Skip to content

domain-skills: add google-trends (Glimpse) skill; fix reddit JSON datacenter block#398

Open
alexandme wants to merge 1 commit into
browser-use:mainfrom
alexandme:domain-skills/google-trends
Open

domain-skills: add google-trends (Glimpse) skill; fix reddit JSON datacenter block#398
alexandme wants to merge 1 commit into
browser-use:mainfrom
alexandme:domain-skills/google-trends

Conversation

@alexandme
Copy link
Copy Markdown

@alexandme alexandme commented Jun 1, 2026

What

New domain-skills/google-trends/scraping.md — Google Trends + the Glimpse extension overlay:

  • explore URL patterns (single term, compare ≤5 on one normalized axis, date=all for 2004→now structural views, Worldwide via omitted geo)
  • extracting Glimpse's modeled absolute monthly volume + YoY from innerText, with direction decoded by sign AND pill color (rgb(118,191,80) = up) — a naive \d+% silently misreads down-terms as up, so unicode-minus normalization + the color check are both needed
  • "Undetermined volume" handling, People Also Search, Discover Trends category drill-down table + CSV export, one-click Get Alerts (saves an Auto alert), Export Data
  • traps: Glimpse absolute volume is a model (treat as rough — trust relative shape/direction/head-to-head), raw Trends is a relative 0-100 index, compare-mode normalizes to the top term, and the chart is not recharts (no JSON/__react* props)

domain-skills/reddit/scraping.md — documents that http_get() and same-origin www.reddit.com/.json now return a 403 datacenter block, and the old.reddit.com same-origin fetch workaround, plus listing-endpoint fan-out (/r/<sub>/top.json?t=year) for mining a whole sub by engagement rather than reading one post at a time. Includes the js() gotcha that the return keyword triggers a sync-IIFE wrap that breaks top-level await (use .then() chains).

Why

Built both while doing trend research; each cost a few exploratory steps to work out (the Glimpse direction-encoding and the Reddit block in particular), so filing them so the next run doesn't pay the same tax — per the SKILL's "always contribute back" norm.

Testing

All techniques exercised live against trends.google.com (with Glimpse installed) and old.reddit.com via the harness.


Summary by cubic

Add a new Google Trends + Glimpse scraping skill to extract absolute monthly volume, YoY, and direction, and document a Reddit .json datacenter block with a working old.reddit.com fetch path. Also adds guidance for Discover Trends CSV/alerts and mining subs via listing endpoints.

  • New Features

    • Google Trends + Glimpse skill: URL patterns, overlay detection, and timed extraction of volume/YoY with unicode-minus normalization and color-based direction.
    • Discover Trends table parsing and CSV export; one-click Get Alerts flow and verification.
    • Key traps: Glimpse volume is modeled (use for shape/direction), raw Trends is 0–100 index, compare mode normalizes to the top term.
  • Bug Fixes

    • www.reddit.com/.json now returns 403; use old.reddit.com with same-origin fetch() to avoid the datacenter block.
    • Listing endpoints for top/hot/new/controversial.json with limit and t params to mine subs by engagement.
    • js() gotcha: avoid return in async chains; use .then()/Promise.all instead.

Written for commit 29cc1ac. Summary will update on new commits.

Review in cubic

- google-trends/scraping.md: new skill for Google Trends + the Glimpse overlay (absolute volume/YoY/direction extraction, Discover Trends table + CSV, Get Alerts, compare mode, date=all structural views; reliability traps).

- reddit/scraping.md: document the www.reddit.com/.json 403 datacenter block and the old.reddit.com same-origin fetch workaround, plus listing-endpoint fan-out for mining a sub.
@browser-harness-review
Copy link
Copy Markdown

✅ Skill review passed

Reviewed 2 file(s) — no findings.

Copy link
Copy Markdown
Contributor

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 2 files

Re-trigger cubic

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant