domain-skills: add google-trends (Glimpse) skill; fix reddit JSON datacenter block#398
Open
alexandme wants to merge 1 commit into
Open
domain-skills: add google-trends (Glimpse) skill; fix reddit JSON datacenter block#398alexandme wants to merge 1 commit into
alexandme wants to merge 1 commit into
Conversation
- google-trends/scraping.md: new skill for Google Trends + the Glimpse overlay (absolute volume/YoY/direction extraction, Discover Trends table + CSV, Get Alerts, compare mode, date=all structural views; reliability traps). - reddit/scraping.md: document the www.reddit.com/.json 403 datacenter block and the old.reddit.com same-origin fetch workaround, plus listing-endpoint fan-out for mining a sub.
✅ Skill review passedReviewed 2 file(s) — no findings. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
New
domain-skills/google-trends/scraping.md— Google Trends + the Glimpse extension overlay:date=allfor 2004→now structural views, Worldwide via omittedgeo)innerText, with direction decoded by sign AND pill color (rgb(118,191,80)= up) — a naive\d+%silently misreads down-terms as up, so unicode-minus normalization + the color check are both needed"Undetermined volume"handling, People Also Search, Discover Trends category drill-down table + CSV export, one-click Get Alerts (saves an Auto alert), Export Data__react*props)domain-skills/reddit/scraping.md— documents thathttp_get()and same-originwww.reddit.com/.jsonnow return a 403 datacenter block, and theold.reddit.comsame-origin fetch workaround, plus listing-endpoint fan-out (/r/<sub>/top.json?t=year) for mining a whole sub by engagement rather than reading one post at a time. Includes thejs()gotcha that thereturnkeyword triggers a sync-IIFE wrap that breaks top-levelawait(use.then()chains).Why
Built both while doing trend research; each cost a few exploratory steps to work out (the Glimpse direction-encoding and the Reddit block in particular), so filing them so the next run doesn't pay the same tax — per the SKILL's "always contribute back" norm.
Testing
All techniques exercised live against
trends.google.com(with Glimpse installed) andold.reddit.comvia the harness.Summary by cubic
Add a new Google Trends + Glimpse scraping skill to extract absolute monthly volume, YoY, and direction, and document a Reddit
.jsondatacenter block with a workingold.reddit.comfetch path. Also adds guidance for Discover Trends CSV/alerts and mining subs via listing endpoints.New Features
Bug Fixes
www.reddit.com/.jsonnow returns 403; useold.reddit.comwith same-originfetch()to avoid the datacenter block.top/hot/new/controversial.jsonwithlimitandtparams to mine subs by engagement.js()gotcha: avoidreturnin async chains; use.then()/Promise.allinstead.Written for commit 29cc1ac. Summary will update on new commits.