Skip to content

Claude/reddit ai relationships scraper ugh g8#9

Merged
jheller1212 merged 2 commits into
mainfrom
claude/reddit-ai-relationships-scraper-UghG8
Mar 7, 2026
Merged

Claude/reddit ai relationships scraper ugh g8#9
jheller1212 merged 2 commits into
mainfrom
claude/reddit-ai-relationships-scraper-UghG8

Conversation

@jheller1212

Copy link
Copy Markdown
Owner

No description provided.

claude added 2 commits March 7, 2026 21:12
- Increase retry count from 3 to 5 with longer backoff (5s, 10s, 20s, 40s, 80s)
- Reduce comment fetch parallelism from 5 to 3 with 1.5s delay between batches
- Add frontend retry logic so transient rate limits don't kill the whole scrape

https://claude.ai/code/session_01JS12oCAdiNAGoSr7NhmNzU
The button text was barely visible against the yellow gradient.
Switched to pure black, bumped font-weight to 800, and added
a subtle text-shadow for contrast.

https://claude.ai/code/session_01JS12oCAdiNAGoSr7NhmNzU
@netlify

netlify Bot commented Mar 7, 2026

Copy link
Copy Markdown

Deploy Preview for redditscrapersbe ready!

Name Link
🔨 Latest commit aff1e0e
🔍 Latest deploy log https://app.netlify.com/projects/redditscrapersbe/deploys/69ac953439fd180008e9912f
😎 Deploy Preview https://deploy-preview-9--redditscrapersbe.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@jheller1212
jheller1212 merged commit 9cc8c19 into main Mar 7, 2026
4 of 5 checks passed
jheller1212 pushed a commit that referenced this pull request Mar 11, 2026
…re, academic fields

Critical fixes:
- #1 Thread-level scraping: paste a post URL and get the post + all
  comments instantly. Auto-detected from input — no new UI needed
- #2 Add Hot, Controversial, Rising sort modes (Controversial is key
  for polarization research)
- #3 Time filter greys out when neither Top nor Controversial is active
- #5 Partial data on Stop: always shows download buttons with message
  "Stopped at X posts. Partial data available below."

Academic data fields added (#7):
- Posts: edited, distinguished, is_crosspost, crosspost_subreddit,
  total_awards_received, gilded
- Comments: depth (nesting level), edited, distinguished,
  controversiality

UX improvements:
- #10 Progressive disclosure: options panel hidden until Analyze
  completes. No more wall of options on first load
- #11 Keyword analysis moved under "Advanced" collapsible section
- #12 Single primary download button "Download for R/Python (Combined
  CSV)" with other formats under collapsible
- #13 CTA renamed to "Squeeze Data" for clarity
- #4 Post limit capped at 1000 with visible note
- #8 Specific error messages for 404/403 (not found, private)
- #9 Input accepts post URLs, subreddit URLs, r/prefix, plain names

https://claude.ai/code/session_01JS12oCAdiNAGoSr7NhmNzU
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants