Skip to content

Claude/reddit ai relationships scraper ugh g8#11

Merged
jheller1212 merged 3 commits into
mainfrom
claude/reddit-ai-relationships-scraper-UghG8
Mar 11, 2026
Merged

Claude/reddit ai relationships scraper ugh g8#11
jheller1212 merged 3 commits into
mainfrom
claude/reddit-ai-relationships-scraper-UghG8

Conversation

@jheller1212

Copy link
Copy Markdown
Owner

No description provided.

claude added 3 commits March 7, 2026 22:48
Darken text color, increase font size slightly, widen letter-spacing,
and enable font smoothing for better contrast on the yellow gradient.

https://claude.ai/code/session_01JS12oCAdiNAGoSr7NhmNzU
…ystem

- New analyze endpoint probes subreddit (about.json + sort modes) to estimate
  collectible posts, subscribers, and community age
- Two-step flow: Analyze first, then Squeeze with informed expectations
- For >1000 posts: auto-splits "top" across time filters (all/year/month)
  to collect beyond Reddit's per-listing 1000 cap
- Shows time estimate based on post count and comment inclusion
- Saves scrape progress to localStorage every batch — user can close
  browser and resume later via banner prompt
- Resume banner shows on page load if unfinished squeeze exists (24h expiry)
- Progress bar shows remaining time estimate during collection

https://claude.ai/code/session_01JS12oCAdiNAGoSr7NhmNzU
…re, academic fields

Critical fixes:
- #1 Thread-level scraping: paste a post URL and get the post + all
  comments instantly. Auto-detected from input — no new UI needed
- #2 Add Hot, Controversial, Rising sort modes (Controversial is key
  for polarization research)
- #3 Time filter greys out when neither Top nor Controversial is active
- #5 Partial data on Stop: always shows download buttons with message
  "Stopped at X posts. Partial data available below."

Academic data fields added (#7):
- Posts: edited, distinguished, is_crosspost, crosspost_subreddit,
  total_awards_received, gilded
- Comments: depth (nesting level), edited, distinguished,
  controversiality

UX improvements:
- #10 Progressive disclosure: options panel hidden until Analyze
  completes. No more wall of options on first load
- #11 Keyword analysis moved under "Advanced" collapsible section
- #12 Single primary download button "Download for R/Python (Combined
  CSV)" with other formats under collapsible
- #13 CTA renamed to "Squeeze Data" for clarity
- #4 Post limit capped at 1000 with visible note
- #8 Specific error messages for 404/403 (not found, private)
- #9 Input accepts post URLs, subreddit URLs, r/prefix, plain names

https://claude.ai/code/session_01JS12oCAdiNAGoSr7NhmNzU
@netlify

netlify Bot commented Mar 11, 2026

Copy link
Copy Markdown

Deploy Preview for redditscrapersbe ready!

Name Link
🔨 Latest commit 7d51017
🔍 Latest deploy log https://app.netlify.com/projects/redditscrapersbe/deploys/69b1ecb65db09b00086ff0cb
😎 Deploy Preview https://deploy-preview-11--redditscrapersbe.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@jheller1212
jheller1212 merged commit e95fa3f into main Mar 11, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants