Skip to content

Improve web crawler safety and reliability#13

Merged
mweiden merged 1 commit into
mainfrom
codex/fix-audio-playback-in-web-crawler
Aug 12, 2025
Merged

Improve web crawler safety and reliability#13
mweiden merged 1 commit into
mainfrom
codex/fix-audio-playback-in-web-crawler

Conversation

@mweiden
Copy link
Copy Markdown
Owner

@mweiden mweiden commented Aug 12, 2025

Summary

  • Mute audio and harden Chrome options to avoid sandbox issues
  • Guard navigation with timeouts and filter local URLs from crawl
  • Ensure crawler workers close browsers and handle timeouts

Testing

  • make fix
  • make lint
  • make test

https://chatgpt.com/codex/tasks/task_e_689ad9b070bc8324b8255e4c22d9517c

@mweiden mweiden merged commit 26882d9 into main Aug 12, 2025
1 check passed
@mweiden mweiden deleted the codex/fix-audio-playback-in-web-crawler branch August 12, 2025 06:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant