Skip to content

Phase 3: screen capture + indexing#9

Draft
Copilot wants to merge 3 commits intomainfrom
copilot/add-screen-capture-indexing
Draft

Phase 3: screen capture + indexing#9
Copilot wants to merge 3 commits intomainfrom
copilot/add-screen-capture-indexing

Conversation

Copy link
Copy Markdown

Copilot AI commented Apr 11, 2026

Implements Module 3 from the agent plan: periodic multi-monitor screenshot capture, OCR, LLM summarisation, privacy filtering, and SQLite indexing — plus the snap one-shot CLI command.

New packages

internal/store

Minimal SQLite store backing all future phases. Runs schema migrations on Open. InsertEvent is the write path for capture (and future) events.

internal/capture

Full capture pipeline assembled as a Capturer struct:

CaptureAll()  →  OCR()  →  PrivacyFilter.MatchesText()  →  Summarise()  →  IndexCapture()
  • capture.goCaptureAll via kbinani/screenshot; OCR shells out to tesseract (degrades gracefully to empty string when not installed); Summarise calls the engine with "Summarise the following screen content in 2 sentences: …"
  • privacy.go — loads ~/.super-ollama/privacy.toml (XDG-aware); filters on skip_keywords (case-insensitive text match) and skip_window_titles (compiled as case-insensitive regex patterns)
  • scheduler.goStartScheduler wraps robfig/cron at the configured interval; returns a draining stop() func

Updated

  • internal/config — adds capture_interval_minutes (default 5) and capture_enabled
  • cmd/super-ollama/main.go — replaces snap stub with a real command: loads config + privacy filter + engine + store, runs Snap(), prints per-display summaries

New dependencies

  • github.com/robfig/cron/v3 v3.0.1
  • github.com/kbinani/screenshot v0.0.0-20230812210009-b87d31814237

Copilot AI and others added 2 commits April 11, 2026 13:55
Agent-Logs-Url: https://github.com/Kritarth-Dandapat/super-ollama/sessions/758aabf0-5938-4cd9-969c-649bc0176283

Co-authored-by: Kritarth-Dandapat <141005022+Kritarth-Dandapat@users.noreply.github.com>
Agent-Logs-Url: https://github.com/Kritarth-Dandapat/super-ollama/sessions/758aabf0-5938-4cd9-969c-649bc0176283

Co-authored-by: Kritarth-Dandapat <141005022+Kritarth-Dandapat@users.noreply.github.com>
Copilot AI changed the title [WIP] Add screen capture and indexing functionality Phase 3: screen capture + indexing Apr 11, 2026
Copilot AI requested a review from Kritarth-Dandapat April 11, 2026 14:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Phase 3: screen capture + indexing

2 participants