Skip to content

feat: pipeline status endpoint + match selection table in Operations#68

Merged
erincon01 merged 1 commit into
developfrom
feat/065-pipeline-status-and-match-selection
Apr 21, 2026
Merged

feat: pipeline status endpoint + match selection table in Operations#68
erincon01 merged 1 commit into
developfrom
feat/065-pipeline-status-and-match-selection

Conversation

@erincon01

Copy link
Copy Markdown
Owner

Summary

  • New endpoint GET /ingestion/pipeline-status?source=X — returns per-match counts: events, aggregations, summaries, embeddings
  • Match status table in Operations with checkboxes and color indicators (green = has data, grey = empty)
  • Per-step selection: steps 3-5 (Aggregate, Summaries, Embeddings) use matches selected from the table, not from catalog
  • Steps 1-2 (Download, Load) still use catalog selection (data not yet in DB)
  • Table auto-refreshes every 5 seconds

Test plan

  • Backend: 530 passed, 0 failed
  • E2E operations: 4 passed, 1 skipped
  • Visual: select 2 matches, run Aggregate — only those 2 get processed

…tions

New GET /ingestion/pipeline-status?source=X endpoint returns per-match
counts (events, aggregations, summaries, embeddings). Operations page
now shows a match status table with checkboxes — steps 3-5 (aggregate,
summaries, embeddings) use selected matches from the table instead of
catalog selection. Green/grey indicators show pipeline progress per match.
@erincon01 erincon01 merged commit 03a748b into develop Apr 21, 2026
5 checks passed
@erincon01 erincon01 deleted the feat/065-pipeline-status-and-match-selection branch April 21, 2026 22:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant