Skip to content

testing.md

Latest commit

 

History

History
61 lines (46 loc) · 2.38 KB

testing.md

File metadata and controls

61 lines (46 loc) · 2.38 KB
Raw

Testing Strategy

Unit Tests

Implemented:

  • Lock-free ring buffer correctness and overflow behavior.
  • Ring buffer empty/full/readable/writable/fill-ratio semantics.
  • Ring buffer reset behavior and concurrent producer/consumer stress run.
  • Fixed-capacity frame accumulator tests for frame boundaries, reset, and sample conservation.
  • Streaming resampler continuity tests for 48k->16k and 44.1k->16k chunking equivalence.
  • VAD transition behavior.
  • Utterance segmentation boundaries.
  • Worker integration fixtures for silence, one utterance, two utterances, pause/resume behavior, minimum-duration rejection, maximum-duration split, and stop finalization.
  • Question detection heuristic confidence gating.
  • Markdown export required sections.
  • SQLite repository migrations and CRUD behavior.

Planned next:

  • Context-window truncation.
  • Structured LLM output parsing.

Persistence mode matrix

  • Default SQLite-enabled build and tests.
  • Explicit in-memory build and tests.
  • Repository tests validate backend-specific behavior through AUDIOCOPILOT_HAS_SQLITE.

Integration Tests (planned)

  • Prerecorded audio -> transcript pipeline.
  • Transcript -> summary pipeline.
  • Question detection -> suggested answer generation.
  • Persistence and reload.
  • Shutdown while inference is active.

Stress Tests (planned)

  • 60-minute prerecorded meeting.
  • Continuous silence and continuous speech.
  • Rapid turn-taking.
  • Audio disconnect simulation.
  • Slower-than-real-time ASR and queue pressure.

Manual microphone validation checklist

  • Launch the JUCE application.
  • Select a physical microphone input.
  • Start recording and verify level meter changes.
  • Verify VAD state changes during speech and returns to silence after trailing silence.
  • Pause and resume recording.
  • Simulate microphone device loss and verify error state and error banner text.
  • Reconnect device, click Recover, and verify recording can be started again.
  • Stop and verify orderly shutdown.

Manual microphone validation notes and runtime observations should be saved in artifacts/microphone/manual-validation-notes.md.

Full side-panel GUI validation notes should be saved in artifacts/fullgui/manual-validation-notes.md.

For fixed-capacity framing milestone validation, configure/build/test logs are stored in artifacts/framequeue/.

For full GUI milestone validation, configure/build/test logs are stored in artifacts/fullgui/.