QVAC-25109 feat[asr-ggml]: propagate Unified RNN-T cache-aware streaming - #4567
Open
freddy311082 wants to merge 3 commits into
Open
freddy311082 wants to merge 3 commits into
freddy311082 wants to merge 3 commits into
Conversation
Contributor
Review StatusCurrent Status: ❌ PENDING Pending reviews: Needs 1 Management or Team Lead, and 1 more from Management, Team Lead, or Member. |
Contributor
License compliance — cleanNo new dependency license findings in this PR. Warn-only (shadow) mode — this check does not block merges yet. Updated automatically by the canonical license compliance workflow. NOTICE presence (advisory)Missing NOTICE (advisory, does not block):
|
freddy311082
had a problem deploying
to
release
September 17, 2026 21:31 — with
GitHub Actions
Failure
freddy311082
had a problem deploying
to
release
September 17, 2026 21:32 — with
GitHub Actions
Failure
freddy311082
had a problem deploying
to
release
September 17, 2026 22:03 — with
GitHub Actions
Failure
freddy311082
had a problem deploying
to
release
September 17, 2026 22:04 — with
GitHub Actions
Failure
freddy311082
had a problem deploying
to
release
September 18, 2026 01:12 — with
GitHub Actions
Failure
freddy311082
force-pushed
the
QVAC-25109/asr-unified-cache-aware-streaming
branch
from
September 18, 2026 18:21
a718913 to
8e96fd0
Compare
freddy311082
requested a deployment
to
release
September 18, 2026 18:31 — with
GitHub Actions
In progress
freddy311082
requested a deployment
to
release
September 18, 2026 18:31 — with
GitHub Actions
In progress
freddy311082
requested a deployment
to
release
September 18, 2026 18:31 — with
GitHub Actions
In progress
freddy311082
requested a deployment
to
release
September 18, 2026 18:31 — with
GitHub Actions
Queued
freddy311082
requested a deployment
to
release
September 18, 2026 18:31 — with
GitHub Actions
In progress
freddy311082
requested a deployment
to
release
September 18, 2026 18:31 — with
GitHub Actions
In progress
freddy311082
requested a deployment
to
release
September 18, 2026 18:31 — with
GitHub Actions
In progress
speech-cpp now drives parakeet-unified-en-0.6b through its native cache-aware encoder instead of re-encoding a sliding window, so the chunk cadence selects a trained operating point rather than an arbitrary window. Give the model its own default of 560 ms, one of the trained chunks, instead of the generic 2000 ms that the engine would snap down anyway, and document the accepted chunk and right-lookahead values on the driver and the parakeet options. The addon keeps forwarding out-of-set values untouched so validation stays in speech-cpp.
…vision (2026-09-18#1) The 2026-09-18#1 registry revision pins qvac-fabric-speech.cpp master at 6380471c, the first published version carrying the Unified RNN-T cache-aware streaming that this package's defaults rely on.
freddy311082
force-pushed
the
QVAC-25109/asr-unified-cache-aware-streaming
branch
from
September 18, 2026 18:38
8e96fd0 to
db9c63e
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Propagates the Unified RNN-T cache-aware streaming that
speech-cppgained inqvac-fabric-speech.cpp#258
up to
@qvac/asr-ggml.parakeet-unified-en-0.6bno longer re-encodes a sliding window whilestreaming: the engine keeps per-layer attention and convolution caches across
steps, so the chunk cadence now selects a trained operating point instead of an
arbitrary window length.
Asana: QVAC-25109.
How
parakeet-unified-en-0.6bgets its own streaming chunk default of 560 ms, oneof the trained chunks, instead of the generic 2000 ms that the engine would
snap down to 1040 ms anyway. The documented default and the effective one now
agree.
stay in
speech-cpprather than being duplicated in the addon.of 80, 160, 560 or 1040 ms, right lookahead of 0, 80, 160, 240, 320, 560 or
1040 ms, both snapped down to the nearest trained value.
speech-cppfloor to2026-09-17.Testing
New addon unit tests cover the default, the four trained chunks passing through
unchanged, that the default is itself a trained operating point, and that
out-of-set values are forwarded rather than coerced.
Full CI was run against the temporary registry and monorepo chain pinning the
ext-lib branch head, and passed end to end, including the ten prebuild
platforms and the GPU integration lanes:
https://github.com/tetherto/qvac/actions/runs/35274766020
Note for the reviewer
The
speech-cppfloor in this PR only resolves once #258 merges and theregistry publishes
2026-09-17. Until then this branch's own CI will fail atdependency resolution. The temporary
vcpkg-configuration.jsonpointer usedfor the run above is deliberately not part of this PR.