Search results

[BUG]: Router wait for recovery flag not working as desired.

[Recovery] Fault Tolerance

bugSomething isn't workingSomething isn't working

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

fault tolerance

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10581 In ai-dynamo/dynamo;

· michaelfeil opened on Jun 11, 2026

[BUG]: Observability Router Recovery + router backoff during worker rollout

[Recovery] Fault Tolerance

bugSomething isn't workingSomething isn't working

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10580 In ai-dynamo/dynamo;

· michaelfeil opened on Jun 11, 2026

Support OTLP HTTP/protobuf export and trace sampling ratio

dep:proposed

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

Feature

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

observabilityRelated to metrics, tracing, loggingRelated to metrics, tracing, logging

Status: Open.

#10575 In ai-dynamo/dynamo;

· AllenXu93 opened on Jun 11, 2026

[CONTRIBUTION]: RouterBackpressureReason::DoNotQueue

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10573 In ai-dynamo/dynamo;

· michaelfeil opened on Jun 11, 2026

[CONTRIBUTION]: priority_load_shed_percent / load shed last contribution

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

dynamo-llmRelates to dynamo-llm componentRelates to dynamo-llm component

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

enhancementNew feature or requestNew feature or request

External Contribution

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

metrics

observabilityRelated to metrics, tracing, loggingRelated to metrics, tracing, logging

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10572 In ai-dynamo/dynamo;

· michaelfeil opened on Jun 11, 2026

[CONTRIBUTION]: fair wspt queue (not starving) 10s

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

dynamo-llmRelates to dynamo-llm componentRelates to dynamo-llm component

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

External Contribution

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

performanceInvolves the performance of DynamoInvolves the performance of Dynamo

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10571 In ai-dynamo/dynamo;

· michaelfeil opened on Jun 11, 2026

[CONTRIBUTION]: perf(kv-router): add fast path for empty PotentialLoads requests

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

External Contribution

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

performanceInvolves the performance of DynamoInvolves the performance of Dynamo

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10566 In ai-dynamo/dynamo;

· michaelfeil opened on Jun 11, 2026

[FEATURE]: Support hte generation-first router on TRTLLM-backend

backend::trtllmRelates to the trtllm backendRelates to the trtllm backend

enhancementNew feature or requestNew feature or request

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10565 In ai-dynamo/dynamo;

· YimianFang opened on Jun 11, 2026

[CONTRIBUTION]: fix(router): decode-overload latch can become permanently stuck, causing 503s after transient load

backend::vllmRelates to the vllm backendRelates to the vllm backend

bugSomething isn't workingSomething isn't working

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10564 In ai-dynamo/dynamo;

· datdo-msft opened on Jun 11, 2026

DEP: shareable multimodal embedding cache and routing support

backend::sglangRelates to the sglang backendRelates to the sglang backend

backend::trtllmRelates to the trtllm backendRelates to the trtllm backend

backend::vllmRelates to the vllm backendRelates to the vllm backend

dep:draftDEP in draft statusDEP in draft status

enhancementNew feature or requestNew feature or request

multimodal

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10563 In ai-dynamo/dynamo;

· furionw opened on Jun 11, 2026

[BUG]: Dynamo disables NIXL telemetry by default but the podmonitor scrapes by default

bugSomething isn't workingSomething isn't working

deployment::k8sRelates to dynamo deployment in kubernetesRelates to dynamo deployment in kubernetes

Dynamo 1.2.0

metrics

nixlRelates to NIXLRelates to NIXL

Status: Open.

#10536 In ai-dynamo/dynamo;

· treydock opened on Jun 10, 2026

[BUG]: Reasoning parser disabled when last message is tool call for Kimi K2.6

bugSomething isn't workingSomething isn't working

frontend`python -m dynamo.frontend` and `dynamo-run in=http|text|grpc``python -m dynamo.frontend` and `dynamo-run in=http|text|grpc`

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

Status: Open.

#10533 In ai-dynamo/dynamo;

· harsh-sarvam opened on Jun 10, 2026