[serve] Add max_request_retries to bound router retry loops - #64399

Open

HrushiYadav wants to merge 6 commits into

ray-project:masterfrom

HrushiYadav:fix/serve-router-retry-limit

Commits on Oct 2, 2026

[serve] Add max_request_retries to bound router retry loops
HrushiYadav
committed
636ff0f
refactor: store max_queued_requests on AsyncioRouter directly
HrushiYadav
committed
25703eb
address review: move unit test, fix imports, add docs
HrushiYadav
committed
ba39384
add max_request_retries to serve.proto for controller serialization
HrushiYadav
committed
98505e7
[serve] Replace flaky retry-limit integration test with deterministic unit test
HrushiYadav
committed
ab69905
[serve] Add max_request_retries to expected get_serve_instance_details JSON
HrushiYadav
committed
d2217f1