Skip to content

[Unresolved] Derive default reservation amount from request max_tokens #403

Description

@eguzki

Summary

RFC 0021 ships the default reservation amount as a flat constant (uint(5000)) because reliably reading request body fields (requestBodyJSON('/max_tokens')) at the point Reserve needs to evaluate them isn't feasible today. Deriving the default from the request's own max_tokens — a real, protocol-declared upper bound — would be strictly better than a flat heuristic, and is called out as an open question in the RFC rather than a decided design.

This is filed as unresolved/exploratory, not committed scope, per RFC 0021, Unresolved questions.

Context

Acceptance Criteria (of the investigation, not an implementation)

  • Determine whether/how request body access can be made available at the point Reserve's CEL evaluates reservation.amount, without regressing the issue that caused kuadrant-operator#2101 to be reverted
  • Document findings (feasible path, or why it remains infeasible) back into RFC 0021 or a follow-up RFC
  • If feasible, scope the follow-up implementation as a separate issue

Notes for reviewers

This is a design spike, not a coded feature — no PR review checklist applies until a follow-up implementation issue is filed.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    • Status
      No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions