Skip to content

Replace CycleState with request attributes (#288) - #294

Open
szedan-rh wants to merge 1 commit into
llm-d:mainfrom
szedan-rh:szedan-rh/288-request-attributes-remove-cyclestate
Open

Replace CycleState with request attributes (#288)#294
szedan-rh wants to merge 1 commit into
llm-d:mainfrom
szedan-rh:szedan-rh/288-request-attributes-remove-cyclestate

Conversation

@szedan-rh

Copy link
Copy Markdown
Contributor

Store plugin-shared data directly on InferenceRequest via a sync.Map
attribute store, matching EPP's pattern. Pass request to response plugin
signatures so they can read attributes set during request phase.
Delete cycle_state.go entirely.

/kind cleanup

  Store plugin-shared data directly on InferenceRequest via a sync.Map
  attribute store, matching EPP's pattern. Pass request to response plugin
  signatures so they can read attributes set during request phase.
  Delete cycle_state.go entirely.

Signed-off-by: szedan <szedan@redhat.com>
@github-actions github-actions Bot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. labels Aug 12, 2026

@ArshVermaGit ArshVermaGit left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please add verification for this cleanup? Since this removes cycle_state.go and changes how request-scoped attributes are stored/read through InferenceRequest, it would be good to confirm the related request/response paths and plugin attribute access still work as expected. Also, please clarify whether this PR should be merged together with #288 or independently.

@szedan-rh

Copy link
Copy Markdown
Contributor Author

@nirrozenbaum - could you please review?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants