Skip to content

Recover from expired context caches - #139

Merged
ShadowBearVR merged 1 commit into
chipsalliance:mainfrom
ShadowBearVR:runtime-caching-fixes
Sep 26, 2026
Merged

ShadowBearVR merged 1 commit into
chipsalliance:mainfrom
ShadowBearVR:runtime-caching-fixes

Conversation

@ShadowBearVR

Copy link
Copy Markdown
Collaborator

This PR bypasses redundant instruction state injection and recovers from expired context caches during long evaluations, which otherwise cause ADK-related errors.

Bypass redundant instruction state injection and recover from expired context
caches during long evaluations.

@siemen11 siemen11 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Collin! :D

yield resp
except Exception as e:
cache_id = getattr(cfg, "cached_content", None)
if not cache_id or "is expired" not in str(e).lower():

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe we can make this a bit more general and include "not found" or "expired"

@ShadowBearVR
ShadowBearVR merged commit 6107f75 into chipsalliance:main Sep 26, 2026
3 checks passed
@ShadowBearVR
ShadowBearVR deleted the runtime-caching-fixes branch September 26, 2026 14:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants