Skip to content

Feat: add AgentTrust evaluation demo - #516

Open
leeyamin wants to merge 1 commit into
rossoctl:mainfrom
leeyamin:agenttrust-evaluation-demo
Open

Feat: add AgentTrust evaluation demo#516
leeyamin wants to merge 1 commit into
rossoctl:mainfrom
leeyamin:agenttrust-evaluation-demo

Conversation

@leeyamin

@leeyamin leeyamin commented Aug 26, 2026

Copy link
Copy Markdown

Summary

Adds a demo that runs AgentTrust, a scope-compliance evaluation as a Kubernetes job against a live A2A agent. AgentTrust probes an agent with in-scope, out-of-scope, and near-miss requests and reports whether the agent's behavior stays within its declared capabilities according to its agent card.
The demo is report only- results are logged, nothing is enforced.

Related issue(s)

Closes #492

Runs an AgentTrust scope-compliance evaluation as a Kubernetes job against a live A2A agent.

Closes rossoctl#492.

Signed-off-by: Lee Yamin <lyamin@redhat.com>

@kevincogan kevincogan left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@leeyamin Nice work! Just one small fix :))

@@ -0,0 +1,89 @@
# AgentTrust Evaluation Demo

@kevincogan kevincogan Sep 1, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One small thing, could we move the agenttrust-evaluation demo under the existing demos directory here: https://github.com/rossoctl/operator/tree/main/operator/demos . After that we should be good to merge :))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feature: add a report-only capability-alignment evaluation

2 participants