Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .github/workflows/push-bundles.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,6 @@ on:
default: '0.1'

env:
QUAY_REPO: quay.io/rh-ee-ikrispin/abevalflow-catalog
VERSION: ${{ github.event.inputs.version || '0.1' }}

jobs:
Expand Down
14 changes: 14 additions & 0 deletions Docs/infrastructure_ops.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,20 @@ Deployment and operations reference for running Agentic Eval Flow on OpenShift.
- `oc` CLI authenticated with cluster-admin or namespace-admin
- `tkn` CLI (optional, for manual pipeline triggers and PipelineRun cleanup)

## Quay.io images (org registry)

Published Agentic Eval Flow images live under **`quay.io/ecosystem-appeng/`** (not a personal namespace):

| Image / bundle | Use |
|---|---|
| `abevalflow-redteam`, `abevalflow-pyrit` | Classic + Konflux red-team Task steps |
| `abevalflow-eval-base` | Konflux evaluate default (classic CI uses the OpenShift internal `eval-base` ImageStream instead) |
| `abevalflow-task-*` | Tekton Bundles for Konflux IntegrationTestScenario |

**CI push:** GitHub Actions (`push-bundles`) authenticates with robot account `ecosystem-appeng+abevalflow` via repo secrets `QUAY_USERNAME` / `QUAY_TOKEN`. Local pushes use the same robot (`podman login quay.io` then `make bundles` in `pipeline/integration`).

**Cluster pull (`ab-eval-flow`):** Keep a `quay-pull-secret` dockerconfig secret for `quay.io` with that robot, and attach it to the Tekton `pipeline` ServiceAccount `imagePullSecrets` so red-team / Quay-backed steps can pull if repos are private. Classic Harbor/AEH evaluate steps continue to use `image-registry.openshift-image-registry.svc:5000/ab-eval-flow/eval-base:*` and do not depend on Quay.

## Namespace Setup

```bash
Expand Down
16 changes: 8 additions & 8 deletions Docs/konflux-integration-guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -316,14 +316,14 @@ The core tasks are published as Tekton Bundles to Quay.io:

| Bundle | Task |
|--------|------|
| `quay.io/rh-ee-ikrispin/abevalflow-task-parse-snapshot:0.1` | parse-snapshot |
| `quay.io/rh-ee-ikrispin/abevalflow-task-prepare:0.1` | prepare |
| `quay.io/rh-ee-ikrispin/abevalflow-task-test:0.1` | test |
| `quay.io/rh-ee-ikrispin/abevalflow-task-evaluate:0.1` | evaluate |
| `quay.io/rh-ee-ikrispin/abevalflow-task-analyze-scorecard:0.1` | analyze-scorecard |
| `quay.io/rh-ee-ikrispin/abevalflow-task-store:0.1` | store |
| `quay.io/rh-ee-ikrispin/abevalflow-task-red-team:0.1` | red-team (opt-in) |
| `quay.io/rh-ee-ikrispin/abevalflow-task-emit-result:0.1` | emit-result |
| `quay.io/ecosystem-appeng/abevalflow-task-parse-snapshot:0.1` | parse-snapshot |
| `quay.io/ecosystem-appeng/abevalflow-task-prepare:0.1` | prepare |
| `quay.io/ecosystem-appeng/abevalflow-task-test:0.1` | test |
| `quay.io/ecosystem-appeng/abevalflow-task-evaluate:0.1` | evaluate |
| `quay.io/ecosystem-appeng/abevalflow-task-analyze-scorecard:0.1` | analyze-scorecard |
| `quay.io/ecosystem-appeng/abevalflow-task-store:0.1` | store |
| `quay.io/ecosystem-appeng/abevalflow-task-red-team:0.1` | red-team (opt-in) |
| `quay.io/ecosystem-appeng/abevalflow-task-emit-result:0.1` | emit-result |

To rebuild bundles after editing task YAML:
```bash
Expand Down
2 changes: 1 addition & 1 deletion pipeline/integration/Makefile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
QUAY_NS ?= quay.io/rh-ee-ikrispin
QUAY_NS ?= quay.io/ecosystem-appeng
VERSION ?= 0.1
TASKS_DIR := ../tasks/konflux

Expand Down
16 changes: 8 additions & 8 deletions pipeline/integration/konflux-eval-pipelinerun.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -152,7 +152,7 @@ spec:
- name: name
value: parse-snapshot
- name: bundle
value: quay.io/rh-ee-ikrispin/abevalflow-task-parse-snapshot:0.1
value: quay.io/ecosystem-appeng/abevalflow-task-parse-snapshot:0.1
- name: kind
value: task
params:
Expand All @@ -170,7 +170,7 @@ spec:
- name: name
value: prepare
- name: bundle
value: quay.io/rh-ee-ikrispin/abevalflow-task-prepare:0.1
value: quay.io/ecosystem-appeng/abevalflow-task-prepare:0.1
- name: kind
value: task
params:
Expand Down Expand Up @@ -205,7 +205,7 @@ spec:
- name: name
value: test
- name: bundle
value: quay.io/rh-ee-ikrispin/abevalflow-task-test:0.1
value: quay.io/ecosystem-appeng/abevalflow-task-test:0.1
- name: kind
value: task
params:
Expand Down Expand Up @@ -255,7 +255,7 @@ spec:
- name: name
value: red-team
- name: bundle
value: quay.io/rh-ee-ikrispin/abevalflow-task-red-team:0.1
value: quay.io/ecosystem-appeng/abevalflow-task-red-team:0.1
- name: kind
value: task
params:
Expand Down Expand Up @@ -301,7 +301,7 @@ spec:
- name: name
value: evaluate
- name: bundle
value: quay.io/rh-ee-ikrispin/abevalflow-task-evaluate:0.1
value: quay.io/ecosystem-appeng/abevalflow-task-evaluate:0.1
- name: kind
value: task
params:
Expand Down Expand Up @@ -354,7 +354,7 @@ spec:
- name: name
value: analyze-scorecard
- name: bundle
value: quay.io/rh-ee-ikrispin/abevalflow-task-analyze-scorecard:0.1
value: quay.io/ecosystem-appeng/abevalflow-task-analyze-scorecard:0.1
- name: kind
value: task
params:
Expand Down Expand Up @@ -391,7 +391,7 @@ spec:
- name: name
value: store
- name: bundle
value: quay.io/rh-ee-ikrispin/abevalflow-task-store:0.1
value: quay.io/ecosystem-appeng/abevalflow-task-store:0.1
- name: kind
value: task
params:
Expand Down Expand Up @@ -426,7 +426,7 @@ spec:
- name: name
value: emit-result
- name: bundle
value: quay.io/rh-ee-ikrispin/abevalflow-task-emit-result:0.1
value: quay.io/ecosystem-appeng/abevalflow-task-emit-result:0.1
- name: kind
value: task
params:
Expand Down
2 changes: 1 addition & 1 deletion pipeline/tasks/konflux/evaluate.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ spec:
description: Git branch/tag/SHA of the submission repo
- name: eval-base-image
type: string
default: "quay.io/rh-ee-ikrispin/abevalflow-eval-base:latest"
default: "quay.io/ecosystem-appeng/abevalflow-eval-base:latest"
description: Container image with Harbor + dependencies pre-installed
- name: llm-model
type: string
Expand Down
4 changes: 2 additions & 2 deletions pipeline/tasks/konflux/red-team.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -159,7 +159,7 @@ spec:
echo "Config generated at $CONFIG_DIR/promptfooconfig.yaml"

- name: run-redteam
image: quay.io/rh-ee-ikrispin/abevalflow-redteam:latest
image: quay.io/ecosystem-appeng/abevalflow-redteam:latest
env:
- name: CI
value: "true"
Expand Down Expand Up @@ -274,7 +274,7 @@ spec:
echo "Promptfoo complete: $FINDINGS findings, passed=$PASSED"

- name: run-crescendo
image: quay.io/rh-ee-ikrispin/abevalflow-pyrit:0.1
image: quay.io/ecosystem-appeng/abevalflow-pyrit:0.1
script: |
#!/usr/bin/env bash
set -euo pipefail
Expand Down
4 changes: 2 additions & 2 deletions pipeline/tasks/phases/red-team.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -150,7 +150,7 @@ spec:
echo "Config generated at $CONFIG_DIR/promptfooconfig.yaml"

- name: run-redteam
image: quay.io/rh-ee-ikrispin/abevalflow-redteam:latest
image: quay.io/ecosystem-appeng/abevalflow-redteam:latest
env:
- name: CI
value: "true"
Expand Down Expand Up @@ -237,7 +237,7 @@ spec:
echo "Promptfoo complete: $FINDINGS findings, passed=$PASSED"

- name: run-crescendo
image: quay.io/rh-ee-ikrispin/abevalflow-pyrit:0.1
image: quay.io/ecosystem-appeng/abevalflow-pyrit:0.1
script: |
#!/usr/bin/env bash
set -euo pipefail
Expand Down
Loading