Skip to content

docs(issue-labels): add trigger phrase to description - #752

Merged
ralphbean merged 4 commits into
mainfrom
skillsaw/fix-issue-labels
Aug 14, 2026
Merged

docs(issue-labels): add trigger phrase to description#752
ralphbean merged 4 commits into
mainfrom
skillsaw/fix-issue-labels

Conversation

@ralphbean

Copy link
Copy Markdown
Member

Ran skillsaw (evaluating it per #188) against the repo's skills.
Adds a "Use when..." trigger phrase to the description so
description-based routing has a clear match condition.

Related to #188

Assisted-by: Claude Opus 4.6 noreply@anthropic.com
Signed-off-by: Ralph Bean rbean@redhat.com


Stack created with GitHub Stacks CLIGive Feedback 💬

@ralphbean
ralphbean requested a review from a team as a code owner August 11, 2026 16:59
@qodo-code-review

Copy link
Copy Markdown

PR Summary by Qodo

Add explicit trigger phrase to issue-labels skill description

📝 Documentation 🕐 Less than 5 minutes

Grey Divider

AI Description

• Add a clear "Use when..." trigger phrase to the issue-labels skill description.
• Make description-based skill routing easier by providing an explicit match condition.
Diagram

graph TD
  A["SKILL.md description"] --> B{"Trigger phrase present?"} --> C(["Agent / router"]) --> D(["Select issue-labels skill"])
  subgraph Legend
    direction LR
    _doc["Text/metadata"] ~~~ _dec{"Decision"} ~~~ _proc(["Process"])
  end
Loading
High-Level Assessment

The following are alternative approaches to this PR:

1. Add a machine-readable routing field (e.g., `use_when` / `triggers`)
  • ➕ Avoids relying on prose parsing and phrase conventions
  • ➕ Enables stricter validation/testing of routing behavior
  • ➖ Requires updating the skill schema and any tooling that reads it
  • ➖ More invasive than a doc-only change
2. Add a dedicated "Routing" section with examples
  • ➕ Keeps SKILL.md human-friendly while still improving clarity
  • ➕ Can document multiple trigger examples without overloading the one-line description
  • ➖ May still be harder for automated routing to consume than a structured field
  • ➖ Longer docs can drift if not maintained

Recommendation: For the current goal (evaluating skillsaw and improving routing clarity with minimal risk), the PR’s approach is the best fit. If description-based routing becomes a long-term dependency, consider introducing a structured use_when/triggers field to make matching deterministic and tooling-friendly.

Files changed (1) +3 / -1

Documentation (1) +3 / -1
SKILL.mdClarify issue-labels skill trigger condition in description +3/-1

Clarify issue-labels skill trigger condition in description

• Extends the skill description to include a "Use when..." phrase, making it explicit when the skill should be applied. This supports description-based routing by providing a clear match condition.

skills/issue-labels/SKILL.md

@fullsend-ai-review

fullsend-ai-review Bot commented Aug 11, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 5:00 PM UTC · Completed 5:09 PM UTC

Commit: 1706f1b · View workflow run →

@qodo-code-review

Copy link
Copy Markdown

Code Review by Qodo

🐞 Bugs (0) 📘 Rule violations (0) 📜 Skill insights (1)

Grey Divider


Action required

1. Protected skills/ file modified 📜 Skill insight § Compliance
Description
This PR modifies a protected governance/infrastructure path under skills/, which must not be
auto-approved and requires explicit human review even if the change is documentation-only.
Code

skills/issue-labels/SKILL.md[R5-7]

+  on issues and pull requests. Produces label_actions in the agent result
+  JSON. Use when labeling an issue or pull request based on its content and
+  the repository's label conventions.
Relevance

●●● Strong

Repo has active protected-path enforcement; changes under protected prefixes are treated as
requiring manual review.

PR-#569

ⓘ Recommendations generated based on similar findings in past PRs

Evidence
Compliance rule 1538392 requires raising a finding whenever protected governance/infrastructure
paths (including skills/) are modified. The diff shows added lines in
skills/issue-labels/SKILL.md, which is under the protected skills/ directory.

skills/issue-labels/SKILL.md[5-7]
Skill: pr-review

Agent prompt
The issue below was found during a code review. Follow the provided context and guidance below and implement a solution

## Issue description
The PR modifies a protected path (`skills/`), which must not be auto-approved and needs explicit human/CODEOWNERS review.

## Issue Context
Protected-path changes require heightened scrutiny regardless of whether the change is documentation-only.

## Fix Focus Areas
- skills/issue-labels/SKILL.md[5-7]

ⓘ Copy this prompt and use it to remediate the issue with your preferred AI generation tools


Grey Divider

Context
✅ Compliance rules (platform): 55 rules
✅ Skills: 4 invoked
  code-review
  code-implementation
  pr-review
  docs-review

Grey Divider

Tip of the day
💡 Did you know, you can group findings by type and pick your Finding display, from Minimal to Full

More tips ↗ | Customize Qodo ↗ | Qodo docs ↗

Grey Divider

Qodo Logo

Comment thread skills/issue-labels/SKILL.md Outdated
@fullsend-ai-review

fullsend-ai-review Bot commented Aug 11, 2026

Copy link
Copy Markdown

Review

Findings

Medium

  • [protected-path] skills/issue-labels/github/SKILL.md, skills/issue-labels/gitlab/SKILL.md — These files are under the skills/ protected path, which requires human approval for changes. The PR links to issue Evaluate skillsaw for linting agent instructions #188 and explains the rationale (adding trigger phrases to descriptions for description-based routing after evaluating skillsaw). Human approval is always required for protected-path changes, regardless of context.
Previous run

Review

Findings

Medium

  • [protected-path] skills/issue-labels/github/SKILL.md — This file is under the skills/ protected path, which requires human approval for changes. The PR links to issue Evaluate skillsaw for linting agent instructions #188 and explains the rationale (adding a trigger phrase to the description for description-based routing after evaluating skillsaw). Human approval is always required for protected-path changes, regardless of context.
Previous run (2)

Review

Findings

Medium

  • [protected-path] skills/issue-labels/github/SKILL.md — This file is under the skills/ protected path, which requires human approval for changes. The PR links to issue Evaluate skillsaw for linting agent instructions #188 and explains the rationale (adding a trigger phrase for description-based routing after evaluating skillsaw). Human approval is always required for protected-path changes, regardless of context.
Previous run (3)

Review

Findings

Medium

  • [protected-path] skills/issue-labels/SKILL.md — This file is under the skills/ protected path, which requires human approval for changes. The PR links to issue Evaluate skillsaw for linting agent instructions #188 and explains the rationale (adding a trigger phrase for description-based routing after evaluating skillsaw). Human approval is always required for protected-path changes, regardless of context.
Previous run (4)

Review

Findings

Medium

  • [protected-path] skills/issue-labels/SKILL.md — This file is under the skills/ protected path, which requires human approval for changes. The PR links to issue Evaluate skillsaw for linting agent instructions #188 and explains the rationale (adding a trigger phrase for description-based routing after evaluating skillsaw). Human approval is always required for protected-path changes, regardless of context.
Previous run (5)

Review

Findings

Medium

  • [protected-path] skills/issue-labels/SKILL.md — This file is under the skills/ protected path, which requires human approval for changes. The PR links to issue Evaluate skillsaw for linting agent instructions #188 and explains the rationale (adding a trigger phrase for description-based routing after evaluating skillsaw). Human approval is always required for protected-path changes, regardless of context.

Labels: PR modifies only a skill documentation file, adding a trigger phrase to the description frontmatter.

@fullsend-ai-review fullsend-ai-review Bot added requires-manual-review Review requires human judgment documentation Improvements or additions to documentation labels Aug 11, 2026

@waynesun09 waynesun09 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review-only pass: 1 finding below.

Comment thread skills/issue-labels/SKILL.md Outdated
@ralphbean
ralphbean force-pushed the skillsaw/fix-issue-labels branch from 1706f1b to d7364f5 Compare August 13, 2026 21:38
@fullsend-ai-review

fullsend-ai-review Bot commented Aug 13, 2026

Copy link
Copy Markdown

🤖 Review · ⚠️ Cancelled · Started 9:39 PM UTC · Ended 9:48 PM UTC

Commit: d7364f5 · View workflow run →

@ralphbean

Copy link
Copy Markdown
Member Author

/fs-fix address @waynesun09's finding

@fullsend-ai-coder

fullsend-ai-coder Bot commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

🤖 Finished Fix · ✅ Success · Started 9:43 PM UTC · Completed 9:48 PM UTC

Commit: d7364f5 · View workflow run →

@fullsend-ai-coder

Copy link
Copy Markdown
Contributor

🔧 Fix agent — iteration 1 (human-triggered)

Addressed waynesun09's finding: extended the trigger phrase to mention the skill's primary invocation path (delegation from review and triage agents), matching the convention established in sibling PR #750.

Fixed (1):

  1. Trigger phrase omits delegation invocation path (skills/issue-labels/SKILL.md): Extended the trigger phrase to mention delegation from the review and triage agents, matching the convention in sibling PR docs(docs-review): add trigger phrase to description #750 (docs-review). The phrase now reads: 'Use when labeling an issue or pull request based on its content and the repository label conventions, or when delegated to by the review or triage agent.'

Tests: passed

Next steps:

  • /fs-review — request a re-review of the changes
  • /fs-fix <your instruction> — run another fix pass with specific guidance
  • Push commits directly — review re-runs automatically on push
    Updated by fullsend fix agent

fullsend-ai-coder Bot added a commit that referenced this pull request Aug 13, 2026
Extend the trigger phrase to mention invocation via delegation from the
review and triage agents, matching the convention established in the
sibling docs-review skill (PR #750).

Addresses review feedback on #752
@fullsend-ai-review

fullsend-ai-review Bot commented Aug 13, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 9:49 PM UTC · Completed 9:58 PM UTC

Commit: df8afe0 · View workflow run →

@ralphbean

Copy link
Copy Markdown
Member Author

/fs-fix move the "Use when" trigger language to be the first sentence of the description

@fullsend-ai-coder

fullsend-ai-coder Bot commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

🤖 Finished Fix · ✅ Success · Started 11:58 PM UTC · Completed 12:03 AM UTC

Commit: df8afe0 · View workflow run →

@fullsend-ai-coder

Copy link
Copy Markdown
Contributor

🔧 Fix agent — iteration 2 (human-triggered)

Moved the 'Use when' trigger language to the beginning of the description per human instruction. The sentence order was reversed so the trigger phrase comes first for description-based routing.

Fixed (1):

  1. move trigger phrase to first sentence of description: Reordered the SKILL.md description so the 'Use when' trigger language is the first sentence, followed by the existing description text about discovering labels and producing label_actions.

Tests: passed

Next steps:

  • /fs-review — request a re-review of the changes
  • /fs-fix <your instruction> — run another fix pass with specific guidance
  • Push commits directly — review re-runs automatically on push
    Updated by fullsend fix agent

fullsend-ai-coder Bot added a commit that referenced this pull request Aug 14, 2026
Move the "Use when" trigger language to the beginning of the
description so description-based routing matches it as the first
sentence.

Addresses review feedback on #752
@fullsend-ai-review

fullsend-ai-review Bot commented Aug 14, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 12:04 AM UTC · Completed 12:15 AM UTC

Commit: 7d3a5aa · View workflow run →

@waynesun09 waynesun09 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Trigger phrase now mentions delegation from the review/triage agent, addressing the earlier finding. CI is green.

@waynesun09 waynesun09 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review-only pass: 2 findings below (1 inline, 1 in this summary since its file isn't part of this PR's diff).

MEDIUM: GitLab variant of issue-labels description would remain unfixed even after rebase (skills/issue-labels/gitlab/SKILL.md, near line 3)

Confirmed on main that both skills/issue-labels/github/SKILL.md and skills/issue-labels/gitlab/SKILL.md still carry the original description text with no "Use when..." trigger phrase — this PR's fix only touches the (now-deleted) flat file, so once rebased per the companion CRITICAL finding, applying the change to only the github variant would leave the gitlab variant's description without the same delegation-routing trigger phrase, and the two forge variants would drift out of sync on a field AGENTS.md requires (when/how to use).

Suggestion: when re-applying this fix post-rebase, update the description in both skills/issue-labels/github/SKILL.md and skills/issue-labels/gitlab/SKILL.md with equivalent trigger-phrase wording.

Comment thread skills/issue-labels/github/SKILL.md
@ralphbean
ralphbean force-pushed the skillsaw/fix-issue-labels branch from 7d3a5aa to a9344d5 Compare August 14, 2026 15:37
@fullsend-ai-review

fullsend-ai-review Bot commented Aug 14, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 3:38 PM UTC · Completed 3:45 PM UTC

Commit: a9344d5 · View workflow run →

Base automatically changed from skillsaw/fix-fix-review to main August 14, 2026 16:09
Ran skillsaw (evaluating it per #188) against the repo's skills.
Adds a "Use when..." trigger phrase to the description so
description-based routing has a clear match condition.

Related to #188

Assisted-by: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Ralph Bean <rbean@redhat.com>
Extend the trigger phrase to mention invocation via delegation from the
review and triage agents, matching the convention established in the
sibling docs-review skill (PR #750).

Addresses review feedback on #752
Move the "Use when" trigger language to the beginning of the
description so description-based routing matches it as the first
sentence.

Addresses review feedback on #752
@ralphbean
ralphbean force-pushed the skillsaw/fix-issue-labels branch from a9344d5 to 44b14dd Compare August 14, 2026 16:09
@fullsend-ai-review

fullsend-ai-review Bot commented Aug 14, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 4:10 PM UTC · Completed 4:19 PM UTC

Commit: 44b14dd · View workflow run →

@ralphbean

Copy link
Copy Markdown
Member Author

/fs-fix rebase this on main and replicate the change across the github and gitlab variant

@fullsend-ai-coder

fullsend-ai-coder Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

🤖 Finished Fix · ✅ Success · Started 5:59 PM UTC · Completed 6:03 PM UTC

Commit: 44b14dd · View workflow run →

Replicate the "Use when..." trigger phrase from the github variant
to the gitlab SKILL.md, adapting terminology (merge request, project)
to match GitLab conventions.

Addresses review feedback on #752
@fullsend-ai-coder

Copy link
Copy Markdown
Contributor

🔧 Fix agent — iteration 3 (human-triggered)

Branch was already rebased on main. Replicated the trigger phrase change to the GitLab variant of issue-labels SKILL.md, adapting GitHub terminology (pull request, repository) to GitLab equivalents (merge request, project).

Fixed (2):

  1. rebase on main: Verified branch is already rebased on main (d6e29fa is the fork point and tip of origin/main). No rebase operation needed.
  2. replicate trigger phrase to gitlab variant: Added 'Use when labeling an issue or merge request...' trigger phrase to skills/issue-labels/gitlab/SKILL.md, adapting terminology from the github variant (merge request instead of pull request, project instead of repository) while preserving the GitLab-specific distinguishing text.

Tests: passed

Next steps:

  • /fs-review — request a re-review of the changes
  • /fs-fix <your instruction> — run another fix pass with specific guidance
  • Push commits directly — review re-runs automatically on push
    Updated by fullsend fix agent

@fullsend-ai-review

fullsend-ai-review Bot commented Aug 14, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 6:05 PM UTC · Completed 6:14 PM UTC

Commit: 1a1778d · View workflow run →

@ralphbean
ralphbean added this pull request to the merge queue Aug 14, 2026
Merged via the queue into main with commit 693ed83 Aug 14, 2026
11 checks passed
@ralphbean
ralphbean deleted the skillsaw/fix-issue-labels branch August 14, 2026 18:54
@fullsend-ai-retro

fullsend-ai-retro Bot commented Aug 14, 2026

Copy link
Copy Markdown

🤖 Finished Retro · ✅ Success · Started 6:57 PM UTC · Completed 7:16 PM UTC

Commit: 1a1778d · View workflow run →

@fullsend-ai-retro

Copy link
Copy Markdown

Retro: PR #752 — docs(issue-labels): add trigger phrase to description

Workflow overview

This documentation PR added a "Use when..." trigger phrase to the issue-labels skill description for description-based routing. It was opened by ralphbean as part of evaluating the skillsaw tool (issue #188). The PR went through 3 fix iterations over 3 days before merging, all driven by human reviewer (waynesun09) findings that the review agent did not catch.

Review quality gap

The review agent ran 6 successful review passes and only ever produced the procedural MEDIUM [protected-path] finding (files under skills/ require human approval). All three substantive findings were caught exclusively by the human reviewer:

  1. Delegation omission (MEDIUM) — The trigger phrase omitted the skill's primary invocation path: delegation from the review and triage agents. waynesun09 cited specific lines in agents/review.md and agents/triage.md and pointed to sibling PR docs(docs-review): add trigger phrase to description #750's convention.
  2. Stale base / deleted file (CRITICAL) — The PR was editing a flat skills/issue-labels/SKILL.md that had been restructured into github/ and gitlab/ variants on main. The merge state was CONFLICTING.
  3. GitLab variant parity (MEDIUM) — Only the GitHub variant would receive the trigger phrase fix; the GitLab variant would be left without it.

Notably, in review run 31815407032, the correctness sub-agent explicitly noticed the GitLab variant gap but classified it as "outside PR scope" and did not emit a finding. Per the sub-agent's own instructions, it does not own PR scope evaluation (that belongs to intent-coherence), and it is explicitly required to check beyond-diff files for correctness implications. This was an LLM self-censoring error, not a missing instruction.

Fix agent performance

All 3 fix runs completed successfully in ~5–6 minutes each with no errors or retries. The fix agent handled each /fs-fix command correctly, including adapting GitHub terminology to GitLab conventions for the variant replication in iteration 3.

Evidence for existing open issues

  • agents#235 (review agent should detect significant base-branch divergence): This PR edited a file that had been deleted and restructured on main. The review agent did not flag the merge conflict across 6 runs.
  • agents#108 (short-circuit review on rebase-only pushes): Two review runs were cancelled as superseded by rapid successive pushes, and several runs after rebases produced identical findings to prior runs.
  • agents#338 (re-review should verify cross-file consistency of documentation fixes): Related to the GitLab variant gap, though that issue is specifically scoped to re-review passes.

Proposals filed

Two proposals below address the novel findings from this retro.

Proposals filed

ggallen pushed a commit that referenced this pull request Aug 19, 2026
Extend the trigger phrase to mention invocation via delegation from the
review and triage agents, matching the convention established in the
sibling docs-review skill (PR #750).

Addresses review feedback on #752
ggallen pushed a commit that referenced this pull request Aug 19, 2026
Move the "Use when" trigger language to the beginning of the
description so description-based routing matches it as the first
sentence.

Addresses review feedback on #752
ggallen pushed a commit that referenced this pull request Aug 19, 2026
Replicate the "Use when..." trigger phrase from the github variant
to the gitlab SKILL.md, adapting terminology (merge request, project)
to match GitLab conventions.

Addresses review feedback on #752
ggallen pushed a commit to ggallen/agents that referenced this pull request Aug 19, 2026
Extend the trigger phrase to mention invocation via delegation from the
review and triage agents, matching the convention established in the
sibling docs-review skill (PR fullsend-ai#750).

Addresses review feedback on fullsend-ai#752
ggallen pushed a commit to ggallen/agents that referenced this pull request Aug 19, 2026
Move the "Use when" trigger language to the beginning of the
description so description-based routing matches it as the first
sentence.

Addresses review feedback on fullsend-ai#752
ggallen pushed a commit to ggallen/agents that referenced this pull request Aug 19, 2026
Replicate the "Use when..." trigger phrase from the github variant
to the gitlab SKILL.md, adapting terminology (merge request, project)
to match GitLab conventions.

Addresses review feedback on fullsend-ai#752
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation fullsend-fix requires-manual-review Review requires human judgment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants