Skip to content

fix: Do not recommend good first issue on bot-authored issues - #1002

Closed
VedantMadane wants to merge 1 commit into
fullsend-ai:mainfrom
VedantMadane:fix/issue-200
Closed

fix: Do not recommend good first issue on bot-authored issues#1002
VedantMadane wants to merge 1 commit into
fullsend-ai:mainfrom
VedantMadane:fix/issue-200

Conversation

@VedantMadane

Copy link
Copy Markdown

Summary

Do not recommend good first issue on bot-authored issues

Changes

  • issue-labels github skill: check author before newcomer labels
  • Skip good first issue / first-timers-only when author is a bot

Fixes #200

- issue-labels github skill: check author before newcomer labels
- Skip good first issue / first-timers-only when author is a bot

Fixes fullsend-ai#200

Signed-off-by: Vedant Madane <6527493+VedantMadane@users.noreply.github.com>
@VedantMadane
VedantMadane requested a review from a team as a code owner August 25, 2026 05:32
@github-actions github-actions Bot closed this Aug 25, 2026
@github-actions

Copy link
Copy Markdown

Thank you for your interest in contributing, @VedantMadane.

This project uses a vouch system for first-time contributors. Before submitting a pull request, you need to be vouched by a maintainer.

To get vouched:

  1. Open a Vouch Request discussion on the main fullsend repo.
  2. Describe what you want to change and why.
  3. Write in your own words — do not have an AI generate the request.
  4. A maintainer will comment /vouch if approved.
  5. Once vouched, open a new PR (preferred) or reopen this one.

See CONTRIBUTING.md for details.

@github-actions

Copy link
Copy Markdown

Functional tests did not run

Functional tests run automatically for org/repo members and collaborators on pull requests.

For other contributors, a maintainer must add the ok-to-test label after the latest push.

@qodo-code-review

Copy link
Copy Markdown

PR Summary by Qodo

Skip newcomer label recommendations for bot-authored issues

🐞 Bug fix 📝 Documentation 🕐 Less than 10 minutes

Grey Divider

AI Description

• Prevent recommending newcomer labels (good first issue / first-timers-only) on bot-filed issues.
• Document an explicit author-check step for GitHub issue labeling.
• Add the same rule to the GitLab issue-labeling skill guidance.
Diagram

graph TD
  A["Issue opened"] --> B{"Bot author?"}
  B -->|"Yes"| C["Recommend contextual labels"] --> F["Label suggestions"]
  B -->|"No"| D["Allow newcomer labels"] --> E["Recommend contextual labels"] --> F["Label suggestions"]
Loading
High-Level Assessment

The following are alternative approaches to this PR:

1. Centralize bot-detection guidance in a shared section
  • ➕ Reduces duplication across GitHub/GitLab skill docs
  • ➕ Makes future updates to bot heuristics consistent
  • ➖ Requires reworking documentation structure and cross-references
  • ➖ May be harder to keep platform-specific CLI examples close to the rule
2. Implement bot-author gating in executable code (not just skill docs)
  • ➕ Enforces the rule even if prompts drift
  • ➕ Easier to test deterministically (fixtures for author metadata)
  • ➖ Higher implementation cost and broader changes
  • ➖ Depends on where labeling decisions are actually executed in the system

Recommendation: The PR’s approach (explicitly documenting the author check and the newcomer-label skip) is appropriate for prompt/skill-driven behavior changes and is low-risk. If this rule becomes more complex or critical, consider centralizing the guidance or enforcing it in code to avoid divergence between GitHub and GitLab skills.

Files changed (2) +22 / -0

Bug fix (1) +18 / -0
SKILL.mdAdd explicit bot-author check before recommending newcomer labels +18/-0

Add explicit bot-author check before recommending newcomer labels

• Introduces a new step instructing the skill to query issue author metadata via 'gh issue view ... --json author' before recommending labels. If the author is a bot (via 'is_bot', '[bot]' suffix, or known automation accounts), the guidance forbids recommending newcomer labels like good first issue / first-timers-only while still allowing contextual labels.

skills/issue-labels/github/SKILL.md

Documentation (1) +4 / -0
SKILL.mdDocument rule to avoid good-first-issue labels on bot-authored issues +4/-0

Document rule to avoid good-first-issue labels on bot-authored issues

• Adds a concise directive that bot-authored issues should not receive good first issue recommendations, aligning GitLab guidance with GitHub behavior.

skills/issue-labels/gitlab/SKILL.md

@qodo-code-review

Copy link
Copy Markdown

Code Review by Qodo

🐞 Bugs (2) 📘 Rule violations (0) 📜 Skill insights (2)

Grey Divider


Action required

1. Protected skill files modified 📜 Skill insight § Compliance
Description
The PR modifies files under the protected skills/ governance path. These changes require human
approval and must not be auto-approved, even though the PR links issue #200.
Code

skills/issue-labels/github/SKILL.md[R67-70]

+## Step 3b: Skip newcomer labels on bot-authored issues
+
+Before recommending labels, check who opened the issue:
+
Relevance

●●● Strong

Protected skills changes require human review; recent multi-file skill changes were accepted.

PR-#686
PR-#752

ⓘ Recommendations generated based on similar findings in past PRs

Evidence
The changed files are both under the checklist's explicitly protected skills/ directory, and the
PR description provides an issue link but does not remove the requirement for human review.

skills/issue-labels/github/SKILL.md[67-70]
skills/issue-labels/gitlab/SKILL.md[62-64]
Skill: pr-review

Agent prompt
The issue below was found during a code review. Follow the provided context and guidance below and implement a solution

## Issue description
This PR changes a file under the protected `skills/` path, which must not be auto-approved.

## Issue Context
The compliance policy requires a review finding for any protected-path modification, with human approval before merge.

## Fix Focus Areas
- skills/issue-labels/github/SKILL.md[67-70]
- skills/issue-labels/gitlab/SKILL.md[62-64]

ⓘ Copy this prompt and use it to remediate the issue with your preferred AI generation tools


2. GitLab bot rule lacks author data 🐞 Bug ≡ Correctness
Description
The GitLab skill says not to recommend newcomer labels for bot-authored issues but provides no
procedure for identifying bots, while its preceding issue query only retrieves IID, title, and
labels. Consequently the sub-agent lacks the author information needed to apply the new rule.
Code

skills/issue-labels/gitlab/SKILL.md[R62-64]

+## Bot-authored issues
+
+Do not recommend good first issue on bot-authored issues.
Relevance

●●● Strong

Missing GitLab author lookup prevents applying the explicitly stated bot rule, requiring a
procedural fix.

PR-#686
PR-#8

ⓘ Recommendations generated based on similar findings in past PRs

Evidence
The new section only states a prohibition, and the existing GitLab query projects `{iid, title,
labels}`, excluding author information; the GitHub change explicitly adds an author query, but
GitLab does not.

skills/issue-labels/gitlab/SKILL.md[48-53]
skills/issue-labels/gitlab/SKILL.md[62-64]
skills/issue-labels/github/SKILL.md[69-75]

Agent prompt
The issue below was found during a code review. Follow the provided context and guidance below and implement a solution

## Issue description
The GitLab bot-authored issue rule is not actionable because the skill neither explains bot detection nor retrieves author data.

## Issue Context
Update the GitLab issue lookup to include the author/author username (or add a per-issue author query), then document the relevant GitLab bot-account indicators before label recommendations.

## Fix Focus Areas
- skills/issue-labels/gitlab/SKILL.md[48-53]
- skills/issue-labels/gitlab/SKILL.md[62-64]

ⓘ Copy this prompt and use it to remediate the issue with your preferred AI generation tools



Remediation recommended

3. Bot-label detection contains typos 📜 Skill insight ≡ Correctness
Description
The GitHub skill's bot-account examples misspell renovate as enovate, and the
first-timers-only label contains a corrupted control character. As written, the documented guard
may fail to recognize Renovate-authored issues and cannot reliably exclude the intended newcomer
label from bot-authored issue recommendations.
Code

skills/issue-labels/github/SKILL.md[R75-80]

+If the author is a bot (.author.is_bot is true, login ends with [bot], or
+the account is clearly automation such as dependabot, 
+enovate,
+github-actions, or a *-bot service account), **do not** recommend
+good first issue, good-first-issue, 
+newcomer labels. Bot-filed issues are not onboarding work for humans.
Relevance

●●● Strong

Typos corrupt bot and label detection, a deterministic documentation correctness fix.

PR-#8
PR-#94

ⓘ Recommendations generated based on similar findings in past PRs

Evidence
The changed text explicitly lists enovate instead of the actual renovate account or service
name, while the exclusion list contains a non-printing or nonstandard character before
irst-timers-only rather than the exact first-timers-only label. These errors make the documented
automation detection and label matching inaccurate, even though the repository separately documents
generic bot patterns.

skills/issue-labels/github/SKILL.md[75-80]
skills/issue-labels/github/SKILL.md[75-78]
skills/fix-review/SKILL.md[99-106]
Skill: pr-review

Agent prompt
The issue below was found during a code review. Follow the provided context and guidance below and implement a solution

## Issue description
Correct the bot detection and newcomer-label examples in the GitHub skill: spell `renovate` correctly and restore the exact `first-timers-only` label so bot-authored issues are not recommended for human onboarding labels.

## Issue Context
The guard should recognize Renovate automation while retaining the existing generic `.author.is_bot`, `[bot]`, and `*-bot` checks. The instruction must use the real `first-timers-only` label so bot-authored issues are excluded from that recommendation.

## Fix Focus Areas
- skills/issue-labels/github/SKILL.md[75-80]
- skills/issue-labels/github/SKILL.md[79-80]
- skills/issue-labels/github/SKILL.md[75-78]

ⓘ Copy this prompt and use it to remediate the issue with your preferred AI generation tools


4. Malformed author query block 🐞 Bug ≡ Correctness
Description
The new gh issue view command is surrounded by single backticks rather than a fenced Markdown code
block, unlike the executable commands elsewhere in the skill. This makes the required author lookup
ambiguous to the sub-agent and can cause it to treat the command as inline text instead of an
operation to run.
Code

skills/issue-labels/github/SKILL.md[R71-73]

+`
+gh issue view NUMBER --repo OWNER/REPO --json author
+`
Relevance

●●● Strong

Malformed executable documentation is a concrete correctness issue; repository accepts documentation
consistency fixes.

PR-#753
PR-#946

ⓘ Recommendations generated based on similar findings in past PRs

Evidence
The new command has a single backtick on each boundary, while the existing command examples use
triple-backtick fences.

skills/issue-labels/github/SKILL.md[71-73]
skills/issue-labels/github/SKILL.md[23-25]

Agent prompt
The issue below was found during a code review. Follow the provided context and guidance below and implement a solution

## Issue description
The author lookup is delimited with single backticks, so it is rendered as inline code rather than a clear executable command block.

## Issue Context
Other executable commands in this skill use fenced Markdown blocks. Preserve the command exactly, but delimit it consistently so the sub-agent can execute it.

## Fix Focus Areas
- skills/issue-labels/github/SKILL.md[71-73]

ⓘ Copy this prompt and use it to remediate the issue with your preferred AI generation tools


Grey Divider

Context sources
✅ Compliance rules (platform): 56 rules
✅ Skills: 4 invoked
  code-review
  code-implementation
  pr-review
  docs-review
Review mode: 🚀 Fast: This is a small, localized instruction change across two related skill files; it affects labeling behavior but avoids high-risk areas and has limited independent logic.

Grey Divider

Tip of the day
💡 Did you know, you can hide the parts of a finding you never read, like the evidence or the agent prompt

More tips ↗ | Customize Qodo ↗ | Qodo docs ↗

Grey Divider

Qodo Logo

Comment on lines +67 to +70
## Step 3b: Skip newcomer labels on bot-authored issues

Before recommending labels, check who opened the issue:

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Action required

1. Protected skill files modified 📜 Skill insight § Compliance

The PR modifies files under the protected skills/ governance path. These changes require human
approval and must not be auto-approved, even though the PR links issue #200.
Agent Prompt
## Issue description
This PR changes a file under the protected `skills/` path, which must not be auto-approved.

## Issue Context
The compliance policy requires a review finding for any protected-path modification, with human approval before merge.

## Fix Focus Areas
- skills/issue-labels/github/SKILL.md[67-70]
- skills/issue-labels/gitlab/SKILL.md[62-64]

ⓘ Copy this prompt and use it to remediate the issue with your preferred AI generation tools

Comment on lines +75 to +80
If the author is a bot (.author.is_bot is true, login ends with [bot], or
the account is clearly automation such as dependabot,
enovate,
github-actions, or a *-bot service account), **do not** recommend
good first issue, good-first-issue, irst-timers-only, or equivalent
newcomer labels. Bot-filed issues are not onboarding work for humans.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remediation recommended

2. Bot-label detection contains typos 📜 Skill insight ≡ Correctness

The GitHub skill's bot-account examples misspell renovate as enovate, and the
first-timers-only label contains a corrupted control character. As written, the documented guard
may fail to recognize Renovate-authored issues and cannot reliably exclude the intended newcomer
label from bot-authored issue recommendations.
Agent Prompt
## Issue description
Correct the bot detection and newcomer-label examples in the GitHub skill: spell `renovate` correctly and restore the exact `first-timers-only` label so bot-authored issues are not recommended for human onboarding labels.

## Issue Context
The guard should recognize Renovate automation while retaining the existing generic `.author.is_bot`, `[bot]`, and `*-bot` checks. The instruction must use the real `first-timers-only` label so bot-authored issues are excluded from that recommendation.

## Fix Focus Areas
- skills/issue-labels/github/SKILL.md[75-80]
- skills/issue-labels/github/SKILL.md[79-80]
- skills/issue-labels/github/SKILL.md[75-78]

ⓘ Copy this prompt and use it to remediate the issue with your preferred AI generation tools

Comment on lines +71 to +73
`
gh issue view NUMBER --repo OWNER/REPO --json author
`

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remediation recommended

3. Malformed author query block 🐞 Bug ≡ Correctness

The new gh issue view command is surrounded by single backticks rather than a fenced Markdown code
block, unlike the executable commands elsewhere in the skill. This makes the required author lookup
ambiguous to the sub-agent and can cause it to treat the command as inline text instead of an
operation to run.
Agent Prompt
## Issue description
The author lookup is delimited with single backticks, so it is rendered as inline code rather than a clear executable command block.

## Issue Context
Other executable commands in this skill use fenced Markdown blocks. Preserve the command exactly, but delimit it consistently so the sub-agent can execute it.

## Fix Focus Areas
- skills/issue-labels/github/SKILL.md[71-73]

ⓘ Copy this prompt and use it to remediate the issue with your preferred AI generation tools

Comment on lines +62 to +64
## Bot-authored issues

Do not recommend good first issue on bot-authored issues.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Action required

4. Gitlab bot rule lacks author data 🐞 Bug ≡ Correctness

The GitLab skill says not to recommend newcomer labels for bot-authored issues but provides no
procedure for identifying bots, while its preceding issue query only retrieves IID, title, and
labels. Consequently the sub-agent lacks the author information needed to apply the new rule.
Agent Prompt
## Issue description
The GitLab bot-authored issue rule is not actionable because the skill neither explains bot detection nor retrieves author data.

## Issue Context
Update the GitLab issue lookup to include the author/author username (or add a per-issue author query), then document the relevant GitLab bot-account indicators before label recommendations.

## Fix Focus Areas
- skills/issue-labels/gitlab/SKILL.md[48-53]
- skills/issue-labels/gitlab/SKILL.md[62-64]

ⓘ Copy this prompt and use it to remediate the issue with your preferred AI generation tools

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Triage agent issue-labels skill should skip 'good first issue' for bot-authored issues

1 participant