Skip to content

[ARCHIVED] Benchmark issue 471 - #471

Closed
guyoron1 wants to merge 1 commit into
mainfrom
lsp-test/470-api-pattern-replication
Closed

[ARCHIVED] Benchmark issue 471#471
guyoron1 wants to merge 1 commit into
mainfrom
lsp-test/470-api-pattern-replication

Conversation

@guyoron1

Copy link
Copy Markdown
Owner

Closes #470

LSP experiment v2: clean first-review with gopls-lsp enabled.
Code identical to PR #418 (issue #366).
Branch created from commit bc05aa0.

Instruct code agents to read existing sibling methods before
implementing new methods that call the same API endpoint or use
the same multi-step API pattern. Covers replicating error handling
(truncation checks, 404-to-ErrNotFound mapping), retry logic
(retryOnTransient), and response validation.

Prevents a class of medium-severity review findings where new
methods omit error handling that existing methods already
implement for the same endpoint.

Closes #366
@guyoron1

Copy link
Copy Markdown
Owner Author

/fs-review

@fullsend-ai-review

fullsend-ai-review Bot commented Jul 13, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 10:15 AM UTC · Completed 10:21 AM UTC
Commit: 758c511 · View workflow run →

@fullsend-ai-review

fullsend-ai-review Bot commented Jul 13, 2026

Copy link
Copy Markdown

Review

Findings

Medium

Low

  • [specificity_level] AGENTS.md:67 — The new section names specific functions (commitFilesTo) and API details (Git Trees API). This is consistent with existing sections in AGENTS.md — the "Go code" section names specific files like internal/mint/main.go, and the "Forge abstraction" section references specific commands like exec.Command("gh", ...). No change warranted.

Labels: PR is tagged as an LSP experiment with RTK+Ponytail methodology per title conventions.

Previous run

Review — Approve

PR: #471 — Add API pattern replication guidance to AGENTS.md
Scope: 4-line documentation addition to AGENTS.md

Summary

Clean, well-scoped documentation change that adds an "API pattern replication" section to AGENTS.md, directly implementing the guidance proposed in issue #470.

Dimensions evaluated

Dimension Result
Correctness ✅ All 5 technical claims verified against source (commitFilesTo at L647, truncation check at L697-703, retryOnTransient at L561, 404→ErrNotFound at L82-85, Git Trees API pattern confirmed)
Security ✅ No secrets, no prompt injection, no permission changes, no Unicode steganography
Intent & coherence ✅ Traces to issue #470, scope matches exactly, placement after "Forge abstraction" is correct per issue spec
Style & conventions ✅ Heading level (##), directive voice, backtick code references all consistent with existing AGENTS.md patterns
Docs currency ✅ All referenced identifiers (commitFilesTo, retryOnTransient, ErrNotFound, file path) exist in codebase
Cross-repo contracts ⏭ Skipped — no API surface changes

No findings at any severity level.


Protected paths detected — this PR modifies files under one or more
protected paths. The review agent cannot approve PRs that touch these paths.
A human reviewer must approve this PR.

Protected files in this PR:

  • AGENTS.md

Labels: PR adds agent guidance documentation to AGENTS.md

@fullsend-ai-review fullsend-ai-review Bot added requires-manual-review Review requires human judgment documentation Improvements or additions to documentation labels Jul 13, 2026
@fullsend-ai-review

fullsend-ai-review Bot commented Jul 13, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 10:26 AM UTC · Completed 10:36 AM UTC
Commit: fa6bdf7 · View workflow run →

@fullsend-ai-review fullsend-ai-review Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See the review comment for full details.

Comment thread AGENTS.md

**When reviewing PRs:** Flag any direct `exec.Command("gh", ...)`, raw GitHub API calls, or other forge-specific operations outside `internal/forge/github/` as a medium-severity or higher finding. This is an architectural violation, not a style preference.

## API pattern replication

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[medium] protected-path

This PR modifies AGENTS.md, which is a protected governance file. The change is well-justified (linked to issue #470 with clear rationale from a real incident on PR fullsend-ai#2360), but human approval is always required for protected-path changes regardless of context.

Comment thread AGENTS.md

## API pattern replication

When implementing a new method that calls the same API endpoint or uses the same multi-step API pattern as an existing method in the file, read the existing implementation first. Replicate its error handling (e.g., truncation checks, 404-to-ErrNotFound mapping), retry logic (e.g., `retryOnTransient`), and response validation. In `internal/forge/github/github.go`, `commitFilesTo` implements the Git Trees API pattern (refs → commit → tree) with truncation checks — any new method using the same endpoint must handle truncation consistently.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[low] specificity_level

The new section names specific functions (commitFilesTo) and API details (Git Trees API), which is more granular than some sections. However, this is consistent with existing sections — the Go code section names specific files and the Forge abstraction section references specific commands. No change warranted.

@fullsend-ai-review fullsend-ai-review Bot added requires-manual-review Review requires human judgment LSP Benchmark: LSP enabled for review+fix rtk+ponytail Benchmark: RTK+Ponytail optimizations and removed requires-manual-review Review requires human judgment labels Jul 13, 2026
@guyoron1 guyoron1 closed this Jul 14, 2026
@guyoron1 guyoron1 changed the title [LSP] [RTK+Ponytail] Code agent should replicate error handling from sibling methods using the same API endpoint [ARCHIVED] Benchmark issue 471 Jul 14, 2026
@github-actions
github-actions Bot deleted the lsp-test/470-api-pattern-replication branch August 16, 2026 03:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation LSP Benchmark: LSP enabled for review+fix requires-manual-review Review requires human judgment rtk+ponytail Benchmark: RTK+Ponytail optimizations

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ARCHIVED] Benchmark issue 470

1 participant