Skip to content

Fix "This PR is dumb" classification - add test case and training data - #219

Merged
jonathanpeppers merged 3 commits into
mainfrom
copilot/fix-218
Jul 25, 2025
Merged

Fix "This PR is dumb" classification - add test case and training data#219
jonathanpeppers merged 3 commits into
mainfrom
copilot/fix-218

Conversation

Copilot AI commented Jul 25, 2025

Copy link
Copy Markdown
Contributor

The phrase "This PR is dumb" was not being flagged as potentially problematic and should be classified as negative.

Before this fix:

Text 'This PR is dumb', IsNegative 0, Confidence 0.6348764896392822

After this fix:

Text 'This PR is dumb', IsNegative 1, Confidence 0.951298713684082

Changes made:

  • Added verbatim test case "This PR is dumb" to onnxjs/tests/test_cases.json
  • Added 5 similar training examples to comments/classified.csv:
    • "This pull request is dumb"
    • "Your PR is really dumb"
    • "That pull request seems dumb"
    • "This code is pretty dumb"
    • "The implementation is dumb"
  • Rebuilt the ML model which now correctly classifies the phrase as problematic

The fix follows the established pattern for heuristics improvements by using verbatim text in test cases and similar but not identical text in training data. All 219 tests pass including the new test case.

Fixes #218.


💬 Share your feedback on Copilot coding agent for the chance to win a $200 gift card! Click here to start the survey.

Copilot AI and others added 2 commits July 25, 2025 14:10
Co-authored-by: jonathanpeppers <840039+jonathanpeppers@users.noreply.github.com>
… data

Co-authored-by: jonathanpeppers <840039+jonathanpeppers@users.noreply.github.com>
Copilot AI changed the title [WIP] Can we add a case for This PR is dumb Fix "This PR is dumb" classification - add test case and training data Jul 25, 2025
Copilot AI requested a review from jonathanpeppers July 25, 2025 14:16
@jonathanpeppers
jonathanpeppers marked this pull request as ready for review July 25, 2025 15:30
@jonathanpeppers
jonathanpeppers merged commit cb543c0 into main Jul 25, 2025
2 checks passed
@jonathanpeppers
jonathanpeppers deleted the copilot/fix-218 branch July 25, 2025 15:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Can we add a case for This PR is dumb

2 participants