Skip to content

test: add prompt_score tests + fix scope scoring bug - #55

Closed
TerminalGravity wants to merge 1 commit into
mainfrom
test/prompt-score-and-fix-scope-scoring
Closed

test: add prompt_score tests + fix scope scoring bug#55
TerminalGravity wants to merge 1 commit into
mainfrom
test/prompt-score-and-fix-scope-scoring

Conversation

@TerminalGravity

Copy link
Copy Markdown
Collaborator
  • 14 new tests for scorePrompt covering all 4 scoring dimensions, grade boundaries, and feedback
  • Bug fix: long prompts (>100 chars) no longer get full scope score just for being verbose — requires domain terms
  • Export scorePrompt for testability

All 57 tests pass.

- Add 14 tests for scorePrompt covering all scoring dimensions
- Fix bug: long prompts (>100 chars) no longer get full scope score
  just for being verbose — now requires domain terms (file/function/etc)
- Export scorePrompt for testability

@TerminalGravity TerminalGravity left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch on the scope scoring bug — verbose prompts getting full scope credit just for length was definitely wrong. The domain-term check is the right fix. 14 new tests covering all dimensions is thorough.

@TerminalGravity

Copy link
Copy Markdown
Collaborator Author

Superseded by #66 which has the same fix plus more complete test coverage. Closing.

@TerminalGravity

Copy link
Copy Markdown
Collaborator Author

Superseded by #66.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant