feat: improve 5 skill scores + add Tessl review workflow#2
Draft
rohan-tessl wants to merge 2 commits into
Draft
Conversation
Optimized 5 SKILL.md files with the lowest scores using tessl skill review. Key changes per skill: - Fixed name format from underscores to kebab-case (tessl validation blocker) - Expanded descriptions with specific actions and "Use when..." trigger clauses - Added structured workflows, concrete examples, and clear tool requirements - Added metadata.version field | Skill | Before | After | Change | |------------------|--------|-------|--------| | demo-skill | 11% | 80% | +69% | | repo-analyzer | 0% | 75% | +75% | | incident-triager | 0% | 81% | +81% | | ci-log-analyzer | 0% | 86% | +86% | | research-planner | 0% | 85% | +85% | Four skills scored 0% because their names used underscores instead of the required kebab-case format, which blocked the LLM judge from running entirely.
Adds .github/workflows/skill-review.yml that runs tesslio/skill-review on PRs touching **/SKILL.md, posting scores as a single PR comment. Uses only GITHUB_TOKEN — no Tessl login required for contributors. Feedback-only by default (fail-threshold: 0).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Hey @okwinds 👋
I ran your skills through
tessl skill reviewat work and found some targeted improvements.Here's the full before/after:
This PR intentionally caps changes at 5 skills to keep review manageable. The included GitHub Action workflow (see below) will surface Tessl feedback on future
SKILL.mdchanges automatically, so the rest of the library can improve incrementally.Changes summary
Across all 5 skills:
repo_analyzer) instead of required kebab-case (repo-analyzer), which blocked the Tessl validator entirely (0% score). This is the single biggest improvement.metadata.version— resolves the missing version warning.Per-skill details:
repo-analyzer, added analysis checklist (bugs, test coverage, anti-patterns), structured diagnosis output format, and pipeline context.incident-triager, added 5-step human-in-the-loop workflow, example with log parsing and clarification questions, triage summary output.ci-log-analyzer, added shell_exec pytest example, failure parsing workflow, diagnosis output format with file/line/function targeting.research-planner, added 4-phase decomposition (prepare → search → read → synthesize), update_plan status tracking example.Tessl Skill Review GitHub Action
This PR also adds
.github/workflows/skill-review.ymlso future PRs that touchSKILL.mdfiles get automatic review feedback.What this workflow does and why it helps
**/SKILL.md, the workflow runstesslio/skill-reviewand posts one comment with Tessl scores and feedback (updated on new pushes).GITHUB_TOKENis used to post the comment.fail-threshold, it never fails the build.with: fail-threshold: 70later if you want PRs to fail on low skill scores.SKILL.mdgets automatic review comments, so the rest of the 70+ skills can improve incrementally.Honest disclosure — I work at @tesslio where we build tooling around skills like these. Not a pitch — just saw room for improvement and wanted to contribute.
Want to self-improve your skills? Just point your agent (Claude Code, Codex, etc.) at this Tessl guide and ask it to optimize your skill. Ping me — @rohan-tessl — if you hit any snags.
Thanks in advance 🙏