feat(python): add robot-framework-py skill with harness coverage#131
feat(python): add robot-framework-py skill with harness coverage#131arvind3 wants to merge 2 commits intomicrosoft:mainfrom
Conversation
|
@arvind3 please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
Contributor License AgreementContribution License AgreementThis Contribution License Agreement (“Agreement”) is agreed to by the party signing below (“You”),
|
|
|
||
| ```robotframework | ||
| *** Settings *** | ||
| ``` |
There was a problem hiding this comment.
Missing acceptance criteria. Also, I'm not sure if this is aligned with Microsoft ecosystem.
There was a problem hiding this comment.
Pull request overview
Adds a new robot-framework-py skill to the Agent Skills catalog, including acceptance criteria and harness scenarios so the test runner can evaluate Robot Framework–related prompts consistently.
Changes:
- Added new skill content at
.github/skills/robot-framework-py/(skill prompt + acceptance criteria reference). - Added harness scenarios at
tests/scenarios/robot-framework-py/scenarios.yamlto exercise common Robot Framework workflows. - Updated catalog wiring (README counts/catalog entry and a
skills/python/general/link entry).
Reviewed changes
Copilot reviewed 5 out of 5 changed files in this pull request and generated 1 comment.
Show a summary per file
| File | Description |
|---|---|
tests/scenarios/robot-framework-py/scenarios.yaml |
Adds runnable harness scenarios for the new skill (expected/forbidden substring checks + mock responses). |
skills/python/general/robot-framework |
Adds a catalog entry intended to point to the new skill under the backward-compat skills/ tree. |
README.md |
Updates skill counts and adds the robot-framework-py entry to the Python “Patterns & Frameworks” section. |
.github/skills/robot-framework-py/references/acceptance-criteria.md |
Adds acceptance criteria patterns used by the harness evaluator. |
.github/skills/robot-framework-py/SKILL.md |
Introduces the skill guidance for Robot Framework Python-centric automation. |
| @@ -0,0 +1 @@ | |||
| ../../../.github/skills/robot-framework-py No newline at end of file | |||
There was a problem hiding this comment.
This entry is a regular text file containing a path, but the rest of the skills/python/... catalog uses directory symlinks (shown as 0-line entries) that can be traversed (e.g., skills/python/foundry/*). As a plain file, tooling that expects to enumerate skill directories under skills/python/... (or users browsing) won’t be able to navigate into robot-framework to find SKILL.md/references. Please make this a symlink-to-directory like the other entries (git mode 120000 pointing at ../../../.github/skills/robot-framework-py) so it behaves as a directory in the working tree.
Summary
.github/skills/robot-framework-py/SKILL.mdfor Robot Framework Python workflows.github/skills/robot-framework-py/references/acceptance-criteria.mdtests/scenarios/robot-framework-py/scenarios.yamlskills/python/general/robot-frameworkrobot-framework-pyValidation
cd tests && pnpm typecheckcd tests && pnpm test:runcd tests && pnpm harness --listcd tests && pnpm harness robot-framework-py --mock --verbosecd tests && pnpm harness robot-framework-py --ralph --mock --max-iterations 5 --threshold 85Notes
expected_patterns/forbidden_patternsto match current harness behaviorCorrect/Incorrectcode-block parser format used bycriteria-loader