Add skills, hooks and docs for agentic testing#661
Draft
jacobtomlinson wants to merge 1 commit intorapidsai:mainfrom
Draft
Add skills, hooks and docs for agentic testing#661jacobtomlinson wants to merge 1 commit intorapidsai:mainfrom
jacobtomlinson wants to merge 1 commit intorapidsai:mainfrom
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add some skills and hooks for automating docs testing with coding agents like Claude Code. Also adds some boilerplate content for coding agents like an
AGENTS.md(withCLAUDE.mdsymlink).In
.claude/skillsyou will find a couple of skills which allow you to test individual pages. It works by using playwright-cli to drive a browser and carry out the steps in the documentation page.The goal here is for human-in-the-loop testing. You may not want to automate every action, and you may want the agent to defer to the user in case of failure. The goal is to kick off an agent and keep an eye on it while it runs through the documentation, requiring minimal effort from the user.
Example
You can kick off a testing job using the
/release-testingskill, just tell it which page you want to test.claude "/release-testing test the AWS EC2 page"The agent will take the following actions:
playwright-cliNote: It will not perform destructive tasks like deleting resources so you will need to do this manually.