Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

56 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

testbed

A testbed for @sidestep/core.

The purpose of this repo is to auto-generate whole applications from one-shot prompts and use the results as feedback on @sidestep/core — its ergonomics, its type inference, its docs, and the shape of the code an AI naturally writes against it. Each subdirectory is a self-contained app produced from a single prompt; reading the generated code tells us where the library is intuitive and where it fights the model.

Each generated app lives in its own folder under build/ with its own README.md and FEEDBACK.md. Keeping every app under build/ means the testbed resets to a clean slate by wiping that one folder. None yet — run the prompt to create the first one.

The workflow

Every app is produced the same way so the results are comparable:

  1. Run the prompt. Hand PROMPT.md to a fresh AI agent, one shot. It invents a small app idea, builds a React frontend, authors the backend with @sidestep/core, and lands everything in its own new kebab-case folder under build/<core-version>/ (the resolved @sidestep/core version, e.g. build/3.0.0/).
  2. Keep the raw output. The point is to observe what the model produces unassisted — don't hand-polish the friction away.
  3. Audit the feedback. Each app must include a FEEDBACK.md (copied from templates/FEEDBACK.template.md and filled in) — a structured, scored record of what building against @sidestep/core was actually like. That file is the signal we collect across every app.

The agent learns @sidestep/core only from the package itself — its types, JSDoc, and docs — never by cribbing from another app in this repo. That keeps each build an honest test of whether the library can teach itself.

testbed/
├── PROMPT.md                      ← the one-shot prompt to run
├── templates/FEEDBACK.template.md ← the auditable feedback template
└── build/                         ← all generated apps (wipe to reset)
    └── <core-version>/            ← bucketed by resolved @sidestep/core version
        └── <new-app>/             ← each generated app in its own folder
            ├── README.md
            └── FEEDBACK.md        ← filled-in per-app feedback

About

Testbed for auto-generating apps from one-shot prompts to gather feedback on @sidestep/core

Resources

Stars

Watchers

Forks

Releases

Packages

Used by

Contributors

Languages