Skip to content

Add final model input/output examples - #4

Merged
tutao0123 merged 2 commits into
mainfrom
agent/readme-final-model-examples
Jul 23, 2026
Merged

Add final model input/output examples#4
tutao0123 merged 2 commits into
mainfrom
agent/readme-final-model-examples

Conversation

@tutao0123

Copy link
Copy Markdown
Owner

Summary

  • add two shared-prompt examples from the completed 106M TinyStories checkpoints to both READMEs
  • show AR and 64-step MDLM continuations side by side
  • preserve the generated text verbatim, mark truncation explicitly, and state that examples do not replace aggregate evaluation
  • include one example exposing MDLM repetition and another showing a comparatively coherent MDLM continuation

Provenance

The examples come from prompt IDs 0 and 573 in the completed fixed 1,000-prompt generation evaluation, using training seeds 1337 and 2027. Prompts are 32 GPT-2 tokens and continuations were generated for 128 tokens in BF16.

Validation

  • pytest tests/test_docs.py (3 passed)
  • ruff check .
  • git diff --check

@tutao0123
tutao0123 merged commit 43a3e74 into main Jul 23, 2026
3 of 6 checks passed
@tutao0123
tutao0123 deleted the agent/readme-final-model-examples branch July 28, 2026 02:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant