Skip to content
#

ai-from-scratch

Here are 7 public repositories matching this topic...

Language: All
Filter by language

Become skilled in Artificial Intelligence, Machine Learning, Generative AI, Deep Learning, Data Science, Natural Language Processing, Reinforcement Learning, and more with this complete 0 to 100 roadmap repository. Designed for beginners and experts alike, this project offers a comprehensive learning path, curated resources, hands-on tutorials, and

  • Updated Sep 26, 2025

A 125M-parameter decoder-only language model built from scratch in PyTorch, featuring a custom BPE tokenizer, Rotary Positional Embeddings (RoPE), Grouped-Query Attention (GQA), SwiGLU activations, and sharded dataset streaming. The project covers the full training pipeline, from large-scale pretraining to supervised fine-tuning (SFT).

  • Updated Sep 15, 2026
  • Python

A 55M-parameter production-ready Seq2Seq chatbot built from scratch in PyTorch. Features a Bidirectional LSTM Encoder, Bahdanau Attention, LSTM Decoder, and SentencePiece tokenization. Optimized via uv with Automatic Mixed Precision, PyTorch sharded dataset streaming, advanced beam search decoding, and comprehensive checkpoint resumption.

  • Updated Sep 14, 2026
  • Python

Add this topic to your repo

To associate your repository with the ai-from-scratch topic, visit your repo's landing page and select "manage topics."

Learn more