JW Labs — jwlabs.vercel.app
A small independent research group I started, where a few friends and I tinker with LLM inference, speculative decoding, and KV-cache systems and write up what we learn. GitHub org
Research & Engineering Writing
| Post | Code | Summary |
|---|---|---|
| SparklingTree: 30% faster than DSpark speculative decoding | repo | Combines first-order Markov correction (DSpark), tree-based block diffusion drafting (DDTree), and best-first search into a frontier speculator. |
| Specialization is (sometimes) all Speculation needs | repo | LoRA-specialized block diffusion drafters improve speculative decoding acceptance up to 46% on OOD languages (up to 15.3% wall-clock speedup). |
| Biting the Bullet: Predictive Speculative KV Replication | repo | Predictive KV warming for bursty LLM inference — proactively replicating shared prefix cache to cut TTFT. |
| Infer-Sim: An open-source simulator for routing & cache policies | repo | Lightweight simulator for replaying inference workloads and testing routing/cache policies before production. |
| Decoding Speculative Decoding from First Principles | — | Walks through the history of speculative decoding, from Leviathan's drafter/verifier trick through tree verification and diffusion drafters. |
Other Repos
| Repo | Description |
|---|---|
| jwlabs | The JW Labs research site. |
| CTorch | PyTorch-style autograd engine built in C. |
| flashkv | KV-cache systems experiments. |
| intellikv | KV-cache systems experiments. |
| supercoder-long-context | SuperCoder for long-context assembly generation. |
| supercoder-debug | Improving SuperCoder by RL'ing a debug stage. |
| infra | Benchmarking + validating ARM assembly for evals. |
| Project | Description |
|---|---|
| Unagi | 🏆 Won $16,000 at EthDenver 2025! DePIN of autonomously verified security cameras |
| Loop | 🏆 Won $3,000 at ethSF 2024! On-chain Reinforcement Learning with Human Feedback (RLHF). |
| CryptoClash | 🏆 Won $11,000 at HackFS! A 3D Multiplayer Fighting Game with NFTs. |
| MOVEMENT | 🏆 Won $100 at Frameworks Hackathon! Decentralized GoFundMe + Change.org. |
| TrainAi | Incentivizes sorting, labeling, and preprocessing image data for AI training with crypto. |
| PaperDex | Chrome extension for paper trading cryptocurrencies on DexScreener. |
| CryptoWrapped | SpotifyWrapped - for your cryptocurrency trades. Simply enter your ETH address. |
| mbc | MBC Hackathon 2025! Bazaar - Tokenizes API pricing structures, creating a dynamic marketplace where each API has its own tradeable token. Market-driven pricing that adjusts based on real demand using x402 and Flaunch. |
| Project | Description |
|---|---|
| CORCH | Autograd engine from scratch in C |
| FedLearning | Interactive site exploring federated learning with pseudo-servers. |
| CollegeAcceptancePredictor | Predicts college acceptances using data scraped from r/collegeresults. |
| GPT-2 Implementation | Reimplementing GPT-2 from scratch following Karpathy's guide (in progress). |
| ShopifyReviews | Finetuned a llama2 model to analyze Shopify user reviews. |
| Memary | Contributed features to a collaborative memory system for AI agents. |
| Project | Description |
|---|---|
| Nand2Tetris | Building a computer in HDL from the ground up using NAND chips. |
| MESI-cache-protocol | Simulates the MESI (Modified, Exclusive, Shared, Invalid) cache coherence protocol for multi-core systems. Interactive visualization demonstrating how cache coherency works. |
| cbp2025 | Championship Branch Prediction 2025 - Implemented multiple branch predictors (bimodal, gshare, perceptron) to test and optimize CPU branch prediction accuracy. |
| Project | Description |
|---|---|
| Mirage | 🏆 Won 1st Place Modal Inference Track @TreeHacks 2026! Synthesizes 3D world-model training data for robots and self-driving cars covering hard-to-capture edge cases (e.g. driving in a hailstorm). Uses Veo3 + Gaussian Splatting on H100 GPUs. |
| Uxer | MCP (Model Context Protocol) that enables Cursor to open up your web app, test it, and iterate on it. Gives Cursor access to control your localhost browser and test E2E features autonomously. |
| GCinema | AI-powered silent film colorization pipeline that segments black-and-white films scene-by-scene, colorizes them, and generates a synchronized soundtrack. Demo tweet. |
| djeet | 🏆 $225 Winner at 2025 TVG Vibeathon! Live DJ mixing platform with drag-and-drop interface. Built in 5 hours - pick songs, drag onto canvas, connect with seamless transitions. |
| GameTok | YCombinator Hackathon 2025! TikTok-style infinite scroll platform for AI-generated video games. Built in 5 hours with Morph LLM and real-time code generation. |
| WASP | 🏆 $700 Winner at UT Austin Momentum Hackathon! Simulate 1000s of UX interviews +A/B testing with browser agents instantly. |
| Jest | Marriage pact app for Jester West dorm at UT Austin. Achieved 300+ downloads among dorm residents. |
| GoonBase | Patreon-style platform built on Base blockchain for the baseapp community. Crypto-native creator economy features. |
| GoonLock | MacOS app that texts your ex if you're distracted. Uses YOLOv8 computer vision to detect phone usage and automatically sends texts to your ex. |
| Ramba_Mamba Game Dev | 🎥 YouTube Channel - Educational content teaching 3D game development using Unity and C# since age 13. 250 subscribers, 20,000+ views, 2,000+ Discord members. |
| SOS | 🏆 $3,500 Winner at OMI Hacks! AI-powered app to detect danger and alert family. |
| Ramba | The AI agent that leads your zoom calls. Built in just 2 hours @nvidiaXvercel "worlds shortest hackathon" |
| hashMind | Real-time energy pricing visualization combining Texas ERCOT grid data with AI simulations. Got top 5 at MARA hackathon in SF 🏆 |
| Project | Description |
|---|---|
| TrackItNow | Inventory management system for a volunteering org managing $15K+. |
| RateMyJudge | Like RateMyProf, but for analyzing debate judge preferences. |
| Stockr | Practice trading stocks on real historical data. |
| StockBenchmark | Stock trading benchmark and analysis tool. |
| papertrade-polymarket | Paper trading platform for Polymarket prediction markets. |
| ClassBot | Bot that auto-joins online classes (COVID-19 project). |
| PooKarma | Social app rewarding users for picking up dog poop (HackTX project). |
| InSight | Chrome extension generating image summaries to improve text comprehension. |
| ShoeMonitor | Tracks sneaker resell prices and sends Discord alerts for deals. |
| Checkpoint.AI | AI-powered tool to compare student homework against teacher keys. |
| Edualize | Enables teachers to create interactive 3D quizzes. |
Personal Site: shreybirmiwal.vercel.app
Email me: shrey@utexas.edu