In the age of AI-powered development, IBM Bob and similar AI agents can ship entire features in minutes. But there's a critical question:
"How do you know the AI didn't sneak in unintended changes, security vulnerabilities, or collateral damage?"
Traditional code review is too slow for AI-speed development. You need AI-speed governance.
BobWatch is the first AI governance layer specifically designed for Bob-generated code. It analyzes GitHub Pull Requests in real-time, comparing what you asked for against what was actually built, and categorizes every change as:
- β INTENDED - Direct fulfillment of your requirements
β οΈ COLLATERAL - Necessary side effects (dependencies, configs, refactoring)- π¨ RISKY - Security vulnerabilities, auth bypasses, exposed secrets, MCP threats
Paste any GitHub PR URL and describe what you asked Bob to build. BobWatch uses Gemini 2.5 Flash to analyze the complete diff and calculate your Trust Reality Delta (TRD) score.
Detects cutting-edge AI agent vulnerabilities:
- π¨ Instruction Boundary Breaches - Data/command separation failures
- π¨ Confused Deputy Attacks - AI agent privilege escalation
- π¨ Prompt Injection Vectors - Hidden commands in tool responses
Automatically watches your codebase for changes and analyzes files in real-time:
npm run watch:dev # Start dev server + file watcherOne-click security fixes powered by Gemini:
- Generates secure replacement code
- Creates automatic backups
- Downloads remediated files instantly
Upload raw Bob IDE session logs for forensic analysis of entire development conversations.
The TRD Score quantifies the gap between developer intent and actual implementation:
// Scoring Algorithm
let score = 100; // Start with perfect trust
// Deductions
score -= (riskyFiles.length * 20); // -20% per security issue
score -= (collateralFiles.length * 5); // -5% per side effect
// Final score clamped to 0-100| Score | Status | Action |
|---|---|---|
| 90-100% | β Excellent | Ship with confidence |
| 70-89% | Minor concerns, review collateral | |
| 50-69% | π Moderate | Significant drift, careful review needed |
| 0-49% | π¨ Critical | Major issues detected, DO NOT MERGE |
| Technology | Purpose |
|---|---|
| IBM Bob | Built 100% of the application |
| Next.js 14 | React framework with App Router |
| Gemini 2.5 Flash | AI-powered security analysis |
| GitHub API | Pull request diff extraction |
| Vercel | Production deployment |
| Node.js File Watcher | Real-time code monitoring |
- Node.js 18+
- Gemini API key (Get one free)
- Git
# 1. Clone the repository
git clone https://github.com/ch1n-may/bobwatch.git
cd bobwatch
# 2. Install dependencies
npm install
# 3. Configure environment variables
cp .env.example .env.local
# Add your GEMINI_API_KEY to .env.local
# 4. Start development server
npm run dev
# 5. (Optional) Start with file watcher
npm run watch:devOpen http://localhost:3000 and start analyzing!
Create .env.local in the root directory:
# Required: Gemini API Key
GEMINI_API_KEY=your_gemini_api_key_here
# Optional: Presentation Mode (bypasses GitHub API for demos)
PRESENTATION_MODE=falsenpm run dev # Start Next.js dev server
npm run build # Build for production
npm run start # Start production server
npm run watch:dev # Dev server + file watcher
npm run watch # File watcher onlyEdit scripts/config/wrapper-config.js to customize:
module.exports = {
watchDirectories: ['app/', 'scripts/'], // Directories to monitor
excludePatterns: ['node_modules', '.git'],
debounceDelay: 500, // ms to wait before analysis
maxConcurrentAnalysis: 3,
backupRetention: 10 // Keep last 10 backups per file
};1. Ask Bob to build a feature
2. Bob creates a PR
3. Paste PR URL into BobWatch
4. Get instant security analysis
5. Auto-fix vulnerabilities with one click
npm run watch:dev
# BobWatch monitors your codebase as you code
# Instant alerts for security issues
# Automatic remediation suggestions1. Export your Bob IDE session log
2. Upload to BobWatch
3. Get complete audit of what Bob built vs. what you asked
4. Identify drift and security issues
- SQL Injection
- XSS (Cross-Site Scripting)
- Authentication Bypasses
- Exposed Secrets & Hardcoded Credentials
- Path Traversal
- Command Injection
- Resource Exhaustion
- Instruction Boundary Breaches - Untrusted data mixed with AI commands
- Confused Deputy Attacks - AI agent privilege escalation
- Prompt Injection - Hidden commands in tool responses
- Tool Manifest Vulnerabilities - Overly broad permissions
- OpenAPI Schema Exploits - Unrestricted endpoint access
bobwatch/
βββ app/ # Next.js App Router
β βββ api/
β β βββ analyze/ # PR analysis endpoint
β β βββ analyze-file/ # Single file analysis
β βββ results/ # Results page
β βββ page.js # Homepage
βββ scripts/
β βββ bobwatch-wrapper.js # File watcher entry point
β βββ config/ # Wrapper configuration
β βββ lib/ # Core wrapper modules
βββ bob_sessions/ # Complete Bob IDE development logs
βββ .env.local # Environment variables (not in git)
βββ README.md # You are here
The /bob_sessions directory contains complete, unedited logs of every conversation with IBM Bob during development. This is a unique resource showing:
- How BobWatch was built from scratch in 24 hours
- Real-world Bob prompting strategies
- Debugging sessions and problem-solving
- Evolution of features and architecture
Total Sessions: 30+
Total Tokens: ~2M+
Development Time: 24 hours
Human-Written Code: ~50 lines
Bob-Generated Code: ~2000+ lines
Built by two engineering students from Bangalore who shipped BobWatch in 24 hours using IBM Bob:
- Chinmay - Full-stack development, AI integration, security research
- Lahar - Architecture, deployment, testing, documentation
- Event: IBM Bob Hackathon 2026
- Build Time: 24 hours
- Coffee Consumed: β
- Bob Prompts: 500+
- Lines of Code (Human): ~50
- Lines of Code (Bob): ~2000+
# Install Vercel CLI
npm i -g vercel
# Deploy
vercel
# Add environment variables in Vercel dashboard:
# GEMINI_API_KEY=your_key_here
# PRESENTATION_MODE=false# Build image
docker build -t bobwatch .
# Run container
docker run -p 3000:3000 -e GEMINI_API_KEY=your_key bobwatchWe welcome contributions! Here's how:
- Fork the repository
- Create a feature branch (
git checkout -b feature/amazing-feature) - Commit your changes (
git commit -m 'Add amazing feature') - Push to the branch (
git push origin feature/amazing-feature) - Open a Pull Request (and analyze it with BobWatch! π)
This project is licensed under the MIT License - see the LICENSE file for details.
- IBM Bob Team - For creating the AI that built this entire application
- Google Gemini Team - For the powerful 2.5 Flash model
- Vercel - For seamless deployment
- The Open Source Community - For inspiration and tools
- Live Demo: bobwatch.vercel.app
- GitHub: github.com/ch1n-may/bobwatch
- Team: One More Prompt
- Hackathon: IBM Bob Hackathon 2026
Made with IBM Bob π€ | Secured by BobWatch π‘οΈ
"In Bob we trust, but BobWatch we verify."