feat: latency profiling and optimization (closes #211)

[atejuolabello-beep]

Summary

closes #211 #207 #197 #206
Lightweight latency profiling infrastructure: component-level timing, request tracing with bottleneck detection, p50/p95/p99 stats, latency budget enforcement, baseline comparison, optimization recommendations.

Endpoints

• POST /profiling/trace (start/span/end)
• GET /profiling/stats
• POST /profiling/baseline + compare
• GET /profiling/recommendations

Config

ENABLE_LATENCY_PROFILING, LATENCY_BUDGET_DATABASE_MS, LATENCY_BUDGET_API_CALL_MS, LATENCY_BUDGET_RETRIEVAL_MS, LATENCY_BUDGET_INFERENCE_MS

Test plan

• 29 offline tests passing
• py_compile clean

[coderabbitai]

Warning

Review limit reached

Next included review available in 55 minutes.

View limit details

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: b27a5069-0d24-478c-873c-1d68c3cc1796

📥 Commits

Reviewing files that changed from the base of the PR and between 8874ea2 and 098d653.

📒 Files selected for processing (28)

• .github/workflows/ci.yml
• answer_depth.py
• arabic_ocr.py
• config.py
• data/swahili_islamic_terms.json
• grounding.py
• history.py
• latency_profiler.py
• main.py
• queue_system.py
• semantic_cache.py
• swahili/__init__.py
• swahili/code_switching.py
• swahili/cultural_context.py
• swahili/dialects.py
• swahili/generator.py
• swahili/loanwords.py
• swahili/models.py
• swahili/optimizer.py
• swahili/router.py
• swahili/terminology.py
• swahili_processor.py
• tests/test_arabic_ocr.py
• tests/test_islamic_qa_benchmark.py
• tests/test_latency_profiler.py
• tests/test_swahili.py
• thematic_quran.py
• vector_store.py

✨ Finishing Touches 💡 1

⚔️ Resolve merge conflicts 💡

• Resolve merge conflict in branch fix/issue-211

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[drips-wave]

@atejuolabello-beep Great news! 🎉 Based on an automated assessment of this PR, the linked Wave issue(s) no longer count against your application limits.

You can now already apply to more issues while waiting for a review of this PR. Keep up the great work! 🚀

Learn more about application limits

[zeemscript]

Strict review blocker: this branch conflicts with the base branch, and , , and are failing. Please resolve all blockers.

[zeemscript]

Strict review blocker: this branch conflicts with the base branch, and Lint and Test, Docker Build, and Performance Budget are failing. Please resolve all blockers.

[zeemscript]

Strict review blocker: required checks are failing. Please fix the failures before requesting merge.

[zeemscript]

@atejuolabello-beep this PR has merge conflicts with the main branch. Please resolve the conflicts (merge main in or rebase) and push the fix so it can be merged. Thanks!