Fixes #46 : Agent Execution Analytics Dashboard - #47
Open
AbhinaavRamesh wants to merge 17 commits into
Open
Conversation
…hboard
Add full-stack observability feature for tracking agent executions,
token usage, costs, and performance metrics.
Backend:
- Add database migration with 5 new tables: agentexecutions, tokenusages,
executiontraces, budgetalerts, and analyticssnapshots
- Implement analytics repository with filtering, aggregation, and time-series queries
- Add REST API endpoints for executions, usage stats, cost breakdown, and trends
- Define Pydantic schemas and DTOs for analytics data transfer
- Add ExecutionStatus and ExecutionTraceStepType enums
- Include seed script for generating synthetic test data
Frontend:
- Create AnalyticsPage with KPI cards, charts, and execution table
- Add ExecutionDetailsPage for viewing individual execution traces
- Implement analyticsService for API communication
- Add TypeScript types for analytics domain
- Update Sidebar with analytics navigation link
- Configure router with /analytics and /analytics/:id routes
Documentation:
- Add ANALYTICS.md with API reference and usage guide
- Include UI screenshots for feature demonstration
Testing:
- Add comprehensive API tests for all analytics endpoints
Housekeeping:
- Remove redundant backend/.dockerignore, .gitignore, .python-version
(covered by root-level configuration)
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: AbhinaavRamesh <47682907+AbhinaavRamesh@users.noreply.github.com>
Replace window.location.href with React Router navigate
Feature Request: Agent Execution Analytics Dashboard
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #46
This PR introduces a native Analytics Dashboard for GenAI AgentOS, providing visibility into agent performance, costs, and execution patterns—without requiring external tooling.
Why This Matters
Currently, there's no way to answer questions like:
This dashboard solves that by surfacing execution data in an actionable format.
Features
Implementation
Database Schema Migration
Added migration a1b2c3d4e5f6_add_analytics_tables.py with five new tables:
Custom PostgreSQL enums added for execution_status, trace_step_type, budget_alert_type, and budget_scope.
Cleanup
Removed stale config files (.dockerignore, .gitignore, .python-version) that were no longer needed.
Alternatives Considered
A lightweight native solution fits the self-hosted philosophy of AgentOS.