-
Notifications
You must be signed in to change notification settings - Fork 8
[FEATURE] Lack user feedback on queries + responses #54
Copy link
Copy link
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Problem Description
The current Vibe Browser chat system lacks a mechanism for users to provide feedback on agent response quality. There's no way for users to indicate whether responses were helpful, accurate, or met their needs.
Proposed Solution
- Implement a simple feedback system with: Thumbs up/down buttons on completed agent responses
- Check how to capture trajectories in a privacy preserving manner for eval
Implementation Considerations
- Technical complexity: Medium - requires extending existing message schema, new UI components, and IPC channels
- Breaking changes: No - feedback fields would be optional additions to existing ChatMessage interface
Dependencies:
- Simple UI components for thumbs up/down buttons
- Backend storage for feedback data and trajectories
- Privacy compliance tools for data anonymization
Additional Context
The system should leverage Vibe's existing infrastructure including tool usage tracking and reasoning capture. The feedback system should integrate with the existing Umami analytics to track feedback submission events and patterns.
Trajectory data COULD include complete conversation context with user messages, agent responses, tool calls, observations, and reasoning steps for comprehensive feedback analysis. Need to check long-term sustainable strategy (check e.g. OpenHands).
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request