Skip to content

[FEATURE] Lack user feedback on queries + responses #54

@tumberger

Description

@tumberger

Problem Description

The current Vibe Browser chat system lacks a mechanism for users to provide feedback on agent response quality. There's no way for users to indicate whether responses were helpful, accurate, or met their needs.

Proposed Solution

  • Implement a simple feedback system with: Thumbs up/down buttons on completed agent responses
  • Check how to capture trajectories in a privacy preserving manner for eval

Implementation Considerations

  • Technical complexity: Medium - requires extending existing message schema, new UI components, and IPC channels
  • Breaking changes: No - feedback fields would be optional additions to existing ChatMessage interface

Dependencies:

  • Simple UI components for thumbs up/down buttons
  • Backend storage for feedback data and trajectories
  • Privacy compliance tools for data anonymization

Additional Context

The system should leverage Vibe's existing infrastructure including tool usage tracking and reasoning capture. The feedback system should integrate with the existing Umami analytics to track feedback submission events and patterns.

Trajectory data COULD include complete conversation context with user messages, agent responses, tool calls, observations, and reasoning steps for comprehensive feedback analysis. Need to check long-term sustainable strategy (check e.g. OpenHands).

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions