Highlight mouse and keyboard keys

[hisune]

This project is fantastic
! But it would be even better if it supported mouse highlighting and displaying keyboard presses.

[Phil-Fan]

+1

[ranggasan]

I’d love to see this feature implemented. Additionally, it would be beneficial to include audio feedback (click sound) for mouse interaction events

[siddharthvaddem]

@ranggasan
system audio would be a problem with Electron and macOS.

navigator.mediaDevices.getUserMedia does not work on macOS for audio capture due to a fundamental limitation whereby apps that want to access the system's audio require a signed kernel extension. Chromium, and by extension Electron, does not provide this.

[mrgwd]

Hi 👋
I’m new to contributing to open source and I’m interested in working on this feature.

Is mouse highlighting / keyboard visualization something you’d like to accept PRs for at this stage, or is it still in design/backlog mode?

If it is open, would it make sense to start with a smaller scope (e.g. mouse highlight only, no audio)?

Happy to follow any guidance on preferred approach or scope. Thanks!

[siddharthvaddem]

I would be open to it following automated zoom which is something some folks are attempting to work on. This feature would be dependent on accurate mouse tracking and would also be easier once this feature is tackled first.

Ideally, this feature ties into custom cursors and so on, which is pretty constrained at the moment.

[FBox467]

Keyviz is a free and open-source tool that visualizes your keypresses and mouse actions in real-time.
Keyviz

[darthcoder]

As a non expert in any of the technologies involved. I can confidently say that you should not get overly wedded to apis. Accessibility in every os has a press ctrl to highlight mouse and there are millions of libraries on nom etc that would give the required functionality. Stop inventing shit from first principles. Drop the ankle weights rock lee. Its ok.

[siddharthvaddem]

Highlighting mouse is done and available in latest main.