Eyetracker Support possible?

[ROTim2]

Was just talking to someone who is completely illiterate due to developmental issues, and I was wondering if there is any Software that uses an Eyetracker to TTS any onscreen text, mainly for playing Video Games, as other solutions already exist for anything outside of that.

Would it be possible for you to implement Eye Tracker Support?
For example: You have a customizable Timer, after looking at something for the specified amount of time, that Element gets read aloud.

[MertenNor]

Yes, but the main issue I think is that you can’t directly copy text from games the way you can from a browser.
What about making a hotkey that extracts all visible text and overlays the recognized text on top so it can be copied?

This way, I wouldn’t need to implement eye-tracker support directly, but it would make it easier for other programs like an eye tracker to grab the text.
What do you think about doing this way?

Thanks for the feedback! Glad to hear people are interested in the program!

[ROTim2]

I don't know much about coding, but would it be possible, to 'attach' the area you are grabbing a screenshot of (the one where you select the area it grabs the screenshot from) to the coordinates of the Eyetracker, and just make the 'FoV'/Size of the Area adjustable.

Pretty sure for exaple Tobii Eye Tracker Software should have APIs to make that relatively easy.

I searched around, most Assistive Software as far as Eyetrackers go is focused on people with mobility issues.
Like controlling onscreen keyboards and the mouse with your eyes.

Sadly I did not find anything, in about 2 hours of pretty decent searching, that just takes your eye looking position and outputs the text as TTS.

This software is by far the closest/seemingly only one applicable to games, and I figured it might not be too hard to integrate an eye tracker.

[MertenNor]

I see what you are saying, and yeah, it’s a good idea. But I still think the simplest way is to just make it more eye-tracker friendly. That way, people can use the eye tracker they are already familiar with. I already have an idea for how to do this, but I won’t have time to implement it before Q1 next year.
I have an update coming soon, hopefully this weekend that will make the program more user-friendly. But the idea I have for eye track users is even more so.