Opencv real-time eye tracking, let your eyes write code! This is still a bit for my current tracking effect, and there is still a little distance, but I want to complete this without a problem, using my eyes to control the computer to type. I think as long as you can do it with your hands, you can do it with your eyes, including games, drawing, writing, and more!
Not much nonsense, the current tracking rate is 82.5%-98% (with glasses and without glasses), this is the first version at present, but it basically realizes eye tracking, and GPU processing will be added later to improve efficiency. face classifier, add face feature algorithm to improve face precision! Make real-time eye tracking more stable, more efficient, more stable, and adapt to more scenarios! Give two video links and pictures (the person inside is not me, my little brother)
Opencv real-time eye tracking without glasses demo video
Opencv real-time eye tracking wearing glasses demo video
To do this eye tracking is mainly to use opencv + the algorithm summed up by reading a lot of foreign papers, this algorithm is more mixed, and the blog will introduce it slowly.
Currently doing this eye tracking, because the company wants to do a typing software:
1. You want to press that key, just stare at that key, when you stare, the color of the key changes from green to blue;
2. After the letter button is blue, it is equivalent to being pressed, and the corresponding place on the screen will see what you typed;
3. And you can use the voice to read out your typed words;
As far as my eye tracker is concerned, it has basically been implemented. I'm still looking to track the reference point-like canthus to accurately judge. Deformation of the eye into an oval shape to orient the iris is also being studied. The eye tracker gives the pixel location in the image of the center of the pupil, while the gaze tracker determines that the person is looking at the screen.