Eye Tracker - Write Messages

Eye Tracker - Write Messages


This is a PROTOTYPE application that I built for my Master Thesis. Therefore, if you download it, do not expect miracles from it, also have patience with it.

Curious about what's under the hood?
Get the printed version of my thesis: https://www.morebooks.de/store/gb/book/hands-free-human-computer-interaction-paradigm-using-face-tracking/isbn/978-3-659-47366-1

There is no built-in tutorial so far, you won't get how to work with it unless you read the hints bellow

Youtube instructions: http://www.youtube.com/watch?v=NHIyAg9rdpM

1. Make sure that when you use the application the light in the room does not reflect in your eyes. (try to avoid facing windows, or lightbulbs). However, your face has to be visible to the camera.
2. Do not move / tilt your head when you use the application
3. Perform a calibration test:
3.1 Start the application
3.2 Set your head approximately 25 cm from the screen. Your face should fit in the red rectangle on the camera preview, your RIGHT EYE and NOSTRIL are tracked by the camera.
3.3 Hold the Android device so that your nostrils appear in the camera preview
3.4 Press the "Start" button
3.5 Hold head still and look at the camera preview (at yourself).
4. Once calibration is done, three buttons will appear on the screen, each with characters and words
5. Gaze Left, Right or Up to Highlight a desired Button, then Select button by blinking right eye or both eyes for two seconds (cout to 3)
6. Continue to select desired Button until you have to choose between just two options.
7. You can restore the Buttons to initial values by accessing he Back button from the top menu.
7. You can delete characters from the text box by accessing the Undo button from the top menu
8. Mark the end of a word by using Space or punctuation symbols.
9. Use the Talk option to make the device talk the message back to you.

In case you are not able to use the application for any reason please write me an e-mail at: [email protected] with the subject "Eye Tracker - Write messages". I will try to give you Hints and Tips on how to manage to use the application.

The prototype application purpose is to assist users write messages using only their eye's direction and blinks. The prototype was developed having in mind people with ALS, Locked-in syndrome or any person that can only move their eyes and eye lids.

The device that I have tested it with is a Samsung Galaxy Nexus with Android 4.1.2.
You will need a front camera, preferably a light sensor and patience.

- Supports different device orientations (Landscape and Portrait)
- Guidelines for face recognition and setting the light conditions to proper values
- Now app works with tablets like Nexus 7
- Added a BEEP when user selects a letter by blinking - for users that cannot close just their right eye
- Removed the Ads

Recent changes:
- Send Text by SMS - This features is not fully tested please write me e-mails if it crashes.
Please also be aware that the SMS messages are sent automatically when the SMS button is pressed. This might cause extra costs due to miss-tapping of the SMS button.
To protect yourself from extra costs, just leave the recipient phone number empty.

- Fixed crashing issue - Thank you for reporting the problem

Version worked for me in a dark room with light reflected on my face for my thesis.
Add to list
Free
55
2.8
User ratings
73
Installs
10,000+
Concerns
3
File size
595 kb
Screenshots
Video of Eye Tracker - Write Messages Screenshot of Eye Tracker - Write Messages Screenshot of Eye Tracker - Write Messages Screenshot of Eye Tracker - Write Messages Screenshot of Eye Tracker - Write Messages Screenshot of Eye Tracker - Write Messages Screenshot of Eye Tracker - Write Messages

About Eye Tracker - Write Messages
This is a PROTOTYPE application that I built for my Master Thesis. Therefore, if you download it, do not expect miracles from it, also have patience with it.

Curious about what's under the hood?
Get the printed version of my thesis: https://www.morebooks.de/store/gb/book/hands-free-human-computer-interaction-paradigm-using-face-tracking/isbn/978-3-659-47366-1

There is no built-in tutorial so far, you won't get how to work with it unless you read the hints bellow

Youtube instructions: http://www.youtube.com/watch?v=NHIyAg9rdpM

1. Make sure that when you use the application the light in the room does not reflect in your eyes. (try to avoid facing windows, or lightbulbs). However, your face has to be visible to the camera.
2. Do not move / tilt your head when you use the application
3. Perform a calibration test:
3.1 Start the application
3.2 Set your head approximately 25 cm from the screen. Your face should fit in the red rectangle on the camera preview, your RIGHT EYE and NOSTRIL are tracked by the camera.
3.3 Hold the Android device so that your nostrils appear in the camera preview
3.4 Press the "Start" button
3.5 Hold head still and look at the camera preview (at yourself).
4. Once calibration is done, three buttons will appear on the screen, each with characters and words
5. Gaze Left, Right or Up to Highlight a desired Button, then Select button by blinking right eye or both eyes for two seconds (cout to 3)
6. Continue to select desired Button until you have to choose between just two options.
7. You can restore the Buttons to initial values by accessing he Back button from the top menu.
7. You can delete characters from the text box by accessing the Undo button from the top menu
8. Mark the end of a word by using Space or punctuation symbols.
9. Use the Talk option to make the device talk the message back to you.

In case you are not able to use the application for any reason please write me an e-mail at: [email protected] with the subject "Eye Tracker - Write messages". I will try to give you Hints and Tips on how to manage to use the application.

The prototype application purpose is to assist users write messages using only their eye's direction and blinks. The prototype was developed having in mind people with ALS, Locked-in syndrome or any person that can only move their eyes and eye lids.

The device that I have tested it with is a Samsung Galaxy Nexus with Android 4.1.2.
You will need a front camera, preferably a light sensor and patience.

- Supports different device orientations (Landscape and Portrait)
- Guidelines for face recognition and setting the light conditions to proper values
- Now app works with tablets like Nexus 7
- Added a BEEP when user selects a letter by blinking - for users that cannot close just their right eye
- Removed the Ads

Recent changes:
- Send Text by SMS - This features is not fully tested please write me e-mails if it crashes.
Please also be aware that the SMS messages are sent automatically when the SMS button is pressed. This might cause extra costs due to miss-tapping of the SMS button.
To protect yourself from extra costs, just leave the recipient phone number empty.

- Fixed crashing issue - Thank you for reporting the problem

Version worked for me in a dark room with light reflected on my face for my thesis.

Visit Website
User reviews of Eye Tracker - Write Messages
Write the first review for this app!
Android Market Comments
A Google User
6 days ago
Dint get it Keep trying. Could use this to test where on an advert people are looking.
A Google User
Jul 13, 2014
Useless Useless
A Google User
Jul 2, 2014
Does not respond on my device Would you pls fix it? I am still waiting to test your project myself........... 3 star for now
A Google User
Apr 18, 2014
Good work! I'm starting my own eye application on.android using opencv, perhaps instead of blinking you could use some sort of timer if the user is looking inside specific Co-ordinates? What algorithm and image processing techniques did you use in this? I'm doing my bachelors and it's my final year project. Keep up the good work and ignore the haters. Solid start with alot of potential
A Google User
Apr 2, 2014
Great idea with many benefits for persons with disability Great idea with great potential for improving the quality of life of persons with disability. I was unable to set it up correctly since I hold the phone to far away in order for my face to fit in the red box. As a result performance was sub par. However I encourage you to continue improving it further so it becomes more usable. Maybe you can give the user some feedback like a visual cursor onscreen indicating where the user is looking?