About this project
New Testimony and Reward - Jason Becker
"This is the best communication idea for people in my situation that I have ever seen. It will drastically improve the quality of life for thousands of people." Jason Becker, Musician, composer and pesky inspiration.
NEW REWARD - EXCLUSIVE POSTCARD WITH JASON BECKER'S FINGERPRINT!
You will receive an exclusive card from Jason Becker with his fingerprint thanking you for helping him to receive an EyeSpeak. If 90 people back this reward, Jason will receive one EyeSpeak. If 400 people back this reward, we will develop an App for Jason to compose and play music using his eyes. And of course, you will have your name and photo on our website and receive our updates via email. Thank you for supporting Jason Becker and our entire team. Together we will change lives.
Video with English and Portuguese Captions (Subtitles)
It is our mission to give voice to those who can’t communicate. In this moment of our “history” we want to bring our knowledge from Space down to Earth, because we believe that we can make a difference! We can do it and we can change many lives. So, we will provide a pair of glasses with the first autonomous augmented reality system based on eye-tracking, designed specifically for people who have amyotrophic lateral sclerosis (ALS) disease, are tetraplegic, or who have any other disability affecting their communication abilities such as locked in syndrome (LIS), muscular dystrophy (MD), spinal cord injuries (SCI), and some cases of traumatic brain injuries.
Our glasses will change the way these people can communicate and interact with the world. Eyespeak has incredible speed and precision, it is easy to use, has ultra-low latency and auto-calibration without the intervention of the user (except for the first time it is used). It provides a truly new experience that allows the user to interact with the world like never before: just with eye movements. The device will write and speak for you. We will also have a developer version with an open source interface to give other possible applications to the world (augmented reality, games, etc).
EyeSpeak has an inspirational history and a special place in our hearts. The idea was triggered after our CEO received the sudden news that his father was diagnosed with ALS. So, after the impact, we are transforming this tragic event into something with meaning, something beautiful, something good. This is why we are totally committed to changing the lives of thousands of people throughout the world. We have the knowledge. We have the experience. And we have the motivation to do it together with you. Thank you for your contribution and for being part of this team! We will make a difference!
Eyespeak is the first autonomous system with an augmented reality interface by eye-tracking that enables the possibility of communicating through the user’s eyes, in any position and orientation of the user's head. It will consist of a pair of augmented reality glasses that will project a virtual keyboard (or the display of your computer if you connect it to it, by remote desktop) onto your field of view. Additionally, we will have a micro camera looking at your eyes to understand which key you are selecting. After writing a word or set of words, you will be able to select with your eyes the “speak” button that will speak what you have written in a synthetic voice, through a speaker that is integrated into your glasses. Thus you will be able to speak with any person through this device when in any position. Since the glasses are always on your head, you will always have access to them. We call it autonomous because the only assistance you need is for somebody to put it on your head and press the ON button. Everything else will be done by you. You won’t need any computer or any other device. Moreover, you will be able to use your current computer by connecting the device to it and using your eyes to control the mouse.
We have already developed the processing unit and image processing algorithms for the eye detection.
Now, we are integrating the following components:
- Epson Moverio BT - 200 - Augmented reality glasses with the possibility of adding prescription lens through a insert setting and two UV shades for added contrast;
- Eye tracking micro camera;
- Processing unit;
Additionally, we will finish developing the required software to create the virtual keyboard and process the micro camera data (eye recognition, eye position, auto calibration).
Calibration will be done only once, when you wear the glasses for the first time. This calibration will calculate the position of your eyes with respect to the glasses frame.
Once this is done, only very minor calibration will be necessary from time to time.
Some of the key features:
- Android 4.0 operating systems;
- Video and photo camera that will allow you to take photos and record videos;
- Immersive and surrounding 3D;
- Earphones or Moverio's detachable earphones with Dolby Mobile surround sound;
- Wi-Fi and Bluetooth connectivity and Removable memory (built-in card slot supports up to 32GB microSDHC card), for example making it possible to surf on the internet.
For more specifications of the Epson Moverio BT-200 please visit the link here
We are finishing the development of the firmware of the processing unit. On the other hand, we will improve our custom eye tracking algorithms to guarantee robustness of the system.
The funds will be used to integrate the components together into a mechanical support device and to develop the required software to correlate the eye position with the selection of the keys of the virtual keyboard. We will use existing libraries in order to minimize development effort.
The rest of the funds will be used to buy the components and assemble them for shipment to our backers.
LusoVU is a spin-off of LusoSpace, a company that for the past 12 years has been creating solutions for optoelectronics in one of the most demanding industries in the world: the aerospace market. On the 3rd April 2014 another satellite equipped with LusoSpace's equipment was launched. Now we are developing a laser that will detect gravitational waves for the LISA mission to be launched in 2034. If you're curious about us you can visit our websites in www.lusospace.com and www.lusovu.com .
So, we know how to combine innovation and quality in order to provide high quality, reliable and robust high tech products.
On the other hand, we have been working on augmented reality devices for astronauts since 2005. This is one of the three strategic areas of LusoSpace that culminated in the creation of its spin-off LusoVU.
We have the systems engineering, optoelectronics, mechanics and software skills that are key factors for the success of this project.
Beyond that, we view this as more than a product. It is chiefly a mission that was triggered because of the diagnosis of ALS of our CEO’s father. So we want to make the difference in his life and in the life of thousands of people worldwide.
Ivo Vieira – CEO, PhD in physics engineering and 16 years working in the space sector, 12 of which as CEO, skilled in managing complex projects
“To see beyond the obvious and then discover the essential … ”
António Moreira dos Santos - North America Operations Manager, PhD in Materials science, with 20 years in materials science research, including optical systems, synergies with more than 40 publications, including a book and manuscripts in peer reviewed journals.
"Deep topical knowledge is essential, but fostering synergies is truly transformative"
Rui Semide – CMO, Electronics engineer with 16 years of experience in health related equipments and services in commercial roles (Product Manager, Marketing and Sales Director and CMO)
“Disruptive thinking thrives in creative minds when higher purposes are involved. With such powerful weapons achievement is the only possible outcome.”
Rita Ferreira - Product Manager, physics engineering, with 14 years experience in systems integration and technology consulting, 4 of which as Manager, and 2 as CEO of a consulting and coaching company
"Intensifying relations and bringing people closer to each other"
Manuel Martins – Project manager, Electronics Engineer with 10 years experience in hardware development, systems and project management
"Breaking barriers towards Augmented Life”
Antão Almada – Software development lead, Informatics Engineer with 18 years experience, 5 of which in augmented and virtual reality software and natural user interfaces.
"Augmenting the senses for a better life."
Luís Cardoso – Optics Manager, PhD in physics engineering with 14 years experience in optical systems.
"Bridging senses to connect people."
Pedro Bento – Electronics Manager, MSc in Electronics Engineering with 11 years experience in electronics development
“The Technology at the service of Mankind. Improving life quality and giving back hope and dreams for those who have lost it.”
Renato Costa – Eye tracking Manager, MSc in Electronics Engineering, 6 years experience in image and data processing
"Engineering is pretty good, but directing it at health care is awesome."
Géraud Moulas - Optics Co-Manager, PhD in physics engineering and 10 years experience in optical systems
“Being the one making the difference. Using professional skills to help to improve lives. Leaving the footprints for a bright future with augmented reality. Only with great goals come great achievements!”
Easy to use: You won’t require complicated calibration systems. The first page that appears when you start it up is the virtual keyboard, so that you can begin to speak immediately without the need for any configuration.
Mobility: You can use it in any position. If you are lying down, turned to the right or left, in your bed or in the chair, moving your head or not, the system is always over your face. Thus you don’t need to calibrate it again neither do you need to install it in a certain position.
Robustness: Since the camera is close to your eye, the precision of eye tracking will be much higher than traditional systems. This will increase the success of your eyes selecting the right key and not the neighboring one.
Speed: We are developing custom electronics, firmware and software to reduce the latency and processing time of the image processing algorithms. On the other hand, you will be able to write a word faster because the high robustness of the system will make it easier and faster to select a key.
Interactivity: As this will be an optical see through augmented reality system, you can look at someone and see the virtual keyboard in that same field of view. So you can write looking in the direction of the person you are communicating with. On the other hand, the micro speaker is incorporated in the glasses. Thus the voice will come from your face. The person will look at you when hearing what you are saying and you will look at the person when you are communicating with that person. This is the closest you have to speaking with someone. The system will be able to use different voice patterns including your own, with the necessary development.
Voice recognition will also be part of the system for device control and applications interaction, for people that are still able to speak.
It will also allow internet navigation and the sharing of photos and films that you take with the glasses, for example on Facebook or sent by e-mail.
Privacy: With or without connection to the computer system it allows you to surf on the internet and write messages without anyone seeing. When connected to the computer, the image of the screen is projected in the glasses, and it can even work with the monitor switched off. This system returns privacy to those who have lost it.
The eyespeak will support the following languages:
·French (FR, CA)
·Portuguese (BR, PT)
Note that in future versions we will expand our product to other languages.
Head Mounted Displays enable users to experience Augmented Reality with their hands free.
EyeSpeak enables users to interact through Augmented Reality with their hands free!
A developer version will be provided with an open source interface so you can develop your own software to use this device for other applications (augmented reality, games, etc). We are giving priority to this health application but we are open to work on other applications. We will continue to improve this product and increase its maturity. Our key objective is to miniaturize it and decrease its cost.
Everyone who buys the developer version will be able to interact with our engineering team to provide feedback on the product and guest support for any technical issue.
Eyetrack Mouse will only track your eye, it won’t speak for you and it needs your computer to work. Eyetrack Mouse has lower accuracy and only works with Windows Vista, 7 and 8 (except 8RT), However it will be supported on tablet and laptop. There is no display on those glasses. You will use the display of your computer. Note you will need a webcam on your computer and this system is not as portable as EyeSpeak. The main advantage over traditional systems is the precision. Eyespeak is better because it is a stand-alone device that you can use in any position and orientation.
Francis Tsai - Artist, worked in the video games industry, comic book publishers, role playing games, trading card games, film and tv design. Authored two art instruction books
"My name is Francis Tsai and I am an artist currently living with my wife Linda in Austin Texas. Most of my work has been in the video game industry, but I have also done work for comic book publishers and film and TV design and have authored 2 art illustration books. In 2010, I was diagnosed with ALS which is a degenerative neuromuscular disease with no known cause or cure. It typically leads to total paralysis and eventually death from respiratory failure. I chose to have a tracheostomy early in 2012 for assisted breathing; however, in doing so, I lost my ability to speak. In the fall of 2012, with the help of a technically savvy friend I was able to obtain a custom-built computer setup controlled via eye gaze. I now rely 100% on the eye gaze setup to communicate. If I am not in front of my computer, then my only option for communicating is by blinking my eyes. I spend roughly half of the day away from my computer as part of my daily routine to get up and ready for the day and then washed and ready for bed at the end of the day. LusoVU’s project to enable eye controlled communication via a wearable device will make a dramatic difference in my daily life. I will no longer have apprehension about my inability to communicate with others while I am in bed, in the bathroom, or away from home. Not being able to communicate is a powerless feeling but being able to wear my communication device wherever I am brings the power back to me. I hope that you will consider supporting this very important project that can help people like me and others with similar paralysis live better lives and communicate freely without bounds again."
John A. Gregoire - Co-Founder The Hope-JG Foundation
Christmas day reward for the priority edition eyespeak: if we reach $400,000 we will deliver the first ones in December 2014 helping you to have a happier Christmas. Spread the word so we can reach the target.
Francis Tsai´s Rewards
Poster Prints of Francis Trai´s Eye Gaze Work (Pledge $100 or more) limited to 20 - You can choose of one of four prints of Francis' work, created after his diagnosis of ALS. Francis created this amazing art using only eye-gaze technology. Francis' unique approach to creating art demonstrates how technology can help those with ALS and other similar situations live better lives. The prints measure 18" X 24".
"MNKE" - Exclusive Kickstarter Francis Tsai Work: (Pledge $1000 or more) limited to 10 - This artwork by artist and illustrator Francis Tsai is EXCLUSIVE to the EyeSpeak project! You will receive a numbered print, signed by Francis Tsai’s wife Linda. Francis, who no longer has the use of his hands, created the artwork using only eye-gaze technology. Francis’ unique approach to creating art has been featured on CNN, Kotaku, and local media around the world. MNKE is 18 inches by 24 inches and printed on high-quality, heavy photographic paper. Help make the EyeSpeak project a reality and be one of only ten people in the world to own Francis’ MNKE art! And of course you will have your name and your photo on our website and receive our updates via email. Thank you so much for supporting us to change lives.
"I believe that technology serves people as much as possible and as much as we want it to support our lives. I believe that good value for money is one of the best sentences to describe why we should develop a technology. I believe that this new system will provide incredible additional value to whoever has communication limitations owing to disease or injury. My father suffers from ALS and he has shown me that augmented reality would be very beneficial for this kind of limitation. And I have discovered that although rare, there are tens of thousands of people in the world with communication limitations. I want to give meaning to my father’s life and I would like to help all of you with similar communication limitations or who have a family member with such limitations. It is not a question of how but of a question of when. I applied to this crowd-funding platform because time is precious for whoever wants to speak and cannot speak. I can speak today but I want you too to be able to speak. We could wait for this technology to be developed for the video games industry and then apply it to your situation. But why wait if we can do it now? Today, I speak. Can you say ”eyespeak” 6 months from now? I believe you can and I know that you will speak through your eyes in a way you have never experienced before. And for those who speak but cannot write, I know this system will be also very important because it will greatly increase writing speed. I am fully committed to providing this product with the same quality philosophy that I am used to providing to my spacecraft customers, i.e. that it is robust, reliable, useful, fast, easy to use, and targeted at the customer. I won’t do any miracles but I assure you that you and my father will experience an interface system that will be much better than what you are used to. It has to be as good for you as it will be for my father. I will work as a team with my father to develop this and I want you to be part of this team. We deserve this!"
Risks and challenges
One technical risk is the calibration process. We expect that only one calibration will be required the first time the device is installed on a user head. However, it may be the case that we conclude that a simple additional calibration is required every time the device is used or when the glasses slip slightly along the nose. We are fully committed to avoid this by using special image processing algorithms that we are developing. Nevertheless, even if we don’t succeed on this point, we expect that any required calibration will be a simple process that will last less than 5 seconds.
Another challenge will be to provide the devices on time. We have already developed the eye tracking electronics and we are improving the image processing algorithms. Nevertheless, we want to provide a mature product that will not need any special installation process. This may require additional software development that may take more time than required. If we reach our stretch goal this risk will be significantly reduced.Learn about accountability on Kickstarter
Support this project
- (30 days)