EYE TRACKING
FOR HUMAN MACHINE INTERFACES
NVISO Neuro SDK is a state-of-the-art software that integrates real-time eye tracking in your applications. It brings vision and attention measurement to your product with minimal effort. The SDK comes with an extensive feature set, including full head pose tracking, gaze estimation, eye tracking data analysis and more. Are you looking for a way to add gaze estimation to your application? Or do you need to know what kind of emotions they are experiencing? If so, then NVISO Neuro SDK is the right tool for you!
Eye tracking, gaze detection, and eye openness are tools that can be used to study human behaviour. Eye tracking can be used to study human behaviour by watching changes in eye shape, pupil dilation and blink rate. Gaze detection (also known as eye tracking) can be used to measure the fixation points on a web page, advertising ad or any product. Eye openness is a term frequently used in the field of business psychology which refers to how open one’s eyes.
The human-machine interface is about to get a lot more interesting. We can expect to see more innovative ways of interacting with machines, whether they're cars, computers or appliances. This will be one of the key areas of research at the intersection of artificial intelligence and human-computer interaction. These interfaces will allow us to interact with our devices through voice, gestures and other non-traditional means such as eye tracking. They'll also allow us to take advantage of new technologies like augmented reality and virtual reality.
STATE-OF-THE-ART
Eye Tracking Technology
Science Based - 3D Geometrical Eye Model
The 3D eye model is a representation of the human eye that takes into account the anatomy and physiology of the human eye. It consists of two main elements: an eyeball and an iris. The eyeball is represented by a sphere with some additional information about its position and orientation in space, while the iris is represented by a disc with some additional information about its position and orientation in space.
Using a 3D eye model, synthetic images from any point of view (POV) can be used to create synthetic training data for deep learning models. The advantage of our approach is that it allows us to automatically detect eyes in any pose and any angle with high accuracy while maintaining compatibility with existing eye tracking systems that have been designed for non-invasive measurements.
Improved Accuracy - Multi-task Convolutional Neural Networks
Multi-task learning is a method of training machine learning models to perform multiple tasks simultaneously. By using this approach, you can create a single model that can be used to perform many different tasks, reducing the workload and increasing efficiency.
Multi-task learning with convolutional neural networks has several advantages over other approaches for deep learning based eye tracking as geometric properties and eye states can learnt simultaneously together leading to better generalization performance. Multi-task learning helps improve generalization by allowing the network to learn more efficiently from less data due to its ability to share parameters across different tasks. This means that the model will be able to predict better results on new data if it has been trained with similar data before.
Reduced Bias - Large Scale Synthetic Eye Databases
In recent years, there has been a surge of interest in the use of deep learning methods to classify eyes. While these techniques have shown great promise, they are often limited by their inability to adapt to new subjects and contexts. This problem is particularly pronounced when the classifier is applied to new age groups or ethnicities. The problem is further complicated by the fact that eye appearance can be significantly altered by specific medical conditions causing asymmetrical behavior. For example, wall-eyes, lazy-eye, or cross-eyed.
NVISO overcomes this these problems, by using very large scale databases of eye images that have been annotated with a large number of key points, gaze, and eye openness. These databases allow us to train models that are robust across different ages, genders, and ethnicities, while still maintaining high accuracy on a single individual and work independently on the left and right eye.
USE CASES
Eye Tracking Applications
Digital Avatars
Digital avatars are computer-generated images or animations that represent a real person, such as an actor or celebrity. Eye tracking can be used in digital avatars to make them more human by mimicking the way people interact with each other and the environment. When an avatar looks at something, we expect it to focus on that object and not wander off too quickly. When their eyes roam around the room, they should track back and forth, not stop abruptly.
Eye tracking is important for creating realistic digital avatars because eye tracking methods can be used to interpret the user’s intention and emotional state: gazing, blinking and eye openness. NVISO eye tracking on software can be used to precisely detect the eye movements of a user and then animate their face accordingly using artificial intelligence algorithms. This allows digital avatars to be more lifelike than ever before!
Human Machine Interfaces
The human-machine interface is about to get a lot more interesting with real-time eye tracking. We can expect to see more innovative ways of interacting with machines, whether they're cars, computers or appliances.
The field of human-computer interface has been concerned with the studies of human-machine interactions and its mutual benefits, i.e., improvements in the design of machines that can better meet the needs and expectations of human beings, and those of the machines that can be designed to better match human capabilities. Developments in this field have incorporated technological advancements into systems that are increasingly user friendly.
Drowsiness and Fatigue
The need for automated eye tracking software is growing because human drivers are getting more and more drowsy and fatigued. According to the U.S. Department of Transportation, there were 5,987 fatal accidents in 2018 that involved drowsiness or fatigue as a factor in the accident.
Studies have shown that the eyes of drivers become unfocused, pupil size increases and the frequency of eye blinks or saccades increases with increased fatigue. These three parameters can provide inputs to detect drowsiness or fatigue when the eye is visible.
NVISO NEURO MODELS™
ULTRA-EFFICIENT DEEP LEARNING AT THE EDGE
NVISO Neuro Models™ are purpose built for a new class of ultra-efficient machine learning processors designed for ultra-low power edge devices. Supporting a wide range of heterogenous computing platforms ranging from CPU, GPU, DSP, NPU, and neuromorphic computing they reduce the high barriers-to-entry into the AI space through cost-effective standardized AI Apps which work optimally at the extreme edge (low power, on-device, without requiring an internet connection). NVISO uses low and mixed precision activations and weights data types (1 to 8-bit) combined with state-of-the-art unstructured sparsity to reduce memory bandwidth and power consumption. Proprietary compact network architectures can be fully sequential suitable for ultra-low power mixed signal inference engines and fully interoperable with both GPUs and neuromorphic processors
PROPRIETARY DATA
NVISO Neuro Models™ use proprietary datasets and modern machine learning to learn from billions of examples resulting in an extraordinary capacity to learn highly complex behaviors and thousands of categories. Thanks to high quality datasets and low-cost access to powerful computing resources, NVISO can train powerful and highly accurate deep learning models.
RUN FASTER
NVISO Neuro Models™ store their knowledge in a single network, making them easy to deploy in any environment and can adapt to the available hardware resources. There is no need to store any additional data when new data is analysed. This means that NVISO Human Behaviour AI can run on inexpensive devices with no internet connectivity providing response times in milliseconds not seconds.
RUN ANYWHERE
NVISO Neuro Models™ are scalable across heterogeneous AI hardware processors being interoperable and optimised for CPUs, GPUs, DSPs, NPUs, and the latest neuromorphic processors using in-memory computing, analog processing, and spiking neural networks. NVISO Neuro Models™ maximise hardware performance while providing seamless cross-platform support on any device.
HUMAN CENTRIC
AI SOLUTIONS
WHAT IS HUMAN BEHAVIOUR AI?
Get Our WhitepaperCLIENTS & PARTNERS
