UNDERSTANDING HUMANS
IN INTELLIGENT DEVICES AT SCALE
The age of autonomous machines and intelligent IoT devices is upon us. They will affect many aspects of our lives. They will bring about a new generation of diagnostic instruments to clinics, improve cars and transportation, and create new consumer experiences, while being embedded into the networks that power and inform society underpinning the efficient provision of public and private services.
Critical to their operation, will be improving the safety, security, and quality of life of humans that interact with such intelligent systems. To interact efficiently and effectively, sensing and interpreting human behaviour will become mission critical to connecting the human user with automated systems.
AI-ENABLED
HUMAN MACHINE INTERFACES
Globally deployed, validated, and award-winning human behaviour AI technology for key applications in electric and autonomous vehicles with advanced in-cabin monitoring, patient monitoring for remote tele-medicine in healthcare/ robotics, and intelligent devices for smart homes. Built on real-time perception and observation of people and objects in contextual situations combined with the reasoning and semantics of human behavior based on trusted scientific research.
NVISO's SDK's provides a robust real-time human behaviour AI API, NVISO Neuro Models™ interoperable and optimised for neuromorphic computing, the ability for flexible sensor integration and placement while delivering faster development cycles and time-to-value for software developers and integrators.
INDUSTRY SOLUTIONS
COMPUTING PLATFORMS
Accurate and Robust
CNNs scale to learn from billions of examples resulting in an extraordinary capacity to learn highly complex behaviors and thousands of categories. NVISO can train powerful and highly accurate and robust models for use in the toughest environments thanks to its proprietary datasets captured in real-world environments.
Easy to Integrate
Where AI is fragmented and difficult-to-navigate at the edge, NVISO AI Apps are simple to use, develop, and deploy, with easy software portability across a variety of hardware and architectures. It reduces the high barriers-to-entry into the edge AI space through cost-effective standardized AI Apps that are future proof and work optimally at the extreme edge.
Ethical and Trustworthy
AI systems need to be resilient and secure. They need to be safe, ensuring a fall back plan in case something goes wrong, as well as being accurate, reliable and reproducible. Additionally unfair bias must be avoided, as it could could have multiple negative implications. NVISO adopts Trustworthy AI frameworks and state-of-the-art policies and practices to ensure its AI Apps are "fit-for-purpose".
HUMAN BEHAVIOUR AI
FROM SENSOR TO SOLUTION
The task of understanding humans by using smart sensing has become increasingly important in modern society, given the proliferation and ubiquity of embedded sensors in a huge range of devices ranging from smartphones and smart city infrastructure to consumer IoT devices and health monitoring systems. A key to enabling the human user to connect with automated systems is artificial intelligence, which enables the plethora of sensing data to be processed in a way that gives context and meaningful insights to aid smart devices to make decisions and perform tasks.
Although there are a number of challenges in developing and integrating artificial intelligence into smart sensing and IoT applications (ranging from memory footprint and computational complexity, to privacy and robustness), the detection and understanding of human activities using artificial intelligence can be divided into three fundamental layers as described below.
SENSORS
Sensors are devices that detect and respond to changes in an environment in which humans are present. Inputs can come from a variety of sources such as light, temperature, motion and pressure (e.g. cameras, microphones, IMUs, etc) which generate data-streams that are used by data-driven and learning-based frameworks.
OBSERVSATIONS
Non-verbal “expressions” can communicate emotions faster, more subtly and more effectively than words ever can, which is why understanding non-verbal cues remains crucial for systems doing human behavioural analysis. Detectors and observations consist of reusable core signals (e.g. finding and locating a face or head in an image) around well understood human modalities.
SEMANTICS
Human behaviour signals provide important information by themselves useful for machines or computers to detect and understand humans. Additional insights however can be extracted by looking at how the core observations change over time or correlate together and can be used with context and/or application specific reasoning and semantics for industry specific solutions.
Extreme Edge Computing
No Cloud Required
Privacy Preserving
By processing video and audio sensor data locally it does not have to be sent over a network to remote servers for processing. This improves data security and privacy as it can perform all processing disconnected from the central server, which is a more secure and private architecture decreasing security risks.
Lower Energy Usage
The more we move data, the more energy we use. Processing data first on-device opposed to sending it to the cloud uses a lot of less energy. As the amount and rate of data exchange with the cloud is minimised, the power consumption of the device is reduced thus improving battery lifetime, which is critical for many edge devices.
Higher Availability
Decentralisation and offline capabilities make edge AI more robust since internet access is not required for processing data. This results in higher availability and reliability as weak WiFi signals do not impact the device performance.
NVISO NEURO MODELS™
EMBEDDED DEEP LEARNING
NVISO Neuro Models™ are purpose built for a new class of ultra-efficient machine learning processors designed for ultra-low power edge devices. Supporting a wide range of heterogenous computing platforms ranging from CPU, GPU, DSP, NPU, and neuromorphic computing they reduce the high barriers-to-entry into the AI space through cost-effective standardized AI Apps which work optimally at the extreme edge (low power, on-device, without requiring an internet connection). NVISO uses low and mixed precision activations and weights data types (1 to 8-bit) combined with state-of-the-art unstructured sparsity to reduce memory bandwidth and power consumption. Proprietary compact network architectures can be fully sequential suitable for ultra-low power mixed signal inference engines and fully interoperable with both GPUs and neuromorphic processors
PROPRIETARY DATA
NVISO Neuro Models™ use proprietary datasets and modern machine learning to learn from billions of examples resulting in an extraordinary capacity to learn highly complex behaviors and thousands of categories. Thanks to high quality datasets and low-cost access to powerful computing resources, NVISO can train powerful and highly accurate deep learning models.
RUN FASTER
NVISO Neuro Models™ store their knowledge in a single network, making them easy to deploy in any environment and can adapt to the available hardware resources. There is no need to store any additional data when new data is analysed. This means that NVISO Human Behaviour AI can run on inexpensive devices with no internet connectivity providing response times in milliseconds not seconds.
RUN ANYWHERE
NVISO Neuro Models™ are scalable across heterogeneous AI hardware processors being interoperable and optimised for CPUs, GPUs, DSPs, NPUs, and the latest neuromorphic processors using in-memory computing, analog processing, and spiking neural networks. NVISO Neuro Models™ maximise hardware performance while providing seamless cross-platform support on any device.
HUMAN CENTRIC
AI SOLUTIONS
Need to talk to an AI expert?
CONTACT SALES
NVISO WHITEPAPER
Teaching Machines to Detect and Understand Humans
The age of autonomous machines and intelligent IoT devices is upon us. They will bring about a new generation of diagnostic instruments to clinics, improve cars and transportation, create new consumer experiences, while being embedded into the networks that power and inform society. Critical to their operation, will be improving the safety, security, and quality of life of humans that interact with such intelligent systems. To interact efficiently and effectively, sensing and interpreting human behaviour will become mission critical to connecting the human user with automation systems. This white paper outlines the core horizontal topics necessary to teach machines to sense and understand humans and use cases where “AI at the Extreme Edge” is not only critical but transformative.
WHERE TO MEET US
CLIENTS & PARTNERS
