Back to our Insights
Back to our Insights

Renault Nissan Mitsubishi Alliance collaborates with Clay AIR to integrate gesture technology into car prototypes


Thomas Amilien

Renault announces collaboration with Clay AIR to increase safety and add an extra layer of convenience for drivers.

Clay AIR hand tracking and gesture recognition technology complements voice user interfaces, turning complex commands into quick and simple shortcuts in the vehicle.

Gesture functions are a new and innovative element of Driver Monitoring Systems that allow for multi-step interactions to take place with user-friendly gestures. 

Clay AIR is providing the automotive manufacturer with a gesture recognition software that allows the driver to control Android Auto navigation through simple in-air gestures. Functions performed include Make/Receive Call, Next song, Adjust volume, Zoom, Home, and Select. 

To ensure safe and convenient interactions, the driver’s gestures are being recognized within a wide sphere of 25 to 45 centimeters from the car’s dashboard. 

“Our partnership with Renault Nissan Mitsubishi sets in motion a safer driving experience for everyone.

Adding air gesture user interfaces leveraging existing cameras used for Driver Monitoring Systems makes sense for automotive players since they are able to add an extra layer of safety and interaction at a lower cost” 

said Thomas Amilien, CEO of Clay AIR.

Clay AIR leverages existing cameras used for other Driver Monitoring System features 

Because Clay AIR is a hardware-agnostic solution, the two companies were able to partner to bring gestures to the Renault Koleos prototype without adding extra hardware.

The software is embedded in the automotive manufacturer prototype car Koleos’ existing dashboard camera (a Time of Flight camera), which is being used for other Driver Monitoring Systems features such as eye-tracking. The gesture recognition technology has also been successfully integrated with the hardware in the Renault Talisman prototype.

Increased safety and driver convenience, while lowering integration costs 

Clay AIR’s technology unleashes the potential to access advanced features such as virtual object manipulation and interaction, while still ensuring low power consumption.

It can be implemented into any vehicle or device with a camera on board: players in the automotive industry can leverage existing cameras used for other inputs, and still integrate the technology without additional hardware.



Redefining in-car safety and lifestyle experience.