Clay AIR

Research Driven Innovation

Clay AIR delivers unparalleled hand tracking and gesture recognition solutions, commanding the future of interactive technology, driving innovation in the automotive industry, and powering the most advanced AR & VR immersive solutions. 

The company is the result of over 10 years of research in Artificial Intelligence, Computer Vision and Human-Machine Interactions. We design and train our models with in-house proprietary tools to provide a fluid and intuitive user experience through state-of-the-art technology.

Benefits

Why Clay AIR?

  • Hardware Agnostic

    Hardware Agnostic

    Clay AIR’s software solutions are platform agnostic and easy to integrate into existing hardware.

  • Customizable

    Customizable

    Forty pre-programmed simple and natural gestures with limitless customization for user experience and unique interfaces across verticals.

  • Efficient

    Efficient

    Low latency with speeds faster than human perception. Battery saving with proprietary computer vision and machine learning techniques.

  • Accurate

    Accurate

    The highest performance of hand tracking & gesture recognition technology. Up to 99% accurate on simple gestures and sequences according to ground truth and f-measure.

Information

Advanced Tracking Technology

Clay AIR proprietary technologies include body and face tracking, plane detection, with a specialty in hand tracking and gesture recognition. Our machine learning model combinations track up to 23 points in space for advanced interaction features. The combination of the location of the points is used to detect gestures, which makes it more accurate than competitive solutions using gesture recognition only.
gestures available in Clay AIR library of pre-programmed gestures for gesture recognition SDK

Hardware Compatibility

Inputs

  • RGB
  • Monochrome
  • TOF
  • IR/NIR
  • Fisheye

Devices

  • VR/AR HMDs
  • Laptops
  • PCs
  • Tablets
  • Smart TVs
  • Robots
  • Smart displays
  • Smartphones

Compute

  • CPU minimum: Snapdragon 425
  • Memory minimum: 20 MB RAM

Software Compatibility

  • Android
  • iOS
  • Mac OS
  • Windows
  • Unity
  • ARCore
  • ARKit
  • Unix/Linux
  • Ubuntu

Performance

Accuracy (Dependent on Hardware)

  • Average 99% on simple trigger gestures and gesture sequences
  • Average +/- 1% on on hand tracking

Latency (Dependent on Frames per Second)

1 frame is an app cycle. 16ms at 60 FPS, 8ms at 120 FPS


Distance

  • Clay Analog: 7 – 8ft
  • Clay ML: 12 – 15ft

Scalability

  • 1 to 4 hands
  • Extensive gesture library and the opportunity to create custom gestures

Our vision

State-of-the-Art Proprietary Technology

Clay AIR was built on the conviction that smart devices will permeate all aspects of our life: autonomous devices, smart robots, extended reality experiences, and more. Humans interact with increasingly complex technology, hence the need for seamless interactions.

Our vision is to enable people to interact intuitively with technology using the most natural language: gestures, leveraging computer vision and machine learning.

To make these intuitive interactions accessible to all, Clay AIR develops proprietary tools and technologies that enable our solutions to be compatible with all kinds of cameras, delivering the best user experience while preserving computing power.

The company is the result of over 10 years of research in Artificial Intelligence, Computer Vision and Human-Machine Interactions. We design and train our models with in-house proprietary tools to provide a natural user experience through state-of-the-art technology.

Our products are backed by various patents on hand tracking, 3D object interactions in XR, and video processing, and our models are designed and trained with in-house proprietary tools.

As a result, our hand tracking and gesture recognition technology is the most accurate, versatile and performant on the market.