Skip to content
Hand Tracking with Millimeter-Wave Radar for AR

Photo via Pexels

Future Tech

Curated by Surfaced Editorial·Computing·3 min read
Share:

Hand tracking with millimeter-wave radar uses high-frequency radio waves to precisely detect and track subtle hand and finger movements in 3D space, even when hands are out of the camera's line of sight or obscured. Google (with Project Soli), Infineon, and automotive radar companies are pioneering this technology. It is primarily in advanced research and prototype stages, demonstrating fine-grained gesture recognition and robust performance in challenging conditions. Google's Project Soli, first showcased in 2015, utilized a tiny radar chip to detect sub-millimeter motions of the human hand at high speeds and accuracy. This offers a robust, privacy-preserving alternative to camera-based hand tracking, which struggles with occlusion, varying lighting, and inherent privacy concerns.

Why It Matters

This technology provides seamless and intuitive interaction with AR environments, allowing users to manipulate virtual objects with natural hand gestures without bulky controllers or being limited by camera visibility. Imagine controlling complex virtual interfaces with subtle finger movements, even through a pocket or under a desk, offering a new level of discreet and ubiquitous interaction with AR. AR/VR hardware manufacturers, human-computer interaction researchers, and automotive companies (for in-cabin gesture control) stand to gain. Manufacturers of physical AR controllers and camera-based tracking solutions might face significant competition. Key barriers include miniaturization for integration into sleek AR glasses, optimizing power consumption, overcoming potential interference, and developing a comprehensive library of intuitive gestures. Mainstream AR integration is estimated within 7-12 years, with Google, Texas Instruments, Infineon, and Meta (exploring alternatives) actively pursuing this. A second-order consequence is the creation of a new form of 'silent communication' or interaction that is invisible to bystanders, raising questions about transparency and awareness in public spaces.

Development Stage

Early Research
Advanced Research
Prototype
Early Commercialization
Growth Phase

Enjoyed this? Get five picks like this every morning.

Free daily newsletter — zero spam, unsubscribe anytime.