Skip to content
Multi-Modal Sensory Substitution Devices (SSD)
Future Tech

Curated by Surfaced Editorial·Healthcare·3 min read
Share:

Multi-Modal Sensory Substitution Devices (SSDs) convert sensory information from one modality (e.g., vision) into stimuli for another, intact modality (e.g., touch or hearing), effectively allowing the brain to 'learn' a new sense. For instance, a camera captures visual data and translates it into a pattern of electrical stimulation on the tongue or vibrotactile feedback on the back, or converts it into a rich auditory landscape. Key organizations involved include Wicab (developer of the BrainPort V100), the EyeCane project at Hebrew University, and numerous academic labs like the University of Southern California and MIT Media Lab. This technology is in early commercialization for specific applications, primarily aiding the visually impaired. A notable milestone was the FDA approval of the BrainPort V100 in 2015, which uses a tongue-mounted electrode array to provide spatial information for blind users, demonstrating practical real-world navigation capabilities. This differs from traditional assistive devices by directly translating complex sensory data rather than merely amplifying or simplifying it.

Why It Matters

Sensory disabilities, particularly blindness (affecting over 40 million globally) and deafness, severely limit an individual's interaction with the world, leading to significant functional impairments and social isolation. When mainstream, SSDs could offer profound new ways for individuals with sensory loss to perceive their surroundings, interpret complex data, and even develop a 'sixth sense' for information beyond normal human perception. Individuals with sensory impairments, their caregivers, and companies innovating in assistive technology would be major winners, while traditional braille or sign language education might evolve to incorporate these new modalities. Main technical barriers include improving the resolution and intuitiveness of the sensory conversion algorithms, reducing cognitive load on the user during interpretation, and miniaturizing the devices for comfortable daily wear. A realistic timeline for widespread, highly functional SSDs is 5-10 years. Israel, the US, and various European countries are highly active in this space. A second-order consequence is the fundamental alteration of human perception, potentially leading to new forms of consciousness, enhanced situational awareness, or even novel ways of understanding and interacting with the environment.

Development Stage

Early Research
Advanced Research
Prototype
Early Commercialization
Growth Phase

Enjoyed this? Get five picks like this every morning.

Free daily newsletter — zero spam, unsubscribe anytime.