The Sensory Design Framework is an adapted, humanity-inspired, industry-wide design language for spatial computing. Both computers and humans are at a nexus of multisensory acceleration. Computers are developing additional senses of their own, like computer vision, voice interfaces, and haptic controls. At the same time, users are beginning to turn to wholly multisensory experiences that move beyond the traditional two-dimensional audiovisual interface into the field of immersive spatial computing. We aim to align the human and machine senses in an intuitive, ethical manner to ensure a societal benefit through design. Just as Material Design Language became the default guide for mobile interface design, we hope that Sensory Design Language will become the default design guide for multisensory interactions beyond the screen.

Our Approach

• Be Human-Centered, by building a language around humane, intuitive interactions. We can only do this by understanding fundamental human behavior and cognition.
• Be Collaborative, by learning with industry experts inside and outside of Adobe. We’re currently working with academic and industry experts in the fields of spatial audio, computer vision, neuroscience, immersive design and related ML fields. Some of our advisors include Tea Uglow, Mark Billinghurst, Jeremy Bailenson, Avi Bar-Zeev, and Joshua To.
• Be Design Leaders, by sharing our insights publicly to product teams utilizing spatial computing like AR, Voice, gestures and haptics, enhanced with ML. 

‍

Our Best Practices

Multi-Sensory

Our tools need to be multi-sensory. By allowing our tools to take in and combine different senses, we will enable products to share experiences, not just information.

Physical by Nature

Our tools need to be physical by nature. Designs placed in the world will only be accepted when they act naturally and humanely. 

3D by Default

We’re moving from the 2D screen to the 3D world. User interfaces and content will have to adapt to an uncontrolled environment, not the other way around. Our design tools need to be three dimensional in nature and approach.

Direct Input

Screens, keyboards, and mice will need to validate their existence when we can directly interact with things in our world. Removing direct interactions from our experience removes the joy of an experience.