Eyes-free Computing
Looking Back, Looking Forward
T. V. Raman
June 09, 2018
Eyes-free Computing
Looking Back, Looking Forward
T. V. Raman
June 09, 2018
Effective Information Access
Eyes-free Computing
4 / 13
■
When we want,
■
Where we want,
■
The way we want!
This Journey Began 30 Years Ago!
Milestones Along The Way
Eyes-free Computing
5 / 13
■
ASTER —Audio System For Technical Readings —(1990s).
■
PDF —Capture and extract document structure —(1995).
■
Web —Design standards for multimodal interaction —(2000).
■
Search —Deliver results the way the user wants —(2005).
■
Mobile —Ubiquitous information access —(2008).
■
Smart speakers —Mainstream eyes-free information access —(2014).
Insights Gathered Along The Way
Eyes-free Computing
6 / 13
■
Electronic information is display-independent.
■
Leverage features of specific interaction modalities e.g., speech.
■
User Interface is a means to an end.
■
UI —Capture User Intent, Grab User Attention.
■
UI peripherals determine the size and shape of computing devices.
Information Is Display Independent
Eyes-free Computing
8 / 13
Single Source, Multiple Outputs
Info
Visual
Audio
Speak
UI —Capture Intent, Grab Attention
Eyes-free Computing
9 / 13
C
Input
Output
U
data res
intent
attn
UI Defines The Device
Eyes-free Computing
10 / 13
■
Desktop: Keyboard, Monitor, Mouse.
■
Laptop: LCD Panel, Keyboard, Trackpad.
■
Smart Phone: Shiny piece of glass.
■
Smart Speaker: Microphone array.
UI Peripherals Determine Device Form-factor!
Conclusion
Eyes-free Computing
12 / 13
■
UI determines size and shape of computing.
■
Ubiquitous information access requires User Aware UI.
