Quick Info
Project Date
May 1, 2014 - Oct. 1, 2014
PIs:
Leah Findlater (PI)
Keywords:
accessibility,
head-mounted display,
sound visualization,
augmented reality,
sound awareness
News

Jul 13, 2018 | Dhruv
We’re going to Galway, Ireland! The Makeability Lab has two full papers and three posters at ASSETS’18. UMD PhD student Lee Stearns led a project entitled Design of an Augmented Reality Magnification Aid for Low Vision Users and explores augmented reality solutions for magnifying text for low-vision users. Lee also had a poster paper accepted entitled Applying Transfer Learning to Recognize Clothing Patterns Using a Finger-Mounted Camera. Both projects are in collaboration with UW HCDE professor Leah Findlater. UW CSE PhD student Dhruv Jain led a project entitled Towards Accessible Conversations in a Mobile Context for People Who Are Deaf and Hard of Hearing and examines real-time captioning solutions for people who are DHH and on-the-move. This work is a collaboration among UW CSE (Dhruv Jain, Jon Froehlich), UW HCDE (Rachel Franz, Leah Findlater) and Gallaudet University in DC (Raja Kushalnagar). The Project Sidewalk team also got two posters in: A Feasibility Study of Using Google Street View and Computer Vision to Track the Evolution of Urban Accessibility , which was based on Ladan Najafizdeh's MS thesis work and Interactively Modeling and Visualizing Neighborhood Accessibility at Scale: An Initial Study of Washington DC , which was led by undergrad extraordinaire Anthony Li along with Manaswi Saha).

Jun 09, 2018 | Dhruv
Our CSE PhD Student Dhruv Jain presented a poster at ACM DIS 2018 in Hong Kong! The poster is entitled Exploring Augmented Reality Approaches to Real-Time Captioning: A Preliminary Autoethnographic Study and examines Dhruv’s experiences with using real-time captioning on HoloLens in lectures and group meetings. This work is a collaboration among UW CSE (Dhruv Jain, Jon Froehlich), UW HCDE (Bonnie Chinh, Leah Findlater) and Gallaudet University (Raja Kushalnagar).
About

The GlassEar sound awareness feedback prototype
GlassEar is a real-time sound awareness display using an HMD and a non-wearable microphone array. In the above image sequence, a DHH user is engaged in conversation with three oral conversation partners. Arrows direct attention towards active speakers.
Publications
Sound Sensing and Feedback Techniques for Deaf and Hard of Hearing People
UW CS PhD Dissertation
PDF | doi | Citation | AR Captioning • GlassEar • HomeSound • SoundWatch • ProtoSound • Personalizing Sound Recognition • HoloSound
Videos
Talks
April 20, 2015 | CHI 2015
Seoul, Korea
Project Members


Leah Findlater
May 2014 - Oct 2014
Associate Professor
HCDE
University of Washington
HandSight | SoundWatch | Touchscreen Accessibility

Dhruv Jain
May 2014 - Sep 2014
PhD Student
Computer Science
University of Washington
SoundWatch | AR Captioning | HomeSound