Quick Info
Project Date
May 1, 2014 - Oct. 1, 2014
PIs:
Leah Findlater (PI)
Keywords:
accessibility,
head-mounted display,
sound visualization,
augmented reality,
sound awareness
News

Jul 13, 2018 | Dhruv
We’re going to Galway, Ireland! The Makeability Lab has two full papers and three posters at ASSETS’18. UMD PhD student Lee Stearns led a project entitled Design of an Augmented Reality Magnification Aid for Low Vision Users and explores augmented reality solutions for magnifying text for low-vision users. Lee also had a poster paper accepted entitled Applying Transfer Learning to Recognize Clothing Patterns Using a Finger-Mounted Camera. Both projects are in collaboration with UW HCDE professor Leah Findlater. UW CSE PhD student Dhruv Jain led a project entitled Towards Accessible Conversations in a Mobile Context for People Who Are Deaf and Hard of Hearing and examines real-time captioning solutions for people who are DHH and on-the-move. This work is a collaboration among UW CSE (Dhruv Jain, Jon Froehlich), UW HCDE (Rachel Franz, Leah Findlater) and Gallaudet University in DC (Raja Kushalnagar). The Project Sidewalk team also got two posters in: A Feasibility Study of Using Google Street View and Computer Vision to Track the Evolution of Urban Accessibility , which was based on Ladan Najafizdeh's MS thesis work and Interactively Modeling and Visualizing Neighborhood Accessibility at Scale: An Initial Study of Washington DC , which was led by undergrad extraordinaire Anthony Li along with Manaswi Saha).

Jun 09, 2018 | Dhruv
Our CSE PhD Student Dhruv Jain presented a poster at ACM DIS 2018 in Hong Kong! The poster is entitled Exploring Augmented Reality Approaches to Real-Time Captioning: A Preliminary Autoethnographic Study and examines Dhruv’s experiences with using real-time captioning on HoloLens in lectures and group meetings. This work is a collaboration among UW CSE (Dhruv Jain, Jon Froehlich), UW HCDE (Bonnie Chinh, Leah Findlater) and Gallaudet University (Raja Kushalnagar).
About

The GlassEar sound awareness feedback prototype
GlassEar is a real-time sound awareness display using an HMD and a non-wearable microphone array. In the above image sequence, a DHH user is engaged in conversation with three oral conversation partners. Arrows direct attention towards active speakers.
Videos
Talks
April 20, 2015 | CHI 2015
Seoul, Korea
Project Members


Leah Findlater
May 2014 - Oct 2014
Associate Professor
HCDE
University of Washington
HandSight | SoundWatch | Touchscreen Accessibility

Dhruv Jain
May 2014 - Sep 2014
PhD Student
Computer Science
University of Washington
SoundWatch | AR Captioning | Accessibility Literature Survey