Quick Info
Project Date
Jan. 1, 2016 - Present
PIs:
Leah Findlater (PI)
Raja Kushalnagar (Co-PI)
Jon E. Froehlich (Co-PI)
Sponsors:
NSF
Microsoft
Google
Keywords:
accessibility,
head-mounted display,
augmented reality,
deaf and hard of hearing
News
We are excited to receive UW Reality Lab funding to support our research proposal entitled Moving Beyond Speech Transcription: Designing New Sound Feedback Visualizations for Deaf and Hard of Hearing Users. This proposal was led by PhD student Dhruv Jain with co-PIs Froehlich and Findlater.

Mar 26, 2019 | Jon
The Makeability Lab and the UbiComp Lab hosted students from Northwest High School. The high school students were all taking an Internet of Things (IoT course), which focuses not just on building IoT technology but the societal implications. For example, students are asked to consider: How can this technology help us achieve a more just and equitable world? How will we be able to ensure that these devices improve our quality of life without imprisoning us? What ethics or code of conduct should guide the IoT? Venkatesh spoke about his research supporting blind programmers, Manaswi spoke about Project Sidewalk and urban accessibility visualizations, and Dhruv spoke about his work on sound awareness tools for people who are deaf or hard of hearing.
We're proud to announce that UW PhD Student and Makeability Lab Member Dhruv Jain's poster titled "Exploring Augmented Reality Approaches to Real-Time Captioning: An Autoethnographic Study" won the people's choice award in UW Allen School Annual Research Day yesterday! This is part of our larger research agenda on AR Captions Dhruv shares this award with HCDE student Bonnie Chinh, HCDE professor Leah Findlater, Gallaudet University Professor Raja Kushalnagar and CSE professor Jon Froehlich. Read the GeekWire new story here.

Oct 29, 2018 | Dhruv
We had a strong representation at ASSETS 2018 in Galway, Ireland- we presented three posters and two full papers. In pictures, see Dhruv Jain presenting his paper on Augmented Reality Captioning in Mobile Context, Lee Stearns presenting "Design of an Augmented Reality Magnification Aid for Low Vision Users" and Jon Froehlich with his poster "How does Urban Accessibility Change over Time"
About

Real-time captions are overlaid on top of the user's vision via an HMD
In this prototype, the user can adjust the position, size, and 3D orientation of the caption display
Publications
Social Tensions with Head-Mounted Displays for Accessibility
Extended Abstract CHI2019 Workshop Proceedings of SHMD
PDF | Citation | AR Captioning
Towards Accessible Conversations in a Mobile Context for People who are Deaf and Hard of Hearing
Proceedings of ASSETS 2018 | Acceptance Rate: 25.9% (28 / 108)
PDF | doi | Citation | Talk | AR Captioning
Exploring Augmented Reality Approaches to Real-Time Captioning: A Preliminary Autoethnographic Study
Extended Abstract Proceedings of DIS2018
PDF | doi | Citation | AR Captioning
Talks
Oct. 22, 2018 | ASSETS 2018
Galway, Ireland
PDF | PPTX | SlideShare | Paper | AR Captioning
Project Members


Leah Findlater
Sep 2018 - Present
Associate Professor
HCDE
University of Washington
HandSight | SoundWatch | Touchscreen Accessibility


Dhruv Jain
Sep 2017 - Present
PhD Student
Computer Science
University of Washington
SoundWatch | AR Captioning | Accessibility Literature Survey