Quick Info
Project Date
Sept. 1, 2018 - Present
PIs:
Jon E. Froehlich (Co-PI)
Sponsors:
NSF
Keywords:
wearables,
haptics,
accessibility,
deaf,
hard of hearing,
sound visualization,
sound awareness,
smartwatch
News

Aug 18, 2021 | Jon
Congratulations to Dhruv Jain who was selected for the prestigious Microsoft Research Dissertation Grant for his work on “Sound Sensing and Feedback Techniques for Deaf and Hard of Hearing Users.” The MSR Dissertationg Grant aims to "increase the pipeline of diverse talent receiving advanced degrees in computing-related fields by providing a research funding opportunity for doctoral students who are underrepresented in the field of computing." Read more on the Allen School news page.
Congratulations to Dhruv Jain who was selected for the Google-CMD-IT LEAP Alliance Fellowship. CMD-IT stands for the Center for Minorities and People with Disabilities in IT and is dedicated to "promoting innovation that enriches, enhances, and enables our target communities, such that more equitable and sustainable contributions are possible by all communities."

Dec 11, 2020 | Jon
It's my pleasure to announce that Dhruv Jain passed his General Exam entitled Sound Sensing & Feedback Techniques for d/Deaf & Hard of Hearing Users: A Dissertation Proposal. His dissertation work was thoughtfully presented, well rehearsed, and even included two live demos (of HomeSound and of SoundWatch). Congrats DJ! Thanks also to the wonderful committee, including co-chair Professor Findlater and fellow committee members Professors Mankoff, Ladner, Wobbrock, and Bigham—literally an all-star cast of HCI+accessibility experts. You can download the slides here or watch the whole thing on YouTube! A few screenshots of the talk (all but the presenter + interpreters had video off):

Oct 29, 2020 | Jon
Members of the newly launched UW CREATE accessibility center won all three top awards at ASSETS2020—the top publication venue in accessibility research—including Best Artifact for our SoundWatch work, Best Paper awarded to Professor Leah Findlater and her PhD student Lotus Zhang, Best Student Paper awarded to PhD student Megan Hofmann and colleagues (including her advisor and CREATE co-director Jennifer Mankoff). Congrats all! Relatedly, Sarah McQuate wrote a lovely article on our SoundWatch work—check it out!
We just received news that two of Dhruv Jain's first-authored submissions were accepted to ASSETS'20—an amazing accomplishment. Importantly, the work itself is impactful and diverse. Congrats DJ and all collaborators! The papers are linked below: Jain, D., Potluri, V., Sharif, A. (2020). Navigating Graduate School with a Disability: A Trio-Ethnography. Proceedings of ASSETS 2020. 17 pages. To Appear. Jain, D., Ngo, H., Patel, P., Goodman, S., Findlater, L., Froehlich, J. E. (2020). SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users. Proceedings of ASSETS 2020. 16 pages. To Appear.
About

Two example use cases of SoundWatch
Publications
Toward User-Driven Sound Recognizer Personalization with People who are d/Deaf or Hard of Hearing
Proceedings of IMWUT 2021
PDF | doi | Citation | SoundWatch • Personalizing Sound Recognition
SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users
Proceedings of ASSETS 2020 | Best Artifact Award
PDF | doi | Citation | SoundWatch
Field Study of a Tactile Sound Awareness Device for Deaf and Hard of Hearing Users
Proceedings of ISWC 2020
PDF | doi | Citation | SoundWatch
Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-hearing Users Across Contexts
Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)
PDF | doi | Citation | SoundWatch
Videos
SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users
Talks
March 12, 2021 | Carnegie Mellon University, HCII Lecture
Virtual
PDF | PPTX | HoloSound | HomeSound | SoundWatch
Feb. 18, 2021 | UW Speech and Hearing Center
Virtual
PDF | PPTX | HoloSound | HomeSound | SoundWatch
Dec. 11, 2020 | UW General exam
Virtual
Oct. 28, 2020 | ASSETS 2020
Virtual
PDF | PPTX | SoundWatch
May 10, 2020 | CHI 2020
Virtual
PDF | PPTX | SoundWatch
Project Members

Leah Findlater
Sep 2018 - Present
Associate Professor
HCDE
University of Washington
HandSight | Touchscreen Accessibility | SoundWatch


Dhruv Jain
Oct 2018 - Present
PhD Student
Computer Science
University of Washington
SoundWatch | AR Captioning | Accessibility Literature Survey

Steven Goodman
Sep 2019 - Present
PhD Student
HCDE
University of Washington
SoundWatch | ProtoSound | Personalizing Sound Recognition
