SoundWatch
Project Description
We introduce SoundWatch, an Android app that provides glanceable, always-available sound feedback on smartwatches for d/Deaf and hard-of-hearing users. Created by a diverse team at University of Washington and led by a hard-of-hearing innovator who wanted to build for his community, SoundWatch uses machine learning to alert its users to important sounds occurring in their environment. With everything from critical fire alarms to speech alerts, users know they can rely on SoundWatch to make their environment more accessible. In the spirit of innovation and the spread of knowledge, SmartWatch is freely available and open-sourced for anyone wanting to learn more and contribute to its development.
Since Dhruv Jain graduated in 2022, he has taken SoundWatch with him to the University of Michigan and is now the PI of the project as a Professor in CSE.
Publications
SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users
Proceedings of ASSETS 2020 | Acceptance Rate: 27.5% (46 / 167) | Best Artifact Award
Field Study of a Tactile Sound Awareness Device for Deaf and Hard of Hearing Users
Proceedings of ISWC 2020
Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-hearing Users Across Contexts
Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)
Videos
Talks
Sound Sensing and Feedback Techniques for d/Deaf and Hard of Hearing Users
Mar 12, 2021 | Carnegie Mellon University, HCII Lecture
Virtual
Sound Sensing and Feedback Techniques for d/Deaf and Hard of Hearing Users
Feb 18, 2021 | UW Speech and Hearing Center
Virtual
Sound Sensing and Feedback Techniques for d/Deaf and Hard of Hearing Users
Dec 11, 2020 | UW General exam
Virtual
Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-Hearing Users Across Contexts
May 10, 2020 | CHI
Virtual