SoundWatch: deep learning for sound accessibility on smartwatches

Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Khoa Nguyen, Rachel Grossman-Kahn, Leah Findlater, Jon E. Froehlich

CACM

keywords: wearables, sound visualization, sound awareness, smartwatch, sound classification, sound recognition, sound sensing, AI for accessibility

PDF | doi | Citation | Code | SoundWatch

ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard-of-Hearing Users

Dhruv Jain, Khoa Nguyen, Steven Goodman, Rachel Grossman-Kahn, Hung Ngo, Aditya Kusupati, Ruofei Du, Alex Olwal, Leah Findlater, Jon E. Froehlich

Proceedings of CHI 2022 | Acceptance Rate: 404.9% (2579 / 637)

keywords: deaf, hard of hearing, sound classification, sound recognition, few-shot learning, sound sensing, Deaf

PDF | doi | Citation | ProtoSound

SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users

Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2020 | Acceptance Rate: 27.5% (46 / 167) | Best Artifact Award

keywords: wearables, haptics, sound visualization, sound awareness, deaf and hard of hearing, smartwatch

PDF | doi | Citation | SoundWatch