HomeSound

Quick Info

Project Date Jan. 15, 2018 - Present
PIs: Leah Findlater (PI)
Jon E. Froehlich (Co-PI)
Sponsors: NSF
Keywords: accessibility, deaf, deaf and hard of hearing, smarthome

News

Dhruv Jain Passes General Exam

Dec 11, 2020 | Jon

It's my pleasure to announce that Dhruv Jain passed his General Exam entitled Sound Sensing & Feedback Techniques for d/Deaf & Hard of Hearing Users: A Dissertation Proposal. His dissertation work was thoughtfully presented, well rehearsed, and even included two live demos (of HomeSound and of SoundWatch). Congrats DJ! Thanks also to the wonderful committee, including co-chair Professor Findlater and fellow committee members Professors Mankoff, Ladner, Wobbrock, and Bigham—literally an all-star cast of HCI+accessibility experts. You can download the slides here or watch the whole thing on YouTube! A few screenshots of the talk (all but the presenter + interpreters had video off):

Four Papers Accepted to CHI2020!

Dec 09, 2019 | Jon

The Makeability Lab had four papers accepted to CHI this year. The acceptance rate was 24% (760 accepts of 3126 submissions). Congrats to the lead PhD students: Steven Goodman (HCDE), Dhruv Jain (CSE), Seokbin Kang (CS), Wendy Roldan (HCDE), and all our wonderful collaborators. Goodman, S., Kirchner, S., Guttman, R., Jain, D., Froehlich, J., Findlater, L. Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-hearing Users Across Contexts, CHI2020 Jain D., Mack., K., Amrous, A., Wright, M., Goodman, S., Findlater, L., Froehlich, J. HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users, CHI2020 Kang, S., Shokeen, E., Byrne, V., Norooz, L., Bonsignore, E., Williams-Pierce, C., Froehlich, J. ARMath: Augmenting Everyday Life with Math Learning, CHI2020 Roldan, W., Gao, X., Marie, A., Hishikawa, T, Li, Z., Zhang, E., Froehlich, J., Yip, J. Opportunities and Challenges in Involving Users in Project-Based HCI Education, CHI2020 We plan to post the camera-ready versions of the papers and some videos in January!

HomeSound Wins People's Choice Award

Nov 20, 2019 | Jon

HomeSound won the People's Choice Award and the Madrona Prize Runner-Up at the Allen School Annual Research Showcase. GeekWire has a nice write-up about the event and awards. Congrats team!

About

Smarthome sound awareness prototype

One of the three smarthome sound awareness prototypes we explored via a wizard-of-oz study

The home is filled with a rich diversity of sounds from mundane beeps and whirs to dog barks and children’s shouts. In this project, we examine how deaf and hard of hearing (DHH) people think about and relate to sounds in the home, solicit feedback and reactions to initial domestic sound awareness systems, and explore potential concerns. We present findings from two qualitative studies: in Study 1, 12 DHH participants discussed their perceptions of and experiences with sound in the home and provided feedback on initial sound awareness mockups. Informed by Study 1, we designed three tablet-based sound awareness prototypes, which we evaluated with 10 DHH participants using a Wizard-of-Oz approach. Together, our findings suggest a general interest in smarthome-based sound awareness systems particularly for displaying contextually aware, personalized and glanceable visualizations but key concerns arose related to privacy, activity tracking, cognitive overload, and trust.