HomeSound: Smarthome Sound Awareness

Quick Info

Project Date Jan. 15, 2018 - Present
PIs: Leah Findlater (PI)
Jon E. Froehlich (Co-PI)
Sponsors: NSF
Keywords: accessibility, deaf, deaf and hard of hearing, smarthome

News

Four Papers Accepted to CHI2020!

Dec 09, 2019 | Jon

The Makeability Lab had four papers accepted to CHI this year. The acceptance rate was 24% (760 accepts of 3126 submissions). Congrats to the lead PhD students: Steven Goodman (HCDE), Dhruv Jain (CSE), Seokbin Kang (CS), Wendy Roldan (HCDE), and all our wonderful collaborators. Goodman, S., Kirchner, S., Guttman, R., Jain, D., Froehlich, J., Findlater, L. Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-hearing Users Across Contexts, CHI2020 Jain D., Mack., K., Amrous, A., Wright, M., Goodman, S., Findlater, L., Froehlich, J. HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users, CHI2020 Kang, S., Shokeen, E., Byrne, V., Norooz, L., Bonsignore, E., Williams-Pierce, C., Froehlich, J. ARMath: Augmenting Everyday Life with Math Learning, CHI2020 Roldan, W., Gao, X., Marie, A., Hishikawa, T, Li, Z., Zhang, E., Froehlich, J., Yip, J. Opportunities and Challenges in Involving Users in Project-Based HCI Education, CHI2020 We plan to post the camera-ready versions of the papers and some videos in January!

HomeSound Wins People's Choice Award

Nov 20, 2019 | Jon

HomeSound won the People's Choice Award and the Madrona Prize Runner-Up at the Allen School Annual Research Showcase. GeekWire has a nice write-up about the event and awards. Congrats team!

High Schoolers Visit the Makeability Lab

Mar 26, 2019 | Jon

The Makeability Lab and the UbiComp Lab hosted students from Northwest High School. The high school students were all taking an Internet of Things (IoT course), which focuses not just on building IoT technology but the societal implications. For example, students are asked to consider: How can this technology help us achieve a more just and equitable world? How will we be able to ensure that these devices improve our quality of life without imprisoning us? What ethics or code of conduct should guide the IoT? Venkatesh spoke about his research supporting blind programmers, Manaswi spoke about Project Sidewalk and urban accessibility visualizations, and Dhruv spoke about his work on sound awareness tools for people who are deaf or hard of hearing.

About

Smarthome sound awareness prototype

One of the three smarthome sound awareness prototypes we explored via a wizard-of-oz study

The home is filled with a rich diversity of sounds from mundane beeps and whirs to dog barks and children’s shouts. In this project, we examine how deaf and hard of hearing (DHH) people think about and relate to sounds in the home, solicit feedback and reactions to initial domestic sound awareness systems, and explore potential concerns. We present findings from two qualitative studies: in Study 1, 12 DHH participants discussed their perceptions of and experiences with sound in the home and provided feedback on initial sound awareness mockups. Informed by Study 1, we designed three tablet-based sound awareness prototypes, which we evaluated with 10 DHH participants using a Wizard-of-Oz approach. Together, our findings suggest a general interest in smarthome-based sound awareness systems particularly for displaying contextually aware, personalized and glanceable visualizations but key concerns arose related to privacy, activity tracking, cognitive overload, and trust.