Projects

HomeSound

2018 – Present

HandSight

2013 – Present

SoundWatch

2018 – Present

AR Captioning

2016 – Present

Publications

“Easier or Harder, Depending on Who the Hearing Person Is”: Codesigning Videoconferencing Tools for Small Groups with Mixed Hearing Status

Emma McDonnell, Soo Hyun Moon, Lucy Jiang, Steven Goodman, Raja Kushalnagar, Jon E. Froehlich, Leah Findlater

Proceedings of CHI 2023

SoundWatch: deep learning for sound accessibility on smartwatches

Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Khoa Nguyen, Rachel Grossman-Kahn, Leah Findlater, Jon E. Froehlich

CACM

ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard-of-Hearing Users

Dhruv Jain, Khoa Nguyen, Steven Goodman, Rachel Grossman-Kahn, Hung Ngo, Aditya Kusupati, Ruofei Du, Alex Olwal, Leah Findlater, Jon E. Froehlich

Proceedings of CHI 2022

Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group Captioning

Emma McDonnell, Ping Liu, Steven Goodman, Raja Kushalnagar, Jon E. Froehlich, Leah Findlater

CSCW Proceedings of PACM HCI | Honorable Mention

Toward User-Driven Sound Recognizer Personalization with People who are d/Deaf or Hard of Hearing

Steven Goodman, Ping Liu, Dhruv Jain, Emma McDonnell, Jon E. Froehlich, Leah Findlater

Proceedings of IMWUT 2021

What Do We Mean by “Accessibility Research”? A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019

Kelly Mack, Emma McDonnell, Dhruv Jain, Lucy Lu Wang, Jon E. Froehlich, Leah Findlater

Proceedings of CHI 2021 | Acceptance Rate: 26.3% (749 / 2844) | Honorable Mention

A bibliometric analysis of citation diversity in accessibility and HCI research

Lucy Lu Wang, Kelly Mack, Emma McDonnell, Dhruv Jain, Leah Findlater, Jon E. Froehlich

Extended Abstracts of CHI 2021 | Acceptance Rate: 39.0% (268 / 688)

HoloSound: Combining Speech and Sound Identification for Deaf or Hard of Hearing Users on a Head-mounted Display

Greg Guo, Robin Yiru Yang, Johnson Kuang, Xue Bin, Dhruv Jain, Steven Goodman, Leah Findlater, Jon E. Froehlich

Poster Proceedings of ASSETS 2020

SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users

Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2020 | Best Artifact Award

Field Study of a Tactile Sound Awareness Device for Deaf and Hard of Hearing Users

Dhruv Jain, Brendon Chiu, Steven Goodman, Chris Schmandt, Leah Findlater, Jon E. Froehlich

Proceedings of ISWC 2020

HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users

Dhruv Jain, Kelly Mack, Akli Amrous, Steven Goodman, Matt Wright, Leah Findlater, Jon E. Froehlich

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)

Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-hearing Users Across Contexts

Steven Goodman, Susanne Kirchner, Rose Guttman, Dhruv Jain, Jon E. Froehlich, Leah Findlater

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)

Autoethnography of a Hard of Hearing Traveler

Dhruv Jain, Audrey Desjardins, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2019 | Acceptance Rate: 25.9% (41 / 158) | Best Paper Nominee

Social Tensions with Head-Mounted Displays for Accessibility

Steven Goodman, Dhruv Jain, Jon E. Froehlich, Brock Craft, Leah Findlater

Extended Abstract CHI2019 Workshop Proceedings of SHMD

Deaf and Hard-of-hearing Individuals’ Preferences for Wearable and Mobile Sound Awareness Technologies

Leah Findlater, Bonnie Chinh, Dhruv Jain, Jon E. Froehlich, Raja Kushalnagar, Angela Carey Lin

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)

Towards Accessible Conversations in a Mobile Context for People who are Deaf and Hard of Hearing

Dhruv Jain, Rachel Franz, Leah Findlater, Jackson Cannon, Raja Kushalnagar, Jon E. Froehlich

Proceedings of ASSETS 2018 | Acceptance Rate: 25.9% (28 / 108)

Design of an Augmented Reality Magnification Aid for Low Vision Users

Lee Stearns, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2018

Applying Transfer Learning to Recognize Clothing Patterns Using a Finger-Mounted Camera

Lee Stearns, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2018 | Acceptance Rate: 58.3% (42 / 72)

Exploring Augmented Reality Approaches to Real-Time Captioning: A Preliminary Autoethnographic Study

Dhruv Jain, Bonnie Chinh, Raja Kushalnagar, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of DIS2018

TouchCam: Realtime Recognition of Location-Specific On-Body Gestures to Support Users with Visual Impairments

Lee Stearns, Uran Oh, Leah Findlater, Jon E. Froehlich

ACM IMWUT December 2017

TacTILE: A Preliminary Toolchain for Creating Accessible Graphics with 3D-Printed Overlays and Auditory Annotations

Liang He, Zijian Wan, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

Recognizing Clothing Colors and Visual Textures Using a Finger-Mounted Camera: An Initial Investigation

Alexander Medeiros, Lee Stearns, Leah Findlater, Chuan Chen, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

Augmented Reality Magnification for Low Vision Users with the Microsoft Hololens and a Finger-Worn Camera

Lee Stearns, Victor De Souza, Jessica Yin, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

Investigating Microinteractions for People With Visual Impairments and the Potential Role of on-Body Interaction

Uran Oh, Lee Stearns, Alisha Pradhan, Jon E. Froehlich, Leah Findlater

Proceedings of ASSETS 2017 | Acceptance Rate: 26.2% (33 / 126)

Evaluating Wrist-Based Haptic Feedback for Non-Visual Target Finding and Path Tracing on a 2D Surface

Jonggi Hong, Alisha Pradhan, Jon E. Froehlich, Leah Findlater

Proceedings of ASSETS 2017 | Acceptance Rate: 26.2% (33 / 126)

Comparing Touchscreen and Mouse Input Performance by People With and Without Upper Body Motor Impairments

Leah Findlater, Karyn Moffatt, Jon E. Froehlich, Meethu Malu, Joan Zhang

Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)

Differences in Crowdsourced vs. Lab-based Mobile and Desktop Input Performance Data

Leah Findlater, Joan Zhang, Jon E. Froehlich, Karyn Moffatt

Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)

Localization of Skin Features on the Hand and Wrist From Small Image Patches

Lee Stearns, Uran Oh, Bridget Cheng, Leah Findlater, David Ross, Rama Chellappa, Jon E. Froehlich

Proceedings of ICPR 2016

Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras

Lee Stearns, Ruofei Du, Uran Oh, Catherine Jou, Leah Findlater, David Ross, Jon E. Froehlich

ACM Transactions on Accessible Computing (TACCESS) 2016

Evaluating Angular Accuracy of Wrist-based Haptic Directional Guidance for Hand Movement

Jonggi Hong, Lee Stearns, Tony Cheng, Jon E. Froehlich, David Ross, Leah Findlater

Proceedings of GI 2016 | Acceptance Rate: 39.4% (13 / 33)

Supporting Everyday Activities for Persons with Visual Impairments Through Computer Vision-Augmented Touch

Leah Findlater, Lee Stearns, Ruofei Du, Uran Oh, David Ross, Rama Chellappa, Jon E. Froehlich

Poster Proceedings of ASSETS 2015

Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing

Dhruv Jain, Leah Findlater, Jamie H Gilkeson, Benjamin Holland, Ramani Duraiswami, Dmitry Zotkin, Christian Vogler, Jon E. Froehlich

Proceedings of CHI 2015

The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind

Lee Stearns, Ruofei Du, Uran Oh, Yumeng Wang, Rama Chellappa, Leah Findlater, Jon E. Froehlich

Proceedings of ACVR 2014

Surveying the Accessibility of Touchscreen Games for Persons with Motor Impairments: A Preliminary Analysis

Yoojin Kim, Nitaben Sutreja, Jon E. Froehlich, Leah Findlater

Poster Proceedings of ASSETS 2013

Age-Related Differences in Performance with Touchscreens Compared to Traditional Mouse Input

Leah Findlater, Jon E. Froehlich, Kays Fattal, Jacob Wobbrock, Tanya Dastyar

Proceedings of CHI 2013 | Honorable Mention

The Design and Evaluation of Prototype Eco-Feedback Displays for Fixture-Level Water Usage Data

Jon E. Froehlich, Leah Findlater, Marilyn Ostergren, Solai Ramanathan, Josh Peterson, Inness Wragg, Eric Larson, Fabia Fu, Mazhengmin Bai, Shwetak Patel, James Landay

Proceedings of CHI 2012 | Honorable Mention

The Design of Eco-Feedback Technology

Jon E. Froehlich, Leah Findlater, James Landay

Proceedings of CHI 2010 | Best Paper Award

Talks

Go Mobile! Designing Accessible Mobile Experiences

Nov. 8, 2013 | Enabled by Design-athon

Washington DC

Leah Findlater, Jon E. Froehlich

The design of eco-feedback technology

April 14, 2010 | 28th international conference on Human factors in computing systems (CHI '10)

Atlanta, Georgia

Leah Findlater, Jon E. Froehlich, James Landay