Jon E. Froehlich

Associate Professor, CS
University of Washington

I am an Associate Professor in the Paul G. Allen School of Computer Science and Engineering at the University of Washington, a Sloan Fellow, and NSF CAREER awardee. My research is in Human-Computer Interaction (HCI) with a focus on high-value social domains such as accessibility, environmental sustainability, and STEM education. I have published over 50 peer-reviewed publications; eleven have been honored with awards, including Best Papers at ACM CHI and ASSETS and a 10-Year Impact Award at UbiComp. Since becoming a professor in 2012, I have taught ~250 undergraduate students and ~150 graduate students in HCI, Design, and UbiComp courses and served as a research advisor to nine graduate students, 50+ undergraduates, and 15 high school students. From 2012-2017, I was an Assistant Professor in Computer Science at the University of Maryland.

Recent News

Liang He Passes General Exam

Dec 18, 2020 | Jon

Announcing Liang He, PhD Candidate! Liang He successfully passed his General Exam entitled Interactive Design Tools and Techniques for Augmented 3D Printable Behaviors. His talk and accompanying slides were beautifully designed and thoughtfully captured his vision for enabling designers and DIY makers to more easily prototype and fabricate interactive 3D printable forms. Congrats Liang!

Dhruv Jain Passes General Exam

Dec 11, 2020 | Jon

It's my pleasure to announce that Dhruv Jain passed his General Exam entitled Sound Sensing & Feedback Techniques for d/Deaf & Hard of Hearing Users: A Dissertation Proposal. His dissertation work was thoughtfully presented, well rehearsed, and even included two live demos (of HomeSound and of SoundWatch). Congrats DJ! Thanks also to the wonderful committee, including co-chair Professor Findlater and fellow committee members Professors Mankoff, Ladner, Wobbrock, and Bigham—literally an all-star cast of HCI+accessibility experts. You can download the slides here or watch the whole thing on YouTube! A few screenshots of the talk (all but the presenter + interpreters had video off):

Announcing Dr. Seokbin Kang

Nov 10, 2020 | Jon

Announcing Dr. Seokbin Kang—Seokbin successfully defended his PhD dissertation entitled Augmented Reality Systems and USer Interaction Techniques for STEM Learning." Seokbin is my last UMD CS advisee and it was an enormous honor working with him. Thanks also to the amazing commitee, which included Professors David Jacobs, Tamara Clegg, Huaishu Peng, and David Weintrop.

SoundWatch Wins Best Artifact Award at ASSETS

Oct 29, 2020 | Jon

Members of the newly launched UW CREATE accessibility center won all three top awards at ASSETS2020—the top publication venue in accessibility research—including Best Artifact for our SoundWatch work, Best Paper awarded to Professor Leah Findlater and her PhD student Lotus Zhang, Best Student Paper awarded to PhD student Megan Hofmann and colleagues (including her advisor and CREATE co-director Jennifer Mankoff). Congrats all! Relatedly, Sarah McQuate wrote a lovely article on our SoundWatch work—check it out!

Manaswi Saha Honored with Google PhD Fellowship

Oct 07, 2020 | Jon

We are incredibly excited and proud of PhD student Manaswi Saha, who was just honored with the 2020 Google PhD Fellowship for her work on Project Sidewalk and urban accessibility. Congrats Manaswi on this well-deserved recognition for your important work. An excerpt of the official blurb from the Allen School News website: Saha, who is one of 53 students throughout the world to be selected for a Google Fellowship, will use those tools to fill an informational gap between citizens and the local government and stakeholders showing where improvements in sidewalks need to be made to make them accessible to all. “Since the beginning of my academic career, my research interests have been towards socially impactful projects. Public service, especially for underrepresented communities, runs in my family,” Saha said. “The driving force for the work I do stems from my role model, my father, who dedicated his life towards rural and agricultural development in India. His selfless efforts inspired me to explore how technology can be used for the betterment of society. With this goal in mind, I set out to do my Ph.D. with a focus on high-value social problems.” Saha works with Froehlich in the Makeability Lab on one of its flagship ventures, Project Sidewalk. The project has two goals: to develop and study data collection methods for acquiring street-level accessibility information using crowdsourcing, machine learning, and online map imagery and to design and develop navigation and map tools for accessibility.

Projects

BodyVis

2012 – 2019

HandSight

2013 – Present

Project Sidewalk

2012 – Present

Pervasive Thermography

2014 – 2019

Social Fabric Fitness

2012 – 2014

Touchscreen Accessibility

– Present

MakerWear

2012 – Present

SqueezaPulse

2015 – 2016

Ondulé

2017 – 2019

PrototypAR

2017 – 2019

AccessVis

2016 – Present

AR Captioning

2016 – Present

I Like This Shirt

2014 – 2015

GlassEar

2014

SharedPhys

2014 – 2017

Accessibility-Infused Maps

2016 – Present

TacTILE

2017

Anchored Audio Sampling

2018

HomeSound

2018 – Present

Deaf Travel Autoethnography

2018 – 2019

UITalk

2019

ARMath

2018 – 2020

SoundWatch

2018 – Present

Publications

Toward User-Driven Sound Recognizer Personalization with People who are d/Deaf or Hard of Hearing

Steven Goodman, Ping Liu, Dhruv Jain, Emma McDonnell, Jon E. Froehlich, Leah Findlater

Proceedings of IMWUT 2021 To Appear

keywords: deaf and hard of hearing, sound recognition, interactive machine learning, teachable machines, personalization

PDF | Citation • SoundWatch • Personalizing Sound Recognition

A bibliometric analysis of citation diversity in accessibility and HCI research

Lucy Lu Wang, Kelly Mack, Emma McDonnell, Dhruv Jain, Leah Findlater, Jon E. Froehlich

Extended Abstracts of CHI 2021 | Acceptance Rate: 39.0% (268 / 688)

keywords: accessibility, disability, bibliometrics, citation analysis

PDF | Citation | Code | Talk

Examining Visual Semantic Understanding in Blind and Low-Vision Technology Users

Venkatesh Potluri, Tad Grindeland, Jon E. Froehlich, Jennifer Mankoff

Proceedings of CHI 2021 | Acceptance Rate: 26.3% (749 / 2844)

keywords: blind, blind making, design tools, desktop accessibility, touchscreen accessibility

PDF | Citation

What Do We Mean by “Accessibility Research”? A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019

Kelly Mack, Emma McDonnell, Dhruv Jain, Lucy Lu Wang, Jon E. Froehlich, Leah Findlater

Proceedings of CHI 2021 | Acceptance Rate: 26.3% (749 / 2844) | Honorable Mention

keywords: accessibility, assistive technology, disability rights, disability, literature review

PDF | Citation | Code

HoloSound: Combining Speech and Sound Identification for Deaf or Hard of Hearing Users on a Head-mounted Display

Greg Guo, Robin Yiru Yang, Johnson Kuang, Xue Bin, Dhruv Jain, Steven Goodman, Leah Findlater, Jon E. Froehlich

Poster Proceedings of ASSETS 2020

keywords: augmented reality, real-time captioning, sound awareness, deaf and hard of hearing, sound localization, sound classification

PDF | doi | Citation | Code • HoloSound

SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users

Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2020

keywords: wearables, haptics, sound visualization, sound awareness, deaf and hard of hearing, smartwatch

PDF | doi | Citation • SoundWatch

Urban Accessibility as a Socio-Political Problem: A Multi-Stakeholder Analysis

Manaswi Saha, Devanshi Chauhan, Siddhant Patil, Rachel Kangas, Jeffrey Heer, Jon E. Froehlich

CSCW 2020

keywords: urban informatics, urban accessibility, sidewalk assessment, sidewalk accessibility, policy, civic tech, socio-political challenges, disability rights

PDF | doi | Citation • Project Sidewalk

Sidewalk Accessibility in the US and Mexico: Policies, Tools, and A Preliminary Case Study

Jon E. Froehlich, Mikey Saugstad, Edgar Martínez, Rebeca de Buen Kalman

Extended Abstract Workshop Proceedings of Civic Tech 2020

keywords: urban informatics, urban accessibility, Mexico, sidewalk assessment, sidewalk accessibility, disability rights

PDF | Citation • Project Sidewalk

Towards Mapping and Assessing Sidewalk Accessibility Across Socio-cultural and Geographic Contexts

Jon E. Froehlich, Mikey Saugstad, Manaswi Saha, Matthew Johnson

Extended Abstract Data4Good

keywords: urban informatics, urban accessibility, sidewalks, Mexico, sidewalk assessment, sidewalk accessibility, policy, disability rights

PDF | Citation • Project Sidewalk

Field Study of a Tactile Sound Awareness Device for Deaf and Hard of Hearing Users

Dhruv Jain, Brendon Chiu, Steven Goodman, Chris Schmandt, Leah Findlater, Jon E. Froehlich

Proceedings of ISWC 2020

keywords: wearables, haptics, accessibility, deaf, hard of hearing, sound awareness

PDF | doi | Citation • SoundWatch

HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users

Dhruv Jain, Kelly Mack, Akli Amrous, Steven Goodman, Matt Wright, Leah Findlater, Jon E. Froehlich

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)

keywords: accessibility, deaf, deaf and hard of hearing, smarthome

PDF | doi | Citation • HomeSound

Involving End-Users in HCI Education: A Case Study and Steps Forward

Wendy Roldan, Jon E. Froehlich, Jason Yip

Extended Abstract EduCHI 2020

keywords: hci education, design education, design process, participatory design

PDF | Citation

Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-hearing Users Across Contexts

Steven Goodman, Susanne Kirchner, Rose Guttman, Dhruv Jain, Jon E. Froehlich, Leah Findlater

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)

keywords: sound visualization, sound awareness, deaf and hard of hearing, smartwatch

PDF | doi | Citation • SoundWatch

Opportunities and Challenges in Involving Users in Project-Based HCI Education

Wendy Roldan, Xin Gao, Allison Marie Hishikawa, Tiffany Ku, Ziyue Li, Echo Zhang, Jon E. Froehlich, Jason Yip

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126) | Honorable Mention

keywords: design education, hci education, participatory design

PDF | doi | Citation

ARMath: Augmenting Everyday Life with Math Learning

Seokbin Kang, Ekta Shokeen, Virginia Byrne, Leyla Norooz, Elizabeth Bonsignore, Caro Williams-Pierce, Jon E. Froehlich

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)

keywords: educational technology, augmented reality, embodied learning, math, tangibles

PDF | doi | Citation • ARMath

Organizing Family Support Services at ACM Conferences

Audrey Girouard, Jon E. Froehlich, Regan Mandryk, Mark Hancock

Communications of the ACM

keywords: family, inclusivity, conference organization

PDF | doi | Citation

Autoethnography of a Hard of Hearing Traveler

Dhruv Jain, Audrey Desjardins, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2019 | Acceptance Rate: 25.9% (41 / 158) | Best Paper Nominee

keywords: accessibility, hard of hearing, longitudinal study, assistive technology, deaf and hard of hearing

PDF | doi | Citation • Deaf Travel Autoethnography

Deep Learning for Automatically Detecting Sidewalk Accessibility Problems Using Streetscape Imagery

Galen Weld, Esther Jang, Anthony Li, Aileen Zeng, Kurtis Heimerl, Jon E. Froehlich

Proceedings of ASSETS 2019 | Acceptance Rate: 25.9% (41 / 158) | Best Paper Award

keywords: mobility impairments, computer vision, urban informatics, deep learning, sidewalks, neural networks

PDF | doi | Citation | Code • Project Sidewalk • Deep Learning for Sidewalk Assessment

AI-Assisted UI Design for Blind and Low-Vision Creators

Venkatesh Potluri, Tad Grindeland, Jon E. Froehlich, Jennifer Mankoff

Extended Abstract ASSETS'19 Workshop: AI Fairness for People with Disabilities

keywords: blind, user-centered design, programming, design process

PDF | Citation

Ondulé: Designing and Controlling 3D Printable Springs

Liang He, Huaishu Peng, Michelle Lin, Ravi Konjeti, François Guimbretière, Jon E. Froehlich

Proceedings of UIST 2019 | Acceptance Rate: 24.4% (93 / 381)

keywords: 3d printing, fabrication, 3d-printed deformation behaviors

PDF | doi | Citation | Talk • Ondulé

A Multi-Modal Approach for Blind and Visually Impaired Developers to Edit Webpage Designs

Venkatesh Potluri, Liang He, Christine Chen, Jon E. Froehlich, Jennifer Mankoff

Extended Abstract ASSETS 2019 | Acceptance Rate: 58.8% (57 / 97)

keywords: accessibility, low-vision, blind users, accessible touchscreens

PDF | doi | Citation • UITalk

PrototypAR: Prototyping and Simulating Complex Systems with Paper Craft and Augmented Reality

Seokbin Kang, Leyla Norooz, Elizabeth Bonsignore, Virginia Byrne, Tamara L. Clegg, Jon E. Froehlich

Proceedings of IDC 2019

keywords: stem, construction kits, augmented reality, prototyping tool

PDF | doi | Citation • PrototypAR

Social Tensions with Head-Mounted Displays for Accessibility

Steven Goodman, Dhruv Jain, Jon E. Froehlich, Brock Craft, Leah Findlater

Extended Abstract CHI2019 Workshop Proceedings of SHMD

keywords: accessibility, head-mounted display, social perception

PDF | Citation • AR Captioning

Deaf and Hard-of-hearing Individuals’ Preferences for Wearable and Mobile Sound Awareness Technologies

Leah Findlater, Bonnie Chinh, Dhruv Jain, Jon E. Froehlich, Raja Kushalnagar, Angela Carey Lin

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)

keywords: head-mounted display, sound visualization, sound awareness, deaf and hard of hearing, smartwatch, smartphone

PDF | doi | Citation

Anchored Audio Sampling: A Seamless Method for Exploring Children's Thoughts During Deployment Studies

Alexis Hiniker, Jon E. Froehlich, Mingrui Zhang, Erin Beneteau

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960) | Best Paper Award

keywords: experience sampling method, children, context-aware experience sampling

PDF | doi | Citation | Code • Anchored Audio Sampling

Project Sidewalk: A Web-based Crowdsourcing Tool for Collecting Sidewalk Accessibility Data at Scale

Manaswi Saha, Mikey Saugstad, Teja Maddali, Aileen Zeng, Ryan Holland, Steven Bower, Aditya Dash, Sage Chen, Anthony Li, Kotaro Hara, Jon E. Froehlich

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960) | Best Paper Award

keywords: mobility impairments, gis, wheelchair, crowdsourcing, urban accessibility

PDF | doi | Citation | Code • Project Sidewalk

Exploring Sound Awareness in the Home for People who are Deaf or Hard of Hearing

Dhruv Jain, Angela Carey Lin, Marcus Amalachandran, Aileen Zeng, Jon E. Froehlich

Proceedings of CHI 2019 | Acceptance Rate: 23.7% (701 / 2960)

keywords: sound visualization, iot, sound awareness, deaf and hard of hearing, smarthome

PDF | doi | Citation • HomeSound

Thermporal: An Easy-to-Deploy Temporal Thermographic Sensor System to Support Residential Energy Audits

Matthew L Mauriello, Brenna McNally, Jon E. Froehlich

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)

keywords: thermography, sensing, thermal cameras, field deployments

PDF | doi | Citation | Talk • Pervasive Thermography • Thermporal

Grand challenges in accessible maps

Jon E. Froehlich, Anke Brock, Anat Caspi, Joao Guerreiro, Kotaro Hara, Reuben Kirkham, Johannes Schoning, Benjamin Tannert

Interactions

keywords: accessibility, mobility impairments, gis, accessible urban navigation, accessible cities, visual impairments, accessibility map visualizations

PDF | doi | Citation • Project Sidewalk • Accessibility-Infused Maps

Design of an Augmented Reality Magnification Aid for Low Vision Users

Lee Stearns, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2018

keywords: wearables, head-mounted display, low-vision, visual impairments, assistive technology, augmented reality

PDF | doi | Citation | Talk • HandSight • AR Magnification

A Feasibility Study of Using Google Street View and Computer Vision to Track the Evolution of Urban Accessibility

Ladan Najafizadeh, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2018

keywords: computer vision, google street view, urban informatics, urban data mining, urban accessibility

PDF | doi | Citation • Project Sidewalk • Urban Accessibility Evolution

Towards Accessible Conversations in a Mobile Context for People who are Deaf and Hard of Hearing

Dhruv Jain, Rachel Franz, Leah Findlater, Jackson Cannon, Raja Kushalnagar, Jon E. Froehlich

Proceedings of ASSETS 2018 | Acceptance Rate: 25.9% (28 / 108)

keywords: augmented reality, real-time captioning, deaf and hard of hearing

PDF | doi | Citation | Talk • AR Captioning

Interactively Modeling and Visualizing Neighborhood Accessibility at Scale: An Initial Study of Washington DC

Anthony Li, Manaswi Saha, Anupam Gupta, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2018

keywords: urban informatics, information visualization, urban data mining, urban accessibility, geo-visualization, walkability index

PDF | doi | Citation • Project Sidewalk • Accessibility-Infused Maps • AccessVis

Applying Transfer Learning to Recognize Clothing Patterns Using a Finger-Mounted Camera

Lee Stearns, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2018 | Acceptance Rate: 58.3% (42 / 72)

keywords: wearables, computer vision, visual impairments, pattern recognition, transfer learning

PDF | doi | Citation • HandSight • Cloth Recognition

A Large-Scale Analysis of YouTube Videos Depicting Everyday Thermal Camera Use

Matthew L Mauriello, Brenna McNally, Cody Buntain, Sapna Bagalkotkar, Samuel Kushnir, Jon E. Froehlich

Proceedings of MobileHCI2018

keywords: thermography, sustainable hci, environmental sustainability, thermal cameras, youtube, user-generated content

PDF | doi | Citation | Talk • Pervasive Thermography

Scaffolding Authentic Wearable-Based Scientific Inquiry for Early Elementary Learners

Virginia Byrne, Seokbin Kang, Leyla Norooz, Rafael Antonio Velez, Monica Katzen, Afe Addeh, Jon E. Froehlich, Tamara L. Clegg

Proceedings of ICLS2018

keywords: sharedphys, bodyvis, physiological sensing, large-screen displays, mixed-reality, scientific inquiry, collaborative learning, stem, wearables

PDF | Citation | Talk • BodyVis • SharedPhys

Physiological Investigations with Live Physiological Sensing and Visualization Tools

Tamara L. Clegg, Virginia Byrne, Leyla Norooz, Seokbin Kang, Jon E. Froehlich

Extended Abstract Symposium Proceedings of ICLS2018

keywords: sharedphys, bodyvis, physiological sensing, large-screen displays, mixed-reality, scientific inquiry, collaborative learning, stem, wearables

PDF | doi | Citation • BodyVis • SharedPhys

Exploring Augmented Reality Approaches to Real-Time Captioning: A Preliminary Autoethnographic Study

Dhruv Jain, Bonnie Chinh, Raja Kushalnagar, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of DIS2018

keywords: deaf, augmented reality, real-time captioning, sound awareness

PDF | doi | Citation • AR Captioning

SIG: Making Maps Accessible and Putting Accessibility in Maps

Anke Brock, Jon E. Froehlich, Joao Guerreiro, Benjamin Tannert, Anat Caspi, Johannes Schoning, Steve Landau

Extended Abstract Proceedings of CHI 2018

keywords: accessibility, crowdsourcing accessibility, accessible urban navigation, accessible cities, physical accessibility, touchscreen accessibility, accessible interfaces

PDF | doi | Citation • Project Sidewalk • Accessibility-Infused Maps

Prototyping and Simulating Complex Systems with Paper Craft and Augmented Reality: An Initial Investigation

Seokbin Kang, Leyla Norooz, Virginia Byrne, Tamara L. Clegg, Jon E. Froehlich

Extended Abstract Proceedings of TEI2018

keywords: children, augmented reality, prototyping, prototyping tool, design process

PDF | doi | Citation • PrototypAR

TouchCam: Realtime Recognition of Location-Specific On-Body Gestures to Support Users with Visual Impairments

Lee Stearns, Uran Oh, Leah Findlater, Jon E. Froehlich

ACM IMWUT December 2017

keywords: wearables, accessibility, computer vision, low-vision, blind users, on-body interaction, skin texture classification, gesture recognition

PDF | doi | Citation • HandSight • On-Body Interaction • TouchCam

Evaluating Wrist-Based Haptic Feedback for Non-Visual Target Finding and Path Tracing on a 2D Surface

Jonggi Hong, Alisha Pradhan, Jon E. Froehlich, Leah Findlater

Proceedings of ASSETS 2017 | Acceptance Rate: 26.2% (33 / 126)

keywords: wearables, haptics, accessibility, blind, blind users, haptic feedback, haptic wristband, directional guidance

PDF | doi | Citation • Touchscreen Accessibility • HandSight • Haptic Hand Guidance

TacTILE: A Preliminary Toolchain for Creating Accessible Graphics with 3D-Printed Overlays and Auditory Annotations

Liang He, Zijian Wan, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

keywords: blind, visual impairments, touchscreens, 3d printing, fabrication, speech interfaces, accessible graphics

PDF | doi | Citation • Touchscreen Accessibility • TacTILE

Recognizing Clothing Colors and Visual Textures Using a Finger-Mounted Camera: An Initial Investigation

Alexander Medeiros, Lee Stearns, Leah Findlater, Chuan Chen, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

keywords: wearables, blind, visual impairments, texture recognition, cloth recognition

PDF | doi | Citation • HandSight • Cloth Recognition

Investigating Microinteractions for People With Visual Impairments and the Potential Role of on-Body Interaction

Uran Oh, Lee Stearns, Alisha Pradhan, Jon E. Froehlich, Leah Findlater

Proceedings of ASSETS 2017 | Acceptance Rate: 26.2% (33 / 126)

keywords: wearables, visual impairments, mobile, on-body interaction, microinteraction

PDF | doi | Citation • HandSight • On-Body Interaction • TouchCam

Augmented Reality Magnification for Low Vision Users with the Microsoft Hololens and a Finger-Worn Camera

Lee Stearns, Victor De Souza, Jessica Yin, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

keywords: wearables, visual impairments, assistive technology, augmented reality, reading printed text, magnification

PDF | doi | Citation • HandSight

A Pilot Deployment of an Online Tool for Large-Scale Virtual Auditing of Urban Accessibility

Manaswi Saha, Kotaro Hara, Soheil Behnezhad, Anthony Li, Mikey Saugstad, Teja Maddali, Sage Chen, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

keywords: crowdsourcing, gis, mobility impairments, urban accessibility

PDF | doi | Citation • Project Sidewalk

Designing 3D-Printed Deformation Behaviors Using Spring-Based Structures: An Initial Investigation

Liang He, Huaishu Peng, Joshua Land, Mark Fuge, Jon E. Froehlich

Extended Abstract Proceedings of UIST 2017

keywords: mechanical springs, 3d printing, fabrication

PDF | doi | Citation • Ondulé

A Temporal Thermography System for Supporting Longitudinal Building Energy Audits

Matthew L Mauriello, Jamie H Gilkeson, Noa Chazan, Jon E. Froehlich

Extended Abstract Proceedings of Ubicomp 2017

keywords: thermography, sustainable hci, environmental sustainability, environmental hci, sustainability, information visualization, thermal cameras, environmental sensing, sensors, design, environment, sustainability

PDF | doi | Citation • Pervasive Thermography • Thermporal

Early Explorations of Deformable Interactive Designs with 3D-Printed Springs

Liang He, Joshua Land, Huaishu Peng, Mark Fuge, Jon E. Froehlich

Extended Abstract SCF 2017

keywords: fabricated objects

PDF | Citation

Differences in Crowdsourced vs. Lab-based Mobile and Desktop Input Performance Data

Leah Findlater, Joan Zhang, Jon E. Froehlich, Karyn Moffatt

Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)

keywords: crowdsourcing, mobile, human performance, input devices, touchscreens

PDF | doi | Citation

Live Physiological Sensing and Visualization Ecosystems: An Activity Theory Analysis

Tamara L. Clegg, Leyla Norooz, Seokbin Kang, Virginia Byrne, Monica Katzen, Angelisa Plane, Vanessa Oguamanam, Thomas Outing, Elizabeth Bonsignore, Jason Yip, Jon E. Froehlich

Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)

keywords: scientific inquiry, sensor-based learning, wearables

PDF | doi | Citation • BodyVis

Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study

Matthew L Mauriello, Manaswi Saha, Erica Brown, Jon E. Froehlich

Proceedings of CHI 2017 | Acceptance Rate: 25.0% (606 / 2424)

keywords: formative inquiry, sustainable hci, urban informatics, environmental sustainability, environmental hci, sustainability

PDF | doi | Citation | Talk • Pervasive Thermography

Comparing Touchscreen and Mouse Input Performance by People With and Without Upper Body Motor Impairments

Leah Findlater, Karyn Moffatt, Jon E. Froehlich, Meethu Malu, Joan Zhang

Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)

keywords: accessibility, touchscreen accessibility, motor impairments, human performance, input devices, touchscreens, mouse

PDF | doi | Citation • Touchscreen Accessibility

MakerWear: A Tangible Approach to Interactive Wearable Creation for Children

Majeed Kazemitabaar, Jason McPeak, Alex Jiao, Liang He, Thomas Outing, Jon E. Froehlich

Proceedings of CHI 2017 | Best Paper Award

keywords: wearables, children, making, tangible interaction

PDF | doi | Citation • MakerWear

SqueezaPulse: Adding Interactive Input to Fabricated Objects Using Corrugated Tubes and Air Pulses

Liang He, Gierad Laput, Eric Brockmeyer, Jon E. Froehlich

Proceedings of TEI'17

keywords: fabricated objects, acoustic sensing, squeeze interactions, corrugated acoustics

PDF | Citation • SqueezaPulse

Localization of Skin Features on the Hand and Wrist From Small Image Patches

Lee Stearns, Uran Oh, Bridget Cheng, Leah Findlater, David Ross, Rama Chellappa, Jon E. Froehlich

Proceedings of ICPR 2016

keywords: handsight, computer vision, machine learning, on-body interaction, skin texture classification, biometrics, skin-based localization

PDF | Citation • HandSight • On-Body Interaction

Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras

Lee Stearns, Ruofei Du, Uran Oh, Catherine Jou, Leah Findlater, David Ross, Jon E. Froehlich

ACM Transactions on Accessible Computing (TACCESS) 2016

keywords: wearables, handsight, accessibility, visual impairments, real-time ocr, blind reading

PDF | doi | Citation • HandSight • Haptic Hand Guidance

New Horizons for the IoT in Everyday Life: Proactive, Shared, Sustainable

Joel Fischer, James A. Colley, Ewa Luger, Michael Golembewski, Enrico Costanza, Sarvapali D. Ramchurn, Stephen Viller, Ian Oakley, Jon E. Froehlich

Extended Abstract Proceedings of UbiComp 2016

keywords: iot, internet of things, sharing economy, automation

PDF | doi | Citation

“That's Your Heart!”: Live Physiological Sensing & Visualization Tools for Life-Relevant & Collaborative STEM Learning

Leyla Norooz, Tamara L. Clegg, Seokbin Kang, Angelisa Plane, Vanessa Oguamanam, Jon E. Froehlich

Proceedings of ICLS 2016

keywords: sharedphys, bodyvis, physiological sensing, large-screen displays, mixed-reality, scientific inquiry, collaborative learning, stem, wearables

PDF | doi | Citation • BodyVis • SharedPhys

SharedPhys: Live Physiological Sensing, Whole-Body Interaction, and Large-Screen Visualizations to Support Shared Inquiry Experiences

Seokbin Kang, Leyla Norooz, Vanessa Oguamanam, Angelisa Plane, Tamara L. Clegg, Jon E. Froehlich

Proceedings of IDC 2016

keywords: sharedphys, bodyvis, physiological sensing, large-screen displays, mixed-reality, scientific inquiry, collaborative learning, stem, wearables

PDF | doi | Citation • SharedPhys • BodyVis

The Future Role of Thermography in Human-Building Interaction

Matthew L Mauriello, Matthew Dahlhausen, Erica Brown, Manaswi Saha, Jon E. Froehlich

CHI 2016 Workshop: Future of Human-Building Interaction

keywords: thermography, human-building interaction, thermal cameras

PDF | Citation • Pervasive Thermography

Evaluating Angular Accuracy of Wrist-based Haptic Directional Guidance for Hand Movement

Jonggi Hong, Lee Stearns, Tony Cheng, Jon E. Froehlich, David Ross, Leah Findlater

Proceedings of GI 2016 | Acceptance Rate: 39.4% (13 / 33)

keywords: wearables, haptics, non-visual directional guidance, handsight

PDF | doi | Citation • HandSight • Haptic Hand Guidance

ReWear: Early Explorations of a Modular Wearable Construction Kit for Young Children

Majeed Kazemitabaar, Liang He, Katie Wang, Chloe Aloimonos, Tony Cheng, Jon E. Froehlich

Extended Abstracts of CHI 2016 | Best Paper Award

keywords: wearables, e-textiles, construction kits, electronic textiles, children, making

PDF | doi | Citation • MakerWear • ReWear

The Design of Assistive Location-based Technologies for People with Ambulatory Disabilities: A Formative Study

Kotaro Hara, Christine Chan, Jon E. Froehlich

Proceedings of CHI 2016 | Acceptance Rate: 25.0% (600 / 2400)

keywords: accessibility, mobility impairments, formative study, gis, navigation, trip planning

PDF | doi | Citation • Accessibility-Infused Maps • Project Sidewalk

Supporting Everyday Activities for Persons with Visual Impairments Through Computer Vision-Augmented Touch

Leah Findlater, Lee Stearns, Ruofei Du, Uran Oh, David Ross, Rama Chellappa, Jon E. Froehlich

Poster Proceedings of ASSETS 2015

keywords: computer vision, blind, visual impairments, finger camera, touch vision

PDF | doi | Citation • HandSight

Characterizing and Visualizing Physical World Accessibility at Scale Using Crowdsourcing, Computer Vision, and Machine Learning

Kotaro Hara, Jon E. Froehlich

SIGACCESS Newsletter '15

keywords: crowdsourcing accessibility, computer vision, google street view, amazon mechanical turk, personalized routing, accessibility map visualizations

PDF | doi | Citation • Project Sidewalk

MakerShoe: Towards an E-Textile Construction Kit to Support Creativity, Playful Making, and Self-Expression

Majeed Kazemitabaar, Leyla Norooz, Mona Leigh Guha, Jon E. Froehlich

Extended Abstracts of IDC 2015

keywords: wearables, e-textiles, construction kits, electronic textiles, children, making

PDF | doi | Citation • MakerWear

Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions

Matthew L Mauriello, Leyla Norooz, Jon E. Froehlich

Proceedings of CHI 2015 | Honorable Mention

keywords: energy audits, thermography, robotics, formative inquiry, design probes, sustainable hci, human-robotic interaction

PDF | Citation • Pervasive Thermography

AtmoSPHERE: Representing Space and Movement Using Sand Traces in an Interactive Zen Garden

Ruofei Du, Kent Wills, Max Potasznik, Jon E. Froehlich

CHI '15 Extended Abstracts

keywords: calm technology, tangible interactive art, xy servo table, sand drawings, zen gardens, physical computing

PDF | Citation • Interactive Sand Table

"I Like This Shirt": Exploring the Translation of Social Mechanisms in the Virtual World into Physical Experiences

Ladan Najafizadeh, Seokbin Kang, Jon E. Froehlich

CHI '15 Extended Abstracts

keywords: wearables, e-textiles, tangible social interaction, social fabric, social objects

PDF | Citation • I Like This Shirt

BodyVis: A New Approach to Body Learning Through Wearable Sensing and Visualization

Leyla Norooz, Matthew L Mauriello, Anita Jorgensen, Brenna McNally, Jon E. Froehlich

Extended Abstract Proceedings of CHI 2015 | Honorable Mention

keywords: physiological sensing, wearables, interactive body learning, tangible interactive computing

PDF | doi | Citation | Talk • BodyVis

Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing

Dhruv Jain, Leah Findlater, Jamie H Gilkeson, Benjamin Holland, Ramani Duraiswami, Dmitry Zotkin, Christian Vogler, Jon E. Froehlich

Proceedings of CHI 2015

keywords: wearables, accessibility, deaf, hard of hearing, head-mounted display, wearable, sound visualization, conversation support

PDF | doi | Citation • GlassEar

Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View: An Extended Analysis

Kotaro Hara, Shiri Azenkot, Megan Campbell, Cynthia Bennett, Sean Pannella, Robert Moore, Kelly Minckler, Rochelle Ng, Jon E. Froehlich

TACCESS 2015

keywords: accessibility, crowdsourcing accessibility, google street view, low-vision, public transport, bus stop auditing, crowdsourcing, blind users, accessible bus stops, remote data collection

PDF | doi | Citation • Crowdsourcing Bus Stop Landmarks

Gamifying Green: Gamification and Environmental Sustainability

Jon E. Froehlich

Recent News

Projects

Publications

Talks

Recent News

Links