Jon E. Froehlich
Associate Professor, CS
University of Washington
I am an Associate Professor in the Paul G. Allen School of Computer Science and Engineering at the University of Washington, a Sloan Fellow, and NSF CAREER awardee. My research is in Human-Computer Interaction (HCI) with a focus on high-value social domains such as accessibility, environmental sustainability, and STEM education. I have published over 50 peer-reviewed publications; eleven have been honored with awards, including Best Papers at ACM CHI and ASSETS and a 10-Year Impact Award at UbiComp. Since becoming a professor in 2012, I have taught ~250 undergraduate students and ~150 graduate students in HCI, Design, and UbiComp courses and served as a research advisor to nine graduate students, 50+ undergraduates, and 15 high school students. From 2012-2017, I was an Assistant Professor in Computer Science at the University of Maryland.
Recent News
We received an Amazon Catalyst award to fund Manaswi Saha's dissertation research on “Combining Computational and Visualization Techniques to Understand Urban Accessibility at Scale.” Congrats Manaswi!
Jun 11, 2019 | Jon
In recognition of her scholastic achievements, service, and research, Aileen Zeng was just awarded the highly competitive Motorola Solutions Foundation Engineering Scholarship from the Society of Women Engineers (SWE).
Congratulations Aileen!!
May 13, 2019 | Jon
Today, our video on PrototypAR entitled "PrototypAR: Learning through AR Design and Experimentation" just launched on the NSF video showcase. Please check it out and explore the site for more inspirational "Innovations in STEM Education" videos.
Apr 25, 2019 | Jon
Makeability Lab member Ather Sharif gives the Keynote Address at the 2019 Evergreen International Conference in Pennsylvania (link). The Evergreen Project develops an open source ILS (integrated library system) used by more than 2,000 libraries around the world. They recognized Ather for his work to improve web accessibility through his startup EvoXLabs.
Apr 18, 2019 | Jon
In recognition of our Best Paper Award at CHI'19 and to help highlight our new deployments in Seattle, WA and Newberg, OR, Project Sidewalk was featured on the College of Engineering webpage and UW News.
Publications
PrototypAR: Prototyping and Simulating Complex Systems with Paper Craft and Augmented Reality
Proceedings of IDC 2019
PDF | Citation | PrototypAR
Social Tensions with Head-Mounted Displays for Accessibility
Extended Abstract CHI'19 Workshop Proceedings of SHMD '19
PDF | Citation | AR Captioning | GlassEar
Exploring Sound Awareness in the Home for People who are Deaf or Hard of Hearing
Proceedings of CHI 2019 | Acceptance Rate: 23.7% (701 / 2960)
Anchored Audio Sampling: A Seamless Method for Exploring Children's Thoughts During Deployment Studies
Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)
Thermporal: An Easy-to-Deploy Temporal Thermographic Sensor System to Support Residential Energy Audits
Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)
Project Sidewalk: A Web-based Crowdsourcing Tool for Collecting Sidewalk Accessibility Data at Scale
Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)
Grand challenges in accessible maps
Interactions
PDF | doi | Citation | Project Sidewalk | Accessibility-Infused Maps
Design of an Augmented Reality Magnification Aid for Low Vision Users
Proceedings of ASSETS 2018
A Feasibility Study of Using Google Street View and Computer Vision to Track the Evolution of Urban Accessibility
Extended Abstract Proceedings of ASSETS 2018
PDF | Citation | Project Sidewalk | Urban Accessibility Evolution
Applying Transfer Learning to Recognize Clothing Patterns Using a Finger-Mounted Camera
Extended Abstract Proceedings of ASSETS 2018 | Acceptance Rate: 58.3% (42 / 72)
Interactively Modeling and Visualizing Neighborhood Accessibility at Scale: An Initial Study of Washington DC
Extended Abstract Proceedings of ASSETS 2018
PDF | Citation | Project Sidewalk | AccessVis | Accessibility-Infused Maps
Towards Accessible Conversations in a Mobile Context for People who are Deaf and Hard of Hearing
Proceedings of ASSETS 2018 | Acceptance Rate: 25.9% (28 / 108)
A Large-Scale Analysis of YouTube Videos Depicting Everyday Thermal Camera Use
Proceedings of MobileHCI2018
Physiological Investigations with Live Physiological Sensing and Visualization Tools
Extended Abstract Symposium Proceedings of ICLS2018
PDF | doi | Citation | BodyVis | SharedPhys
Scaffolding Authentic Wearable-Based Scientific Inquiry for Early Elementary Learners
Proceedings of ICLS2018
PDF | Talk | Citation | BodyVis | SharedPhys
Exploring Augmented Reality Approaches to Real-Time Captioning: A Preliminary Autoethnographic Study
Extended Abstract Proceedings of DIS2018
SIG: Making Maps Accessible and Putting Accessibility in Maps
Extended Abstract Proceedings of CHI 2018
PDF | doi | Citation | Project Sidewalk | Accessibility-Infused Maps
Prototyping and Simulating Complex Systems with Paper Craft and Augmented Reality: An Initial Investigation
Extended Abstract Proceedings of TEI2018
PDF | doi | Citation | PrototypAR
TouchCam: Realtime Recognition of Location-Specific On-Body Gestures to Support Users with Visual Impairments
ACM IMWUT December 2017
PDF | Citation | HandSight | TouchCam | On-Body Interaction
Recognizing Clothing Colors and Visual Textures Using a Finger-Mounted Camera: An Initial Investigation
Extended Abstract Proceedings of ASSETS 2017
TacTILE: A Preliminary Toolchain for Creating Accessible Graphics with 3D-Printed Overlays and Auditory Annotations
Extended Abstract Proceedings of ASSETS 2017
Evaluating Wrist-Based Haptic Feedback for Non-Visual Target Finding and Path Tracing on a 2D Surface
Proceedings of ASSETS 2017 | Acceptance Rate: 26.2% (33 / 126)
PDF | doi | Citation | Touchscreen Accessibility | HandSight | Haptic Hand Guidance
A Pilot Deployment of an Online Tool for Large-Scale Virtual Auditing of Urban Accessibility
Extended Abstract Proceedings of ASSETS 2017
A Temporal Thermography System for Supporting Longitudinal Building Energy Audits
Extended Abstract Proceedings of Ubicomp 2017
Comparing Touchscreen and Mouse Input Performance by People With and Without Upper Body Motor Impairments
Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)
Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study
Proceedings of CHI 2017 | Acceptance Rate: 25.0% (606 / 2424)
SqueezaPulse: Adding Interactive Input to Fabricated Objects Using Corrugated Tubes and Air Pulses
Proceedings of TEI'17
PDF | Citation | SqueezaPulse
Localization of Skin Features on the Hand and Wrist From Small Image Patches
Proceedings of ICPR 2016
Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras
ACM Transactions on Accessible Computing (TACCESS) 2016
“That's Your Heart!”: Live Physiological Sensing & Visualization Tools for Life-Relevant & Collaborative STEM Learning
Proceedings of ICLS 2016
PDF | doi | Citation | BodyVis | SharedPhys
SharedPhys: Live Physiological Sensing, Whole-Body Interaction, and Large-Screen Visualizations to Support Shared Inquiry Experiences
Proceedings of IDC 2016
PDF | Citation | BodyVis | SharedPhys
The Future Role of Thermography in Human-Building Interaction
CHI 2016 Workshop: Future of Human-Building Interaction
Evaluating Angular Accuracy of Wrist-based Haptic Directional Guidance for Hand Movement
Proceedings of GI 2016 | Acceptance Rate: 39.4% (13 / 33)
The Design of Assistive Location-based Technologies for People with Ambulatory Disabilities: A Formative Study
Proceedings of CHI 2016 | Acceptance Rate: 25.0% (600 / 2400)
PDF | doi | Citation | Accessibility-Infused Maps | Project Sidewalk
Characterizing and Visualizing Physical World Accessibility at Scale Using Crowdsourcing, Computer Vision, and Machine Learning
SIGACCESS Newsletter '15
Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions
Proceedings of CHI 2015
"I Like This Shirt": Exploring the Translation of Social Mechanisms in the Virtual World into Physical Experiences
CHI '15 Extended Abstracts
AtmoSPHERE: Representing Space and Movement Using Sand Traces in an Interactive Zen Garden
CHI '15 Extended Abstracts
Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View: An Extended Analysis
ACM Transactions on Accessible Computing (TACCESS) 2015
Tohme: Detecting Curb Ramps in Google Street View Using Crowdsourcing, Computer Vision, and Machine Learning
Proceedings of UIST 2014
PDF | Citation | Project Sidewalk | Tohme
Towards Automated Thermal Profiling of Buildings at Scale Using Unmanned Aerial Vehicles and 3D-Reconstruction
Poster Proceedings of UbiComp 2014
Social Fabric Fitness: The Design and Evaluation of Wearable E-Textile Displays to Support Group Running
Proceedings of CHI 2014
An Initial Study of Automatic Curb Ramp Detection with Crowdsourced Verification using Google Street View Images
Poster Proceedings of HCOMP 2013
PDF | Citation | Project Sidewalk | Tohme
Surveying the Accessibility of Touchscreen Games for Persons with Motor Impairments: A Preliminary Analysis
Poster Proceedings of ASSETS 2013
Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View
Proceedings of ASSETS 2013
Exploring Early Solutions for Automatically Identifying Inaccessible Sidewalks in the Physical World using Google Street View
HCIC2013 Workshop
PDF | Citation | Project Sidewalk | Tohme
Age-Related Differences in Performance with Touchscreens Compared to Traditional Mouse Input
Proceedings of CHI 2013
Combining Crowdsourcing and Google Street View to Identify Street-level Accessibility Problems
Proceedings of CHI 2013
Bear-With-Me: An Embodied Prototype to Explore Tangible Two-Way Exchanges of Emotional Language
CHI '13 Extended Abstracts
PDF | Citation | Bear-With-Me
Individuals Among Commuters: Building Personalised Transport Information Services from Fare Collection Systems
Pervasive and Mobile Computing (PMC) 2012
A feasibility study of crowdsourcing and google street view to determine sidewalk accessibility
Poster Proceedings of ASSETS 2012
The Design and Evaluation of Prototype Eco-Feedback Displays for Fixture-Level Water Usage Data
Proceedings of CHI 2012
PDF | Citation | HydroSense
A Longitudinal Study of Pressure Sensing to Infer Real-World Water Usage Events in the Home
Proceedings of Pervasive 2011
PDF | Citation | HydroSense
Mining Public Transport Usage for Personalised Intelligent Transport Systems
Proceedings of ICDM 2010
WATTr: a method for self-powered wireless sensing of water activity in the home
Proceedings of UbiComp 2010
PDF | Citation | HydroSense
Disaggregated water sensing from a single, pressure-based sensor: An extended analysis of HydroSense using staged experiments
Pervasive and Mobile Computing (PMC) 2010
PDF | Citation | HydroSense
Where Does Your Water Go? HydroSense Knows.
Poster Proceedings of BECC 2009
PDF | Citation | HydroSense
HydroSense: infrastructure-mediated single-point sensing of whole-home water activity
Proceedings of Ubicomp 2009
PDF | Citation | HydroSense
Barrier pointing: using physical edges to assist target acquisition on mobile device touch screens
Proceedings of ASSETS 2007
Talks
Oct. 16, 2018 | CSE510 Advanced Topics in HCI Guest Lecture
University of Washington, Seattle
Oct. 9, 2018 | HCDE539: Physical Computing and Prototyping Guest Lecture
University of Washington, Seattle
PDF | PPTX | BodyVis | Social Fabric Fitness | MakerWear | I Like This Shirt
Oct. 9, 2018 | Change Seminar
University of Washington, Seattle
Nov. 7, 2017 | HCDE539: Physical Computing and Prototyping Guest Lecture
University of Washington, Seattle
PDF | PPTX | BodyVis | Social Fabric Fitness | MakerWear
Oct. 13, 2017 | DUB Retreat
University of Washington, Seattle
PDF | PPTX | BodyVis | Project Sidewalk | MakerWear | Ondulé
June 7, 2017 | UMD CS Staff Talk
University of Maryland, College Park
PDF | PPTX | BodyVis | HandSight | Project Sidewalk | MakerWear
April 13, 2017 | HCDE Invited Talk
University of Washington, Seattle
PDF | PPTX | BodyVis | HandSight | Project Sidewalk | MakerWear
April 11, 2017 | UW CSE Colloquium
University of Washington, Seattle
PDF | PPTX | BodyVis | HandSight | Project Sidewalk | MakerWear
April 6, 2017 | Lecture Series at the Laboratory for Telecommunication Sciences
LTS Auditorium, College Park, MD
PDF | BodyVis | HandSight | Project Sidewalk | Pervasive Thermography | MakerWear
April 4, 2017 | STEAM Salon Lecture Series
University of Maryland, College Park
Aug. 10, 2016 | Under Armour Lighthouse Partner Meeting
College Park, Maryland
May 26, 2016 | 33rd Annual HCIL Symposium
College Park, Maryland
May 12, 2016 | CS Corporate Affiliates Day
College Park, Maryland
May 28, 2015 | 32nd Annual HCIL Symposium
College Park, Maryland
March 24, 2015 | Keynote Talk at the Symposium and Hackathon in Social Media and Interaction
Emmanuel College, Cambridge University
Oct. 29, 2014 | Human-Computer Interaction Institute (HCII) Seminar Series, Carnegie Mellon University
Pittsburgh, Pennsylvania
PDF | PPTX | SlideShare
Oct. 22, 2014 | Science and Technology Society: College Park Scholars
College Park, Maryland
PDF | PPTX | SlideShare
Oct. 16, 2014 | National Academy of Sciences: D.C. Art Science Evening Rendezvous (DASER)
Washington DC
PDF | PPTX | SlideShare
May 29, 2014 | 31st Annual HCIL Symposium
College Park, Maryland
PDF | PPTX | SlideShare
April 21, 2014 | Maker Movement in Health
Indiana University (via Skype)
March 27, 2014 | Science and Technology Society: College Park Scholars
College Park, Maryland
March 24, 2014 | Talk to CS Department External Review Committee
College Park, Maryland
Feb. 12, 2014 | Human Factors and Applied Cognition Seminar Series, George Mason University
Fairfax, Virginia
Dec. 10, 2013 | Segal Design Institute Seminar Series, Northwestern University
Evanston, Illionois
Nov. 8, 2013 | Enabled by Design-athon
Washington DC
Oct. 4, 2013 | Undergraduate Research Friday Afternoon Research Talk
College Park, MD
Sept. 12, 2013 | HCIL Brown Bag Lunch Speaker Series
College Park, MD
July 30, 2013 | Digital Societies and Social Technologies Summer Institute
College Park, MD
May 22, 2013 | 30th Annual HCIL Symposium
College Park, Maryland
PDF | PPTX | SlideShare
Dec. 5, 2012 | Spatio-temporal Data Mining for a Better Understanding of Human Mobility. The Bicycle Sharing System (BSS) Case Study
Paris, France
Nov. 29, 2012 | University of Colorado: Joint Colloquium between Computer Science and the Environmental Design Program
Boulder, Colorado
Nov. 13, 2012 | Behavior, Energy, and Climate Change 2012
Sacramento, California
PDF | PPTX | SlideShare
July 23, 2012 | SESYNC Workshop on Visualization Technologies to Support Research on Human-Environment Interactions
Annapolis, Maryland
July 3, 2012 | The Center for Language and Speech Processing, Johns Hopkins University
Baltimore, Maryland
PDF | PPTX | HydroSense
June 5, 2012 | University of Maryland, Baltimore County (UMBC)
Baltimore, Maryland
PDF | PPTX | HydroSense
May 22, 2012 | 29th Annual HCIL Symposium
College Park, Maryland
May 9, 2012 | 30th international conference on Human factors in computing systems (CHI'12)
Austin, Texas
PDF | PPTX | SlideShare | HydroSense
April 21, 2012 | 22nd Annual High School Programming Contest at the University of Maryland
College Park, Maryland
Feb. 17, 2012 | Virginia Tech, North Capital Region
Falls Church, Virginia
Sept. 7, 2011 | University of Washington Computer Science Doctoral Defense
Seattle, Washington
June 13, 2011 | 9th International Conference on Pervasive computing (Pervasive'11)
San Francisco, California
PDF | PPTX | HydroSense
May 24, 2011 | Roosevelt High School
Atlanta, Georgia
April 24, 2011 | Microsoft Research
Atlanta, Georgia
April 13, 2011 | School of Interactive Computing, Georgia Institute of Technology
Atlanta, Georgia
April 6, 2011 | Department of Computer Science, Columbia University
New York City, New York
April 4, 2011 | Department of Computer Science, University of Maryland
College Park, Maryland
March 28, 2011 | Department of Computer Science, University of Iowa
Iowa City, Iowa
March 21, 2011 | Department of Industrial Operations and Engineering, University of Michigan
Ann Arbor, Michigan
March 14, 2011 | Department of Computer Science, University of Rochester
Rochester, New York
March 11, 2011 | Department of Computer Science, Rochester Institute of Technology
Rochester, New York
Feb. 22, 2011 | Department of Computer Science, University of Wisconsin
Madison, Wisconsin
Feb. 16, 2011 | School of Information, University of Michigan
Ann Arbor, Michigan
Feb. 14, 2011 | Department of Electrical Engineering and Computer Science, University of Michigan
Ann Arbor, Michigan
Feb. 9, 2011 | School of Electrical Engineering and Computer Science, Oregon State University
Corvallis, Oregon
Feb. 3, 2011 | School of Information and Library Sciences, University of North Carolina
Chapel Hill, North Carolina
Jan. 27, 2011 | Design Computing Colloquium, Department of Architecture, University of Washington
Seattle, Washington
Jan. 26, 2011 | School of Interactive Art and Technology, Simon Fraser University
Surrey, British Columbia, Canada
Nov. 16, 2010 | Behavior, Energy, and Climate Change 2010
Sacramento, California
PDF | PPTX | SlideShare
Nov. 3, 2010 | Dorkbot Seattle, Jigsaw Renaissance
Seattle, Washington
PDF | PPTX | HydroSense
Nov. 2, 2010 | Research Methods in Informatics, INFO470, University of Washington
Seattle, Washington
Oct. 27, 2010 | UW CSE Affiliates 2010
Seattle, Washington
Aug. 20, 2010 | Ritsumeikan Computers and Society, UW International Specialized Programs
Seattle, Washington
July 19, 2010 | CS 4 HS Washington, Exploring Computer Science for Teachers of High School Math and Science
Seattle, Washington
July 19, 2010 | Summer Academy for Advancing Deaf and Hard of Hearing in Computing
Seattle, Washington
May 24, 2010 | Mobile Health 2010 at Stanford University
Palo Alto, California
PDF | PPTX | SlideShare
May 21, 2010 | UW Honors 263 D: A Brave New World: The Scientific, Economic and Social Impact of Computer Science
Seattle, Washington
April 14, 2010 | 28th international conference on Human factors in computing systems (CHI '10)
Atlanta, Georgia
PDF | PPTX | SlideShare
March 26, 2010 | The Institute for Sustainability's First Conference on Sustainability for the Pacific Northwest
Seattle, Washington
Feb. 17, 2010 | Urban Ecology Research Laboratory
Seattle, Washington
Feb. 15, 2010 | Stanford Precourt Energy Efficiency Center, ARPA-e Workshop
Palo Alto, California
Dec. 11, 2009 | Presentation for Dr. Sang Mook
Seattle, WA
Nov. 16, 2009 | Behavior, Energy, and Climate Change 2009
Washington, DC
Oct. 29, 2009 | UW CSE Affiliates 2009
Seattle, Washington
Oct. 8, 2009 | Walk21
New York City, New York
Oct. 3, 2009 | 11th international conference on Ubiquitous computing (Ubicomp '09)
Pasadena, California
PDF | PPTX | HydroSense
Oct. 3, 2009 | Doctoral Colloquium in the Adjunct Proceedings of UbiComp'09
Orlando, Florida
Aug. 5, 2009 | Shoda Psychology Lab
Seattle, Washington
July 16, 2009 | 21st international jont conference on Artifical intelligence (IJCAI'09)
Pasadena, California
April 22, 2009 | Technical Communications 505, Computer Mediated Communications, University of Washington
Seattle, Washington
April 7, 2009 | 27th international conference on Human factors in computing systems (CHI '09)
Boston, Massachusetts
Nov. 17, 2008 | Behavior, Energy and Climate Change 2008
Sacramento, California
Nov. 4, 2008 | 1st International Workshop on Urban, Community, and Social Applications of Networked Sensing Systems (UrbanSense '08) at SenSys'08
Raleigh, North Carolina
Oct. 23, 2008 | UW CSE Affiliates 2008
Seattle, Washington
June 17, 2008 | Telefonica Research Seminar
Barcelona, Spain
April 14, 2008 | Intelligent Vehicle Initiative (IVI), Technology Advanced Controls and Navigation Systems, SAE World Congress and Exhibition
Detroit, Michigan
Nov. 14, 2007 | Cornell SIGCHI Distinguished Lectureship Series
Ithaca, New York
Oct. 15, 2007 | 9th international ACM SIGACCESS conference on Computers and accessibility (Assets '07)
Tempe, Arizona
July 26, 2007 | Microsoft Research Intern Project Overview
Redmond, Washington
June 12, 2007 | 5th international conference on Mobile Systems, Applications and Services (MobiSys '07)
San Juan, Puerto Rico
June 11, 2007 | 1st International Workshop on MobiEval: System Evaluation for Mobile Platforms - Metrics, Methods, Tools and Platforms (MobiEval'07) at MobiSys'07
San Juan, Puerto Rico
Oct. 17, 2006 | User Interface Design, Prototyping, and Evaluation Part II, CSE490f, University of Washington
Seattle, Washington
Sept. 20, 2006 | 8th international conference on Ubiquitous Computing (UbiComp'06)
Orange County, California
Nov. 8, 2005 | International ACM SIGGROUP Conference on Supporting Group Work (GROUP '05)
Sanibel Island, Florida
May 27, 2004 | 26th International Conference on Software Engineering (ICSE '04)
Edinburgh, Scotland
