Towards Fine-Grained Sidewalk Accessibility Assessment with Deep Learning: Initial Benchmarks and an Open Dataset

Alex Liu, Kevin Wu, Minchu Kulkarni, Mikey Saugstad, Peyton Rapo, Jeremy Freiburger, Maryam Hosseini, Chu Li, Jon E. Froehlich

Extended Abstract ASSETS 2024 To Appear | Acceptance Rate: 66.7% (58 / 87)

keywords: computer vision, sidewalk assessment, sidewalk accessibility, vision transformers, obstacle detection

PDF | doi | Citation | Deep Learning for Sidewalk Assessment • Project Sidewalk

RAIS: Towards A Robotic Mapping and Assessment Tool for Indoor Accessibility Using Commodity Hardware

Xia Su, Daniel Campos Zamora, Jon E. Froehlich

Extended Abstract ASSETS 2024 To Appear | Acceptance Rate: 66.7% (58 / 87)

keywords: computer vision, indoor accessibility auditing, lidar, indoor map generation, accessible indoor maps

PDF | doi | Citation | RAIS: Robotic Accessibility Indoor Scanner

Towards Rapid Fabrication of Custom Tactile Surface Indicators for Indoor Navigation

Daniel Campos Zamora, Liang He, Jon E. Froehlich

Extended Abstract ASSETS 2024 To Appear | Acceptance Rate: 66.7% (58 / 87)

keywords: blind or low vision, tactile surface indicators, detectable warning surfaces, truncated domes, 3d printing

PDF | doi | Citation

Engaging with Children’s Artwork in Mixed Visual-Ability Families

Arnavi Chheda-Kothary, Jacob Wobbrock, Jon E. Froehlich

ASSETS To Appear | Acceptance Rate: 30.0% (67 / 223)

keywords: accessibility, AI for accessibility, chatgpt, blind or low vision, mixed-ability families, art, children's artwork

PDF | doi | Citation | Engaging with Children's Artwork in Mixed Visual-Ability Families

Towards AI-Powered AR for Enhancing Sports Playability for People with Low Vision: An Exploration of ARSports

Jaewook Lee, Yang Li, Dylan Bunarto, Eujean Lee, Jaden Wang, Adrian Rodriguez, Yuhang Zhao, Yapeng Tian, Jon E. Froehlich

IDEATExR To Appear

keywords: sports, low-vision, augmented reality, AI-assisted vision, visual augmentation

PDF | Citation

The Future of Urban Accessibility: The Role of AI

Jon E. Froehlich, Chu Li, Maryam Hosseini, Fabio Miranda, Andres Sevtsuk, Yochai Eisenberg

Extended Abstract ASSETS To Appear

keywords: urban informatics, urban accessibility, urban visualization

PDF | doi | Citation

SonifyAR: Context-Aware Sound Generation in Augmented Reality

Xia Su, Jon E. Froehlich, Eunyee Koh, Chang Xiao

UIST To Appear | Acceptance Rate: 24.0% (146 / 608)

keywords: augmented reality, context-aware ar, large language model (llm), sound generation, sound authoring

PDF | doi | Citation | SonifyAR: Context-Aware Sound Generation in Augmented Reality

MobiPrint: A Mobile 3D Printer for Environment-Scale Design and Fabrication

Daniel Campos Zamora, Liang He, Jon E. Froehlich

UIST 2024 To Appear | Acceptance Rate: 24.0% (146 / 608)

keywords: 3d printing, mobile fabrication, robotic 3d printing, environment-scale fabrication

PDF | doi | Citation | MobiPrint

Embodied AR Language Learning Through Everyday Object Interactions: A Demonstration of EARLL

Jaewook Lee, Sieun Kim, Minji Park, Catherine Rasgaitis, Jon E. Froehlich

Extended Abstract UIST 2024 To Appear

keywords: computer vision, augmented reality, embodied learning, ar glasses, context-aware ar, language learning

PDF | doi | Citation | EARLL: Embodied AR Language Learning

CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low Vision

Jaewook Lee, Andrew D. Tjahjadi, Jiho Kim, Junpu Yu, Minji Park, Jon E. Froehlich, Yapeng Tian, Yuhang Zhao

UIST 2024 To Appear | Acceptance Rate: 24.0% (146 / 608)

keywords: accessibility, augmented reality, AI-assisted vision, affordance segmentation, visual augmentation

PDF | doi | Citation | CookAR

AltGeoViz: Facilitating Accessible Geovisualization

Chu Li, Rock Pang, Ather Sharif, Arnavi Chheda-Kothary, Jeffrey Heer, Jon E. Froehlich

IEEE VIS 2024 To Appear | Acceptance Rate: 31.9% (66 / 207)

keywords: visualization, screen readers, accessible visualizations, accessible maps, dynamic geovisualization, accessible visual analytics

PDF | doi | Citation | AltGeoViz

A Demo of DIAM: Drone-based Indoor Accessibility Mapping

Xia Su, Ruiqi Chen, Richard Weiye Zhang, Jingwei Ma, Jon E. Froehlich

Extended Abstract UIST 2024 To Appear

keywords: computer vision, 3D reconstruction, indoor accessibility auditing, indoor map generation, accessible indoor maps

PDF | doi | Citation | DIAM: Drone-based Indoor Accessibility Mapping

SonifyAR: Context-Aware Sound Effect Generation in Augmented Reality

Xia Su, Eunyee Koh, Chang Xiao

Extended Abstract CHI 2024 | Acceptance Rate: 33.9% (391 / 1154)

keywords: augmented reality, design tools, llms, large language model (llm)

PDF | doi | Citation | SonifyAR: Context-Aware Sound Generation in Augmented Reality

“Caption It in an Accessible Way That Is Also Enjoyable”: Characterizing User-Driven Captioning Practices on TikTok

Emma McDonnell, Tessa Eagle, Pitch Sinlapanuntakul, Soo Hyun Moon, Kathryn Ringland, Jon E. Froehlich, Leah Findlater

CHI 2024 | Acceptance Rate: 26.3% (1060 / 4028)

keywords: social networks, video captioning, social media, video shorts, short video captioning

PDF | doi | Citation

LabelAId: Just-in-time AI Interventions for Improving Human Labeling Quality and Domain Knowledge in Crowdsourcing Systems

Chu Li, Zhihan Zhang, Mikey Saugstad, Esteban Safranchik, Minchu Kulkarni, Xiaoyu Huang, Shwetak Patel, Vikram Iyer, Tim Althoff, Jon E. Froehlich

CHI 2024 | Acceptance Rate: 26.3% (1060 / 4028)

keywords: machine learning, human+AI, community science, Programmatic Weak Supervision, snorkel

PDF | doi | Citation | LabelAId • Project Sidewalk

“I never realized sidewalks were a big deal”: A Case Study of a Community-Driven Sidewalk Audit Using Project Sidewalk

Chu Li, Katrina Ma, Mikey Saugstad, Kie Fujii, Molly Delany, Yochai Eisenberg, Delphine Labbé, Judy L. Shanley, Devon Snyder, Florian P. Thomas, Jon E. Froehlich

CHI 2024 | Acceptance Rate: 26.3% (1060 / 4028)

keywords: urban accessibility, sidewalk assessment, disability advocacy, service learning, community science, project sidewalk

PDF | doi | Citation | Project Sidewalk + Community Science • Project Sidewalk

RASSAR: Room Accessibility and Safety Scanning in Augmented Reality

Xia Su, Han Zhang, Kaiming Cheng, Jaewook Lee, Qiaochu (Steve) Liu, Wyatt Olson, Jon E. Froehlich

CHI 2024 | Acceptance Rate: 26.3% (1060 / 4028)

keywords: computer vision, augmented reality, 3D reconstruction, indoor accessibility auditing, lidar

PDF | doi | Citation | Code | RASSAR

GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality

Jaewook Lee, Jun Wang, Elizabeth Brown, Liam Gene Ping Chu, Sebastian S. Rodriguez, Jon E. Froehlich

CHI 2024 | Acceptance Rate: 26.3% (1060 / 4028)

keywords: augmented reality, llms, chatgpt, large language model, pronoun disambiguation, context-aware ar, natural human agents

PDF | doi | Citation | GazePointAR

MoiréWidgets: High-Precision, Passive Tangible Interfaces via Moiré Effect

Daniel Campos Zamora, Mustafa Doga Dogan, Alexa Siu, Eunyee Koh, Chang Xiao

CHI 2024 | Acceptance Rate: 26.3% (1060 / 4028)

keywords: computer vision, tangible interaction, fabrication, Moiré effect

PDF | doi | Citation

Playing on Hard Mode: Accessibility, Difficulty, and Joy in Video Game Adoption for Gamers with Disabilities

Jesse Martinez, Jon E. Froehlich, James Fogarty

CHI 2024 | Acceptance Rate: 26.3% (1060 / 4028)

keywords: video games, video game accessibility

PDF | doi | Citation

At the Intersection of Disability Justice, Pedestrian Safety, and Health

Yochai Eisenberg, Judy L. Shanley, Anna Zivarts, Brent Chamberlain, Keith Christensen, Minoo Abrishami, Jon E. Froehlich

Extended Abstract TRB 2024

keywords: accessible public transit, public transport, sustainable transportation, sidewalk assessment, urban visualization, sidewalk equity, ada transition plans, transit equity

PDF | Citation | Talk | Sidewalk Equity

Multiple-Stakeholder Perspectives on Accessibility Data and the Use of Socio-Technical Tools to Improve Sidewalk Accessibility

Delphine Labbé, Yochai Eisenberg, Devon Snyder, Judy L. Shanley, Joy Hammel, Jon E. Froehlich

Disabilities

keywords: urban informatics, urban accessibility, sidewalks, sidewalk assessment, sidewalk equity, ada transition plans

PDF | doi | Citation | Project Sidewalk • Multi-Stakeholder Interviews to Examine Urban Accessibility

Accessible Area Mapper for Inclusive and Sustainable Urban Mobility: A Preliminary Investigation of Airborne Point Clouds for Pathway Analysis

Hunsoo Song, Joshua Carpenter, Jon E. Froehlich, Jinha Jung

Workshop Proceedings of SuMob 2023

keywords: sidewalk assessment, lidar, 3d point clouds, pedestrian pathway inference, walkability, rollability

PDF | doi | Citation | Accessible Pathway Mapping using LiDAR

Towards Designing a Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation: A Demonstration of GazePointAR

Jaewook Lee, Jun Wang, Elizabeth Brown, Liam Gene Ping Chu, Sebastian S. Rodriguez, Jon E. Froehlich

Extended Abstract Proceedings of UIST 2023

keywords: augmented reality, multi-modal interaction, voice interaction, voice query

PDF | doi | Citation | GazePointAR

Towards Real-time Computer Vision and Augmented Reality to Support Low Vision Sports: A Demonstration of ARTennis

Jaewook Lee, Devesh Sarda, Eujean Lee, Amy S. Lee, Jun Wang, Adrian Rodriguez, Jon E. Froehlich

Extended Abstract Proceedings of UIST 2023

keywords: accessibility, head-mounted display, sports, augmented reality, ar glasses

PDF | doi | Citation | ARTennis

A Demonstration of RASSAR: Room Accessibility and Safety Scanning in Augmented Reality

Xia Su, Kaiming Cheng, Han Zhang, Jaewook Lee, Wyatt Olson, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2023 | Acceptance Rate: 51.9% (40 / 77)

keywords: accessibility, computer vision, indoor accessibility auditing, lidar, room reconstruction

PDF | doi | Citation | RASSAR

BusStopCV: A Real-time AI Assistant for Labeling Bus Stop Accessibility Features in Streetscape Imagery

Minchu Kulkarni, Chu Li, Jaye Ahn, Katrina Ma, Zhihan Zhang, Mikey Saugstad, Yochai Eisenberg, Valerie Novack, Brent Chamberlain, Jon E. Froehlich

Poster Proceedings of ASSETS 2023 | Acceptance Rate: 51.9% (40 / 77)

keywords: crowdsourcing accessibility, computer vision, accessible public transit, accessible urban navigation, accessible cities, bus stop auditing, accessible bus stops

PDF | doi | Citation | BusStopCV

A Large-Scale Mixed-Methods Analysis of Blind and Low-vision Research in ACM and IEEE

Yong-Joon Thoo, Maximiliano Jeanneret Medina, Jon E. Froehlich, Nicolas Ruffieux, Denis Lalanne

Proceedings of ASSETS 2023 | Acceptance Rate: 30.4% (55 / 181)

keywords: blind, low-vision, literature review, bibliometrics

PDF | doi | Citation | Accessibility Literature Survey

Off to the Park: A Geospatial Investigation of Adapted Ride-on Car Usage

Mia E. Hoffman, Katherine M. Steele, Jon E. Froehlich, Kyle N. Winfree, Heather Feldner

Disability and Rehabilitation: Assistive Technology

keywords: accessibility, wheelchair, urban accessibility, human mobility, ride-on car, child mobility

PDF | doi | Citation

Implementing a Community-Based Virtual Tool To Characterize Sidewalk Accessibility in a Northern New Jersey (NJ) Town

Kie Fujii, Katrina Ma, Chu Li, Mikey Saugstad, Lisa Stolarz, Michael Starr, Florian P. Thomas, Jon E. Froehlich

Extended Abstract ASCIP 2023 Annual Meeting

keywords: sidewalk assessment, sidewalk accessibility, sidewalk problems, sidewalk visualization, disability advocacy, civic tech, community organizing

PDF | Citation | Project Sidewalk

Implementing a Community-Based Virtual Tool To Characterize Sidewalk Accessibility in a Northern New Jersey (NJ) Town

Kie Fujii, Katrina Ma, Chu Li, Mikey Saugstad, Michael Starr, Lisa Stolarz, Florian P. Thomas, Jon E. Froehlich

Extended Abstract CMSC 2023 Annual Meeting

keywords: sidewalk assessment, sidewalk accessibility, sidewalk problems, inclusive cities

PDF | Citation | Poster | Project Sidewalk

“Easier or Harder, Depending on Who the Hearing Person Is”: Codesigning Videoconferencing Tools for Small Groups with Mixed Hearing Status

Emma McDonnell, Soo Hyun Moon, Lucy Jiang, Steven Goodman, Raja Kushalnagar, Jon E. Froehlich, Leah Findlater

Proceedings of CHI 2023 | Acceptance Rate: 27.6% (879 / 3182)

keywords: hard of hearing, real-time captioning, Deaf, video conferencing

PDF | doi | Citation

Kinergy: Creating 3D Printable Motion using Embedded Kinetic Energy

Liang He, Xia Su, Huaishu Peng, Jeffrey I. Lipton, Jon E. Froehlich

Proceedings of UIST 2022 | Acceptance Rate: 26.3% (98 / 372)

keywords: 3d printing, fabrication, 3d-printed deformation behaviors, kinetic fabrication, cad, 3d-printable motion

PDF | doi | Citation | Kinergy

sPrintr: Towards In-Situ Personal Fabrication using a Mobile 3D Printer

Daniel Campos Zamora, Liang He, Yueqian Zhang, Xuhai Xu, Jennifer Mankoff, Jon E. Froehlich

Extended Abstract Proceedings of SCF 2022

keywords: robotics, 3d printing, fabrication, mobile fabrication

PDF | doi | Citation | sPrintr

Scaling Crowd+AI Sidewalk Accessibility Assessments: Initial Experiments Examining Label Quality and Cross-city Training on Performance

Michael Duan, Sho Kiami, Logan Milandin, Johnson Kuang, Mikey Saugstad, Maryam Hosseini, Jon E. Froehlich

Poster Proceedings of ASSETS'22 | Acceptance Rate: 58.9% (43 / 73)

keywords: computer vision, urban informatics, deep learning, sidewalk assessment, sidewalk accessibility

PDF | doi | Citation | Project Sidewalk • Deep Learning for Sidewalk Assessment

A Pilot Study of Sidewalk Equity in Seattle Using Crowdsourced Sidewalk Assessment Data

Chu Li, Lisa Orii, Mikey Saugstad, Stephen J. Mooney, Yochai Eisenberg, Delphine Labbé, Joy Hammel, Jon E. Froehlich

UrbanAccess 2022

keywords: urban informatics, sidewalk equity, data science, spatial patterns

PDF | doi | Citation | Project Sidewalk • Sidewalk Equity

The Future of Urban Accessibility for People with Disabilities: Data Collection, Analytics, Policy, and Tools

Jon E. Froehlich, Yochai Eisenberg, Maryam Hosseini, Fabio Miranda, Marc Adams, Anat Caspi, Holger Dieterich, Heather Feldner, Aldo Gonzalez, Claudina de Gyves, Joy Hammel, Reuben Kirkham, Melanie Kneisel, Delphine Labbé, Stephen J. Mooney, Victor Pineda, Cláudia Pinhão, Ana Rodríguez, Manaswi Saha, Mikey Saugstad, Judy L. Shanley, Ather Sharif, Qing Shen, Claudio Silva, Maarten Sukel, Eric K. Tokuda, Sebastian Felix Zappe, Anna Zivarts

Extended Abstract ASSETS'22 Workshop on The Future of Urban Accessibility

keywords: accessible urban navigation, urban informatics, urban accessibility, sidewalks, sidewalk accessibility, urban visualization

PDF | doi | Citation

Towards Semi-automatic Detection and Localization of Indoor Accessibility Issues using Mobile Depth Scanning and Computer Vision

Xia Su, Kaiming Cheng, Han Zhang, Jaewook Lee, Yueqian Zhang, Jon E. Froehlich

UrbanAccess 2022

keywords: accessibility, computer vision, augmented reality, 3D reconstruction, indoor accessibility auditing

PDF | doi | Citation | RASSAR

Participatory Design of Crowd+AI Tools to Map, Analyze, and Visualize Sidewalk Accessibility

Yochai Eisenberg, Delphine Labbé, Sierra Berquist, Judy L. Shanley, Joy Hammel, Jon E. Froehlich

Extended Abstract Proceedings of TRANSED 2022

keywords: urban informatics, urban accessibility, sidewalks, sidewalk assessment, sidewalk accessibility, sidewalk visualization

PDF | Citation | Project Sidewalk

Designing Interactive Data-Driven Tools for Understanding Urban Accessibility at Scale

Manaswi Saha

UW CS PhD Dissertation

keywords: urban accessibility, sidewalks, sidewalk assessment, sidewalk accessibility, sidewalk problems, urban visualization, sidewalk visualization

PDF | doi | Citation | AccessVis • Accessibility-Infused Maps • Project Sidewalk

Sound Sensing and Feedback Techniques for Deaf and Hard of Hearing People

Dhruv Jain

UW CS PhD Dissertation

keywords: sound visualization, sound awareness, sound localization, sound classification, sound recognition, sound sensing

PDF | doi | Citation | AR Captioning • Personalizing Sound Recognition • ProtoSound • HoloSound • HomeSound • SoundWatch • GlassEar

Towards Global-Scale Crowd+AI Techniques to Map and Assess Sidewalks for People with Disabilities

Maryam Hosseini, Mikey Saugstad, Fabio Miranda, Andres Sevtsuk, Cláudio T. Silva, Jon E. Froehlich

CVPR2022 Workshop: Accessibility, Vision, and Autonomy (AVA)

keywords: accessible cities, urban informatics, urban accessibility, sidewalk assessment, sidewalk accessibility, sidewalk visualization

PDF | doi | Citation | Project Sidewalk • Deep Learning for Sidewalk Assessment

Fabricating Kinetic Objects with 3D Printable Spring-Based Mechanisms for Interactivity

Liang He

UW CS PhD Dissertation

keywords: 3d printing, 3d-printed deformation behaviors, kinetic fabrication, design tools

PDF | doi | Citation | Kinetic Fabrication • Ondulé • Kinergy

SoundWatch: deep learning for sound accessibility on smartwatches

Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Khoa Nguyen, Rachel Grossman-Kahn, Leah Findlater, Jon E. Froehlich

CACM

keywords: wearables, sound visualization, sound awareness, smartwatch, sound classification, sound recognition, sound sensing, AI for accessibility

PDF | doi | Citation | Code | SoundWatch

SIG: Towards More Personal Health Sensing

Junyi Zhu, Liang He, Jun Nishida, Hamid Ghaednia, Hsin-Liu Kao, Jon E. Froehlich, Edward Wang, Stefanie Mueller

Extended Abstract Proceedings of CHI 2022

keywords: health, sensing, activity sensing, making

PDF | doi | Citation

Visualizing Urban Accessibility: Investigating Multi-Stakeholder Perspectives through a Map-based Design Probe Study

Manaswi Saha, Siddhant Patil, Emily Cho, Evie Yu-Yen Cheng, Chris Horng, Devanshi Chauhan, Rachel Kangas, Richard McGovern, Anthony Li, Jeffrey Heer, Jon E. Froehlich

CHI | Acceptance Rate: 24.7% (637 / 2579)

keywords: design probes, urban accessibility, geo-visualization, sidewalk accessibility, urban visualization, sensemaking, sidewalk visualization

PDF | doi | Citation | Talk | AccessVis • Multi-Stakeholder Interviews to Examine Urban Accessibility • Accessibility-Infused Maps • Project Sidewalk

ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard-of-Hearing Users

Dhruv Jain, Khoa Nguyen, Steven Goodman, Rachel Grossman-Kahn, Hung Ngo, Aditya Kusupati, Ruofei Du, Alex Olwal, Leah Findlater, Jon E. Froehlich

Proceedings of CHI 2022 | Acceptance Rate: 404.9% (2579 / 637)

keywords: deaf, hard of hearing, sound classification, sound recognition, few-shot learning, sound sensing, Deaf

PDF | doi | Citation | ProtoSound

ModElec: A Design Tool for Prototyping Physical Computing Devices Using Conductive 3D Printing

Liang He, Jarrid Wittkopf, Ji Won Jun, Kris Erickson, Tico Ballagas

IMWUT

keywords: 3d printing, fabrication

PDF | doi | Citation | Code | ModElec

The Future of Global-Scale Spatial Data Collection and Analyses on Urban (in)Accessibility for People with Disabilities

Jon E. Froehlich, Fabio Miranda, Maryam Hosseini, Nicholas Bolten, Anat Caspi, Roberto M. Cesar Jr., Holger Dieterich, Yochai Eisenberg, Victor Pineda, Manaswi Saha, Mikey Saugstad, Andres Sevtsuk, Cláudio T. Silva, Eric K. Tokuda, Sebastian Felix Zappe

Extended Abstract Spatial Data Science Symposium 2021

keywords: accessibility, accessible urban navigation, wheelchair, urban informatics, urban accessibility, human mobility

PDF | Citation

Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group Captioning

Emma McDonnell, Ping Liu, Steven Goodman, Raja Kushalnagar, Jon E. Froehlich, Leah Findlater

CSCW Proceedings of PACM HCI | Honorable Mention

keywords: large-screen displays, design probes, mobile phones, real-time captioning, deaf and hard of hearing

PDF | doi | Citation | Small Group Captioning

Sidewalk Gallery: An Interactive, Filterable Image Gallery of Over 500,000 Sidewalk Accessibility Problems

Michael Duan, Aroosh Kumar, Mikey Saugstad, Aileen Zeng, Ilia Savin, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2021 | Acceptance Rate: 61.8% (55 / 89) | Best Artifact Runner-up Award

keywords: crowdsourcing accessibility, sidewalks, human mobility, sidewalk problems, image gallery, open data

PDF | doi | Citation | Project Sidewalk • Sidewalk Gallery

Experimental Crowd+AI Approaches to Track Accessibility Features in Sidewalk Intersections Over Time

Ather Sharif, Paari Gopal, Mikey Saugstad, Shiven Bhatt, Raymond Fok, Galen Weld, Kavi Dey, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2021 | Acceptance Rate: 61.8% (55 / 89)

keywords: accessibility, crowdsourcing accessibility, urban informatics, urban accessibility, tracking urban change

PDF | doi | Citation | Project Sidewalk • Urban Accessibility Evolution

A Preliminary Analysis of Android Educational Game Accessibility

Jesse Martinez, James Fogarty, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2021 | Acceptance Rate: 61.8% (55 / 89)

keywords: touchscreen accessibility, educational technology, motor disabilities, games

PDF | doi | Citation | Touchscreen Accessibility

A Taxonomy of Sounds in Virtual Reality

Dhruv Jain, Sasa Junuzovic, Swetha Machanavajhala, Meredith Ringel Morris, Eyal Ofek, John Porter, Mike Sinclair, Chris Yoon

Proceeedings of DIS 2021 | Acceptance Rate: 26.8% (153 / 571) | Best Paper Award

keywords: accessibility, sound awareness

PDF | doi | Citation

Pedagogical Strategies for Reflection in Project-based HCI Education with End Users

Wendy Roldan, Ziyue Li, Xin Gao, Sarah Kay Strickler, Allison Marie Hishikawa, Jon E. Froehlich, Jason Yip

Proceedings of DIS 2021 | Acceptance Rate: 26.8% (153 / 571) | Honorable Mention

keywords: design education, hci education, participatory design

PDF | doi | Citation

Toward User-Driven Sound Recognizer Personalization with People who are d/Deaf or Hard of Hearing

Steven Goodman, Ping Liu, Dhruv Jain, Emma McDonnell, Jon E. Froehlich, Leah Findlater

Proceedings of IMWUT 2021

keywords: deaf and hard of hearing, sound recognition, interactive machine learning, teachable machines, personalization

PDF | doi | Citation | SoundWatch • Personalizing Sound Recognition

What Do We Mean by “Accessibility Research”? A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019

Kelly Mack, Emma McDonnell, Dhruv Jain, Lucy Lu Wang, Jon E. Froehlich, Leah Findlater

Proceedings of CHI 2021 | Acceptance Rate: 26.3% (749 / 2844) | Honorable Mention

keywords: accessibility, assistive technology, disability rights, disability, literature review

PDF | doi | Citation | Code | Accessibility Literature Survey

HulaMove: Using Commodity IMU for Waist Interaction

Xuhai Xu, Jiahao Li, Tianyi Yuan, Liang He, Yunkang Yan, Xin Liu, Yuntao Wang, Yuanchun Shi, Jennifer Mankoff, Anind K. Dey

CHI 2021 | Acceptance Rate: 26.3% (749 / 2844)

keywords: on-device sensing, waist interaction

PDF | Citation

A bibliometric analysis of citation diversity in accessibility and HCI research

Lucy Lu Wang, Kelly Mack, Emma McDonnell, Dhruv Jain, Leah Findlater, Jon E. Froehlich

Extended Abstracts of CHI 2021 | Acceptance Rate: 39.0% (268 / 688)

keywords: accessibility, disability, bibliometrics, citation analysis

PDF | doi | Citation | Code | Talk | Accessibility Literature Survey

Examining Visual Semantic Understanding in Blind and Low-Vision Technology Users

Venkatesh Potluri, Tad Grindeland, Jon E. Froehlich, Jennifer Mankoff

Proceedings of CHI 2021 | Acceptance Rate: 26.3% (749 / 2844)

keywords: blind, blind making, design tools, desktop accessibility, touchscreen accessibility

PDF | doi | Citation

HoloSound: Combining Speech and Sound Identification for Deaf or Hard of Hearing Users on a Head-mounted Display

Greg Guo, Robin Yiru Yang, Johnson Kuang, Xue Bin, Dhruv Jain, Steven Goodman, Leah Findlater, Jon E. Froehlich

Poster Proceedings of ASSETS 2020

keywords: augmented reality, real-time captioning, sound awareness, deaf and hard of hearing, sound localization, sound classification

PDF | doi | Citation | Code | HoloSound

Navigating Graduate School with a Disability: A Trio-Ethnography

Dhruv Jain, Venkatesh Potluri, Ather Sharif

Proceedings of ASSETS 2020 | Acceptance Rate: 27.5% (46 / 167) | Best Paper Nominee

keywords: accessibility, educational technology

PDF | Citation

SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users

Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2020 | Acceptance Rate: 27.5% (46 / 167) | Best Artifact Award

keywords: wearables, haptics, sound visualization, sound awareness, deaf and hard of hearing, smartwatch

PDF | doi | Citation | SoundWatch

Urban Accessibility as a Socio-Political Problem: A Multi-Stakeholder Analysis

Manaswi Saha, Devanshi Chauhan, Siddhant Patil, Rachel Kangas, Jeffrey Heer, Jon E. Froehlich

CSCW

keywords: urban informatics, urban accessibility, sidewalk assessment, sidewalk accessibility, policy, civic tech, socio-political challenges, disability rights

PDF | doi | Citation | Talk | Project Sidewalk • Multi-Stakeholder Interviews to Examine Urban Accessibility

Designing, Controlling, and Fabricating In-Place Augmented Structures.

Liang He

Extended Abstract UIST 2020

keywords: fabrication

PDF | doi | Citation

Sidewalk Accessibility in the US and Mexico: Policies, Tools, and A Preliminary Case Study

Jon E. Froehlich, Mikey Saugstad, Edgar Martínez, Rebeca de Buen Kalman

Extended Abstract Workshop Proceedings of Civic Tech 2020

keywords: urban informatics, urban accessibility, Mexico, sidewalk assessment, sidewalk accessibility, disability rights

PDF | doi | Citation | Project Sidewalk

Towards Mapping and Assessing Sidewalk Accessibility Across Socio-cultural and Geographic Contexts

Jon E. Froehlich, Mikey Saugstad, Manaswi Saha, Matthew Johnson

Extended Abstract Data4Good

keywords: urban informatics, urban accessibility, sidewalks, Mexico, sidewalk assessment, sidewalk accessibility, policy, disability rights

PDF | doi | Citation | Project Sidewalk

Field Study of a Tactile Sound Awareness Device for Deaf and Hard of Hearing Users

Dhruv Jain, Brendon Chiu, Steven Goodman, Chris Schmandt, Leah Findlater, Jon E. Froehlich

Proceedings of ISWC 2020

keywords: wearables, haptics, accessibility, deaf, hard of hearing, sound awareness

PDF | doi | Citation | SoundWatch

Augmented Reality Systems and User Interaction Techniques for Stem Learning

Seokbin Kang

UMD CS PhD Dissertation

keywords: sharedphys, mixed-reality, collaborative learning, stem, augmented reality, prototyping

PDF | doi | Citation | PrototypAR • ARMath • SharedPhys

HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users

Dhruv Jain, Kelly Mack, Akli Amrous, Steven Goodman, Matt Wright, Leah Findlater, Jon E. Froehlich

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)

keywords: accessibility, deaf, deaf and hard of hearing, smarthome

PDF | doi | Citation | HomeSound

Involving End-Users in HCI Education: A Case Study and Steps Forward

Wendy Roldan, Jon E. Froehlich, Jason Yip

Extended Abstract EduCHI 2020

keywords: design process, design education, hci education, participatory design

PDF | Citation

ARMath: Augmenting Everyday Life with Math Learning

Seokbin Kang, Ekta Shokeen, Virginia Byrne, Leyla Norooz, Elizabeth Bonsignore, Caro Williams-Pierce, Jon E. Froehlich

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)

keywords: educational technology, augmented reality, embodied learning, math, tangibles

PDF | doi | Citation | ARMath

Opportunities and Challenges in Involving Users in Project-Based HCI Education

Wendy Roldan, Xin Gao, Allison Marie Hishikawa, Tiffany Ku, Ziyue Li, Echo Zhang, Jon E. Froehlich, Jason Yip

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126) | Honorable Mention

keywords: design education, hci education, participatory design

PDF | doi | Citation

PneuFetch: Supporting Blind and Visually Impaired People to Fetch Nearby Objects via Light Haptic Cues

Liang He, Ruolin Wang, Xuhai Xu

Extended Abstract CHI 2020 | Acceptance Rate: 41.8% (323 / 772)

keywords: haptics, accessibility, blind, fabrication, haptic feedback

PDF | Citation | PneuFetch

Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-hearing Users Across Contexts

Steven Goodman, Susanne Kirchner, Rose Guttman, Dhruv Jain, Jon E. Froehlich, Leah Findlater

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)

keywords: sound visualization, sound awareness, deaf and hard of hearing, smartwatch

PDF | doi | Citation | SoundWatch

Organizing Family Support Services at ACM Conferences

Audrey Girouard, Jon E. Froehlich, Regan Mandryk, Mark Hancock

Communications of the ACM

keywords: family, inclusivity, conference organization

PDF | doi | Citation |

Interactive Computational Tools for Assessing and Understanding Urban Accessibility At Scale

Manaswi Saha

SIGACCESS Newsletter 2020

keywords: accessibility, crowdsourcing accessibility, accessible cities, physical world accessibility, street-level accessibility, accessibility map visualizations, crowd-powered streetview accessibility, urban accessibility

PDF | Citation | AccessVis • Accessibility-Infused Maps • Project Sidewalk

Deep Learning for Automatically Detecting Sidewalk Accessibility Problems Using Streetscape Imagery

Galen Weld, Esther Jang, Anthony Li, Aileen Zeng, Kurtis Heimerl, Jon E. Froehlich

Proceedings of ASSETS 2019 | Acceptance Rate: 25.9% (41 / 158) | Best Paper Award

keywords: mobility impairments, computer vision, urban informatics, deep learning, sidewalks, neural networks

PDF | doi | Citation | Code | Project Sidewalk • Deep Learning for Sidewalk Assessment

Autoethnography of a Hard of Hearing Traveler

Dhruv Jain, Audrey Desjardins, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2019 | Acceptance Rate: 25.9% (41 / 158) | Best Paper Nominee

keywords: accessibility, hard of hearing, longitudinal study, assistive technology, deaf and hard of hearing

PDF | doi | Citation | Deaf Travel Autoethnography

AI-Assisted UI Design for Blind and Low-Vision Creators

Venkatesh Potluri, Tad Grindeland, Jon E. Froehlich, Jennifer Mankoff

Extended Abstract ASSETS'19 Workshop: AI Fairness for People with Disabilities

keywords: blind, user-centered design, programming, design process

PDF | Citation

Ondulé: Designing and Controlling 3D Printable Springs

Liang He, Huaishu Peng, Michelle Lin, Ravi Konjeti, François Guimbretière, Jon E. Froehlich

Proceedings of UIST 2019 | Acceptance Rate: 24.4% (93 / 381)

keywords: 3d printing, fabrication, 3d-printed deformation behaviors

PDF | doi | Citation | Talk | Ondulé

A Multi-Modal Approach for Blind and Visually Impaired Developers to Edit Webpage Designs

Venkatesh Potluri, Liang He, Christine Chen, Jon E. Froehlich, Jennifer Mankoff

Extended Abstract ASSETS 2019 | Acceptance Rate: 58.8% (57 / 97)

keywords: accessibility, low-vision, blind users, accessible touchscreens

PDF | doi | Citation | UITalk

PrototypAR: Prototyping and Simulating Complex Systems with Paper Craft and Augmented Reality

Seokbin Kang, Leyla Norooz, Elizabeth Bonsignore, Virginia Byrne, Tamara L. Clegg, Jon E. Froehlich

Proceedings of IDC 2019

keywords: stem, construction kits, augmented reality, prototyping tool

PDF | doi | Citation | PrototypAR

Social Tensions with Head-Mounted Displays for Accessibility

Steven Goodman, Dhruv Jain, Jon E. Froehlich, Brock Craft, Leah Findlater

Extended Abstract CHI2019 Workshop Proceedings of SHMD

keywords: accessibility, head-mounted display, social perception

PDF | Citation | AR Captioning

Thermporal: An Easy-to-Deploy Temporal Thermographic Sensor System to Support Residential Energy Audits

Matthew L Mauriello, Brenna McNally, Jon E. Froehlich

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)

keywords: thermography, sensing, thermal cameras, field deployments

PDF | doi | Citation | Talk | Pervasive Thermography • Thermporal

Anchored Audio Sampling: A Seamless Method for Exploring Children's Thoughts During Deployment Studies

Alexis Hiniker, Jon E. Froehlich, Mingrui Zhang, Erin Beneteau

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960) | Best Paper Award

keywords: experience sampling method, children, context-aware experience sampling

PDF | doi | Citation | Code | Anchored Audio Sampling

Project Sidewalk: A Web-based Crowdsourcing Tool for Collecting Sidewalk Accessibility Data at Scale

Manaswi Saha, Mikey Saugstad, Teja Maddali, Aileen Zeng, Ryan Holland, Steven Bower, Aditya Dash, Sage Chen, Anthony Li, Kotaro Hara, Jon E. Froehlich

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960) | Best Paper Award

keywords: mobility impairments, gis, wheelchair, crowdsourcing, urban accessibility

PDF | doi | Citation | Code | Project Sidewalk

Exploring Sound Awareness in the Home for People who are Deaf or Hard of Hearing

Dhruv Jain, Angela Carey Lin, Marcus Amalachandran, Aileen Zeng, Jon E. Froehlich

Proceedings of CHI 2019 | Acceptance Rate: 23.7% (701 / 2960)

keywords: sound visualization, iot, sound awareness, deaf and hard of hearing, smarthome

PDF | doi | Citation | HomeSound

Deaf and Hard-of-hearing Individuals’ Preferences for Wearable and Mobile Sound Awareness Technologies

Leah Findlater, Bonnie Chinh, Dhruv Jain, Jon E. Froehlich, Raja Kushalnagar, Angela Carey Lin

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)

keywords: head-mounted display, sound visualization, sound awareness, deaf and hard of hearing, smartwatch, smartphone

PDF | doi | Citation

Grand challenges in accessible maps

Jon E. Froehlich, Anke Brock, Anat Caspi, Joao Guerreiro, Kotaro Hara, Reuben Kirkham, Johannes Schoning, Benjamin Tannert

Interactions

keywords: accessibility, mobility impairments, gis, accessible urban navigation, accessible cities, visual impairments, accessibility map visualizations

PDF | doi | Citation | Project Sidewalk • Accessibility-Infused Maps

Towards Accessible Conversations in a Mobile Context for People who are Deaf and Hard of Hearing

Dhruv Jain, Rachel Franz, Leah Findlater, Jackson Cannon, Raja Kushalnagar, Jon E. Froehlich

Proceedings of ASSETS 2018 | Acceptance Rate: 25.9% (28 / 108)

keywords: augmented reality, real-time captioning, deaf and hard of hearing

PDF | doi | Citation | Talk | AR Captioning

A Feasibility Study of Using Google Street View and Computer Vision to Track the Evolution of Urban Accessibility

Ladan Najafizadeh, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2018

keywords: computer vision, google street view, urban informatics, urban data mining, urban accessibility

PDF | doi | Citation | Project Sidewalk • Urban Accessibility Evolution

Applying Transfer Learning to Recognize Clothing Patterns Using a Finger-Mounted Camera

Lee Stearns, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2018 | Acceptance Rate: 58.3% (42 / 72)

keywords: wearables, computer vision, visual impairments, pattern recognition, transfer learning

PDF | doi | Citation | HandSight • Cloth Recognition

Design of an Augmented Reality Magnification Aid for Low Vision Users

Lee Stearns, Leah Findlater, Jon E. Froehlich

Proceedings of ASSETS 2018

keywords: wearables, head-mounted display, low-vision, visual impairments, assistive technology, augmented reality

PDF | doi | Citation | Talk | HandSight • AR Magnification

Interactively Modeling and Visualizing Neighborhood Accessibility at Scale: An Initial Study of Washington DC

Anthony Li, Manaswi Saha, Anupam Gupta, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2018

keywords: urban informatics, information visualization, urban data mining, urban accessibility, geo-visualization, walkability index

PDF | doi | Citation | AccessVis • Accessibility-Infused Maps • Project Sidewalk

A Large-Scale Analysis of YouTube Videos Depicting Everyday Thermal Camera Use

Matthew L Mauriello, Brenna McNally, Cody Buntain, Sapna Bagalkotkar, Samuel Kushnir, Jon E. Froehlich

Proceedings of MobileHCI2018

keywords: thermography, sustainable hci, environmental sustainability, thermal cameras, youtube, user-generated content

PDF | doi | Citation | Talk | Pervasive Thermography

HandSight: A Touch-Based Wearable System to Increase Information Accessibility for People with Visual Impairments

Lee Stearns

UMD CS PhD Dissertation

keywords: accessibility, computer vision, physical accessibility, blind reading, accessible graphics

PDF | Citation | Talk | HandSight

Designing and Evaluating Next-Generation Thermographic Systems to Support Residential Energy Audits

Matthew L Mauriello

UMD CS PhD Dissertation

keywords: thermography, sustainable hci, environmental sustainability, thermal cameras

PDF | Citation | Talk | Pervasive Thermography

Scaffolding Authentic Wearable-­Based Scientific Inquiry for Early Elementary Learners

Virginia Byrne, Seokbin Kang, Leyla Norooz, Rafael Antonio Velez, Monica Katzen, Afe Addeh, Jon E. Froehlich, Tamara L. Clegg

Proceedings of ICLS2018

keywords: sharedphys, bodyvis, physiological sensing, large-screen displays, mixed-reality, scientific inquiry, collaborative learning, stem, wearables

PDF | Citation | Talk | BodyVis • SharedPhys

Physiological Investigations with Live Physiological Sensing and Visualization Tools

Tamara L. Clegg, Virginia Byrne, Leyla Norooz, Seokbin Kang, Jon E. Froehlich

Extended Abstract Symposium Proceedings of ICLS2018

keywords: sharedphys, bodyvis, physiological sensing, large-screen displays, mixed-reality, scientific inquiry, collaborative learning, stem, wearables

PDF | doi | Citation | BodyVis • SharedPhys

Exploring Augmented Reality Approaches to Real-Time Captioning: A Preliminary Autoethnographic Study

Dhruv Jain, Bonnie Chinh, Raja Kushalnagar, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of DIS2018

keywords: deaf, augmented reality, real-time captioning, sound awareness

PDF | doi | Citation | AR Captioning

SIG: Making Maps Accessible and Putting Accessibility in Maps

Anke Brock, Jon E. Froehlich, Joao Guerreiro, Benjamin Tannert, Anat Caspi, Johannes Schoning, Steve Landau

Extended Abstract Proceedings of CHI 2018

keywords: accessibility, crowdsourcing accessibility, accessible urban navigation, accessible cities, physical accessibility, touchscreen accessibility, accessible interfaces

PDF | doi | Citation | Project Sidewalk • Accessibility-Infused Maps

Prototyping and Simulating Complex Systems with Paper Craft and Augmented Reality: An Initial Investigation

Seokbin Kang, Leyla Norooz, Virginia Byrne, Tamara L. Clegg, Jon E. Froehlich

Extended Abstract Proceedings of TEI2018

keywords: children, augmented reality, prototyping, prototyping tool, design process

PDF | doi | Citation | PrototypAR

TouchCam: Realtime Recognition of Location-Specific On-Body Gestures to Support Users with Visual Impairments

Lee Stearns, Uran Oh, Leah Findlater, Jon E. Froehlich

ACM IMWUT December 2017

keywords: wearables, accessibility, computer vision, low-vision, blind users, on-body interaction, skin texture classification, gesture recognition

PDF | doi | Citation | On-Body Interaction • TouchCam • HandSight

Evaluating Wrist-Based Haptic Feedback for Non-Visual Target Finding and Path Tracing on a 2D Surface

Jonggi Hong, Alisha Pradhan, Jon E. Froehlich, Leah Findlater

Proceedings of ASSETS 2017 | Acceptance Rate: 26.2% (33 / 126)

keywords: wearables, haptics, accessibility, blind, blind users, haptic feedback, haptic wristband, directional guidance

PDF | doi | Citation | Touchscreen Accessibility • Haptic Hand Guidance • HandSight

Augmented Reality Magnification for Low Vision Users with the Microsoft Hololens and a Finger-Worn Camera

Lee Stearns, Victor De Souza, Jessica Yin, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

keywords: wearables, visual impairments, assistive technology, augmented reality, reading printed text, magnification

PDF | doi | Citation | HandSight

A Pilot Deployment of an Online Tool for Large-Scale Virtual Auditing of Urban Accessibility

Manaswi Saha, Kotaro Hara, Soheil Behnezhad, Anthony Li, Mikey Saugstad, Teja Maddali, Sage Chen, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

keywords: mobility impairments, gis, crowdsourcing, urban accessibility

PDF | doi | Citation | Project Sidewalk

TacTILE: A Preliminary Toolchain for Creating Accessible Graphics with 3D-Printed Overlays and Auditory Annotations

Liang He, Zijian Wan, Leah Findlater, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

keywords: blind, visual impairments, touchscreens, 3d printing, fabrication, speech interfaces, accessible graphics

PDF | doi | Citation | Touchscreen Accessibility • TacTILE

Recognizing Clothing Colors and Visual Textures Using a Finger-Mounted Camera: An Initial Investigation

Alexander Medeiros, Lee Stearns, Leah Findlater, Chuan Chen, Jon E. Froehlich

Extended Abstract Proceedings of ASSETS 2017

keywords: wearables, blind, visual impairments, texture recognition, cloth recognition

PDF | doi | Citation | HandSight • Cloth Recognition

Investigating Microinteractions for People With Visual Impairments and the Potential Role of on-Body Interaction

Uran Oh, Lee Stearns, Alisha Pradhan, Jon E. Froehlich, Leah Findlater

Proceedings of ASSETS 2017 | Acceptance Rate: 26.2% (33 / 126)

keywords: wearables, visual impairments, mobile, on-body interaction, microinteraction

PDF | doi | Citation | On-Body Interaction • TouchCam • HandSight

Designing 3D-Printed Deformation Behaviors Using Spring-Based Structures: An Initial Investigation

Liang He, Huaishu Peng, Joshua Land, Mark Fuge, Jon E. Froehlich

Extended Abstract Proceedings of UIST 2017

keywords: 3d printing, fabrication, mechanical springs

PDF | doi | Citation | Ondulé

A Temporal Thermography System for Supporting Longitudinal Building Energy Audits

Matthew L Mauriello, Jamie H Gilkeson, Noa Chazan, Jon E. Froehlich

Extended Abstract Proceedings of Ubicomp 2017

keywords: thermography, sustainable hci, environmental sustainability, environmental hci, sustainability, information visualization, thermal cameras, environmental sensing, sensors, design, environment, sustainability

PDF | doi | Citation | Pervasive Thermography • Thermporal

Scalable Methods and Tools to Support Thermographic Data Collection and Analysis for Energy Audits

Matthew L Mauriello

Extended Abstract ACM Ubicomp 2017 Doctoral Colloquium

keywords: thermography, sustainable hci, environmental sustainability, sustainability, thermal cameras, mobile, sensors, design, environment, sustainability

PDF | doi | Citation | Pervasive Thermography

MakerWear: A Tangible Construction Kit for Young Children to Create Interactive Wearables

Majeed Kazemitabaar

UMD CS MS Thesis

keywords: stem, educational technology, educating makers, maker movement

PDF | doi | Citation | MakerWear

Early Explorations of Deformable Interactive Designs with 3D-Printed Springs

Liang He, Joshua Land, Huaishu Peng, Mark Fuge, Jon E. Froehlich

Extended Abstract Symposium on Computational Fabrication 2017

keywords: fabricated objects

PDF | doi | Citation

Comparing Touchscreen and Mouse Input Performance by People With and Without Upper Body Motor Impairments

Leah Findlater, Karyn Moffatt, Jon E. Froehlich, Meethu Malu, Joan Zhang

Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)

keywords: accessibility, touchscreen accessibility, motor impairments, human performance, input devices, touchscreens, mouse

PDF | doi | Citation | Touchscreen Accessibility

Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study

Matthew L Mauriello, Manaswi Saha, Erica Brown, Jon E. Froehlich

Proceedings of CHI 2017 | Acceptance Rate: 25.0% (606 / 2424)

keywords: formative inquiry, sustainable hci, urban informatics, environmental sustainability, environmental hci, sustainability

PDF | doi | Citation | Talk | Pervasive Thermography

Live Physiological Sensing and Visualization Ecosystems: An Activity Theory Analysis

Tamara L. Clegg, Leyla Norooz, Seokbin Kang, Virginia Byrne, Monica Katzen, Angelisa Plane, Vanessa Oguamanam, Thomas Outing, Elizabeth Bonsignore, Jason Yip, Jon E. Froehlich

Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)

keywords: scientific inquiry, wearables, sensor-based learning

PDF | doi | Citation | BodyVis

Differences in Crowdsourced vs. Lab-based Mobile and Desktop Input Performance Data

Leah Findlater, Joan Zhang, Jon E. Froehlich, Karyn Moffatt

Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)

keywords: crowdsourcing, mobile, human performance, input devices, touchscreens

PDF | doi | Citation

MakerWear: A Tangible Approach to Interactive Wearable Creation for Children

Majeed Kazemitabaar, Jason McPeak, Alex Jiao, Liang He, Thomas Outing, Jon E. Froehlich

Proceedings of CHI 2017 | Best Paper Award

keywords: wearables, children, making, tangible interaction

PDF | doi | Citation | MakerWear

SqueezaPulse: Adding Interactive Input to Fabricated Objects Using Corrugated Tubes and Air Pulses

Liang He, Gierad Laput, Eric Brockmeyer, Jon E. Froehlich

Proceedings of TEI'17

keywords: fabricated objects, acoustic sensing, squeeze interactions, corrugated acoustics

PDF | doi | Citation | SqueezaPulse

Temporal Tracking Urban Areas using Google Street View

Ladan Najafizadeh

UMD CS MS Thesis

keywords: accessibility, crowdsourcing accessibility, accessible cities, physical accessibility

PDF | doi | Citation | Project Sidewalk

Scalable Methods to Collect and Visualize Sidewalk Accessibility Data for People with Mobility Impairments

Kotaro Hara

UMD CS PhD Dissertation

keywords: accessibility, crowdsourcing accessibility, accessible public transit, accessible urban navigation, accessible cities, physical accessibility

PDF | doi | Citation | Project Sidewalk

Localization of Skin Features on the Hand and Wrist From Small Image Patches

Lee Stearns, Uran Oh, Bridget Cheng, Leah Findlater, David Ross, Rama Chellappa, Jon E. Froehlich

Proceedings of ICPR 2016

keywords: handsight, computer vision, machine learning, on-body interaction, skin texture classification, biometrics, skin-based localization

PDF | doi | Citation | HandSight • On-Body Interaction

Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras

Lee Stearns, Ruofei Du, Uran Oh, Catherine Jou, Leah Findlater, David Ross, Jon E. Froehlich

ACM Transactions on Accessible Computing (TACCESS) 2016

keywords: wearables, handsight, accessibility, visual impairments, real-time ocr, blind reading

PDF | doi | Citation | HandSight • Haptic Hand Guidance

New Horizons for the IoT in Everyday Life: Proactive, Shared, Sustainable

Joel Fischer, James A. Colley, Ewa Luger, Michael Golembewski, Enrico Costanza, Sarvapali D. Ramchurn, Stephen Viller, Ian Oakley, Jon E. Froehlich

Extended Abstract Proceedings of UbiComp 2016

keywords: iot, internet of things, sharing economy, automation

PDF | doi | Citation

“That's Your Heart!”: Live Physiological Sensing & Visualization Tools for Life-Relevant & Collaborative STEM Learning

Leyla Norooz, Tamara L. Clegg, Seokbin Kang, Angelisa Plane, Vanessa Oguamanam, Jon E. Froehlich

Proceedings of ICLS 2016

keywords: sharedphys, bodyvis, physiological sensing, large-screen displays, mixed-reality, scientific inquiry, collaborative learning, stem, wearables

PDF | doi | Citation | BodyVis • SharedPhys

SharedPhys: Live Physiological Sensing, Whole-Body Interaction, and Large-Screen Visualizations to Support Shared Inquiry Experiences

Seokbin Kang, Leyla Norooz, Vanessa Oguamanam, Angelisa Plane, Tamara L. Clegg, Jon E. Froehlich

Proceedings of IDC 2016

keywords: sharedphys, bodyvis, physiological sensing, large-screen displays, mixed-reality, scientific inquiry, collaborative learning, stem, wearables

PDF | doi | Citation | SharedPhys • BodyVis

ReWear: Early Explorations of a Modular Wearable Construction Kit for Young Children

Majeed Kazemitabaar, Liang He, Katie Wang, Chloe Aloimonos, Tony Cheng, Jon E. Froehlich

Extended Abstracts of CHI 2016 | Best Paper Award

keywords: wearables, e-textiles, construction kits, electronic textiles, children, making

PDF | doi | Citation | MakerWear • ReWear

Evaluating Angular Accuracy of Wrist-based Haptic Directional Guidance for Hand Movement

Jonggi Hong, Lee Stearns, Tony Cheng, Jon E. Froehlich, David Ross, Leah Findlater

Proceedings of GI 2016 | Acceptance Rate: 39.4% (13 / 33)

keywords: wearables, haptics, non-visual directional guidance, handsight

PDF | doi | Citation | HandSight • Haptic Hand Guidance

The Future Role of Thermography in Human-Building Interaction

Matthew L Mauriello, Matthew Dahlhausen, Erica Brown, Manaswi Saha, Jon E. Froehlich

CHI 2016 Workshop: Future of Human-Building Interaction

keywords: thermography, human-building interaction, thermal cameras

PDF | Citation | Pervasive Thermography

The Design of Assistive Location-based Technologies for People with Ambulatory Disabilities: A Formative Study

Kotaro Hara, Christine Chan, Jon E. Froehlich

Proceedings of CHI 2016 | Acceptance Rate: 25.0% (600 / 2400)

keywords: accessibility, mobility impairments, formative study, gis, navigation, trip planning

PDF | doi | Citation | Accessibility-Infused Maps • Project Sidewalk • Multi-Stakeholder Interviews to Examine Urban Accessibility

Characterizing and Visualizing Physical World Accessibility at Scale Using Crowdsourcing, Computer Vision, and Machine Learning

Kotaro Hara, Jon E. Froehlich

SIGACCESS Newsletter '15

keywords: crowdsourcing accessibility, computer vision, google street view, amazon mechanical turk, personalized routing, accessibility map visualizations

PDF | doi | Citation | Project Sidewalk

Supporting Everyday Activities for Persons with Visual Impairments Through Computer Vision-Augmented Touch

Leah Findlater, Lee Stearns, Ruofei Du, Uran Oh, David Ross, Rama Chellappa, Jon E. Froehlich

Poster Proceedings of ASSETS 2015

keywords: computer vision, blind, visual impairments, finger camera, touch vision

PDF | doi | Citation | HandSight

MakerShoe: Towards an E-Textile Construction Kit to Support Creativity, Playful Making, and Self-Expression

Majeed Kazemitabaar, Leyla Norooz, Mona Leigh Guha, Jon E. Froehlich

Extended Abstracts of IDC 2015

keywords: wearables, e-textiles, construction kits, electronic textiles, children, making

PDF | doi | Citation | MakerWear

Pixel: A Tool for Creative Design with Physical Materials and Computation

Michael Gubbels

UMD iSchool MS Thesis

keywords: makers, educating makers, maker movement

PDF | doi | Citation | Pixel

BodyVis: A New Approach to Body Learning Through Wearable Sensing and Visualization

Leyla Norooz, Matthew L Mauriello, Anita Jorgensen, Brenna McNally, Jon E. Froehlich

Extended Abstract Proceedings of CHI 2015 | Honorable Mention

keywords: physiological sensing, wearables, interactive body learning, tangible interactive computing

PDF | doi | Citation | Talk | BodyVis

Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing

Dhruv Jain, Leah Findlater, Jamie H Gilkeson, Benjamin Holland, Ramani Duraiswami, Dmitry Zotkin, Christian Vogler, Jon E. Froehlich

Proceedings of CHI 2015

keywords: wearables, accessibility, deaf, hard of hearing, head-mounted display, wearable, sound visualization, conversation support

PDF | doi | Citation | GlassEar

Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions

Matthew L Mauriello, Leyla Norooz, Jon E. Froehlich

Proceedings of CHI 2015 | Honorable Mention

keywords: energy audits, thermography, robotics, formative inquiry, design probes, sustainable hci, human-robotic interaction

PDF | doi | Citation | Pervasive Thermography

AtmoSPHERE: Representing Space and Movement Using Sand Traces in an Interactive Zen Garden

Ruofei Du, Kent Wills, Max Potasznik, Jon E. Froehlich

CHI '15 Extended Abstracts

keywords: calm technology, tangible interactive art, xy servo table, sand drawings, zen gardens, physical computing

PDF | doi | Citation | AtmoSPHERE

"I Like This Shirt": Exploring the Translation of Social Mechanisms in the Virtual World into Physical Experiences

Jon E. Froehlich, Seokbin Kang, Ladan Najafizadeh

CHI '15 Extended Abstracts

keywords: wearables, e-textiles, tangible social interaction, social fabric, social objects

PDF | doi | Citation | I Like This Shirt

Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View: An Extended Analysis

Kotaro Hara, Shiri Azenkot, Megan Campbell, Cynthia Bennett, Sean Pannella, Robert Moore, Kelly Minckler, Rochelle Ng, Jon E. Froehlich

TACCESS 2015

keywords: accessibility, crowdsourcing accessibility, google street view, low-vision, public transport, bus stop auditing, crowdsourcing, blind users, accessible bus stops, remote data collection

PDF | doi | Citation | Crowdsourcing Bus Stop Landmarks

Gamifying Green: Gamification and Environmental Sustainability

Jon E. Froehlich

The Gameful World

keywords: persuasive technology, environmental sustainability, gamification, ubigreen, nest, opower, bikeshare, eco-driving, toyota prius, nissan leaf, recyclebank, ethics, gamifying green, motivation, credibility

PDF | Citation

Scalable methods to collect and visualize sidewalk accessibility data for people with mobility impairments

Kotaro Hara

Extended Abstract Proceedings of UIST 2014

keywords: accessibility, crowdsourcing accessibility, accessible public transit, accessible cities, urban informatics, physical world accessibility

PDF | doi | Citation | Project Sidewalk

Tohme: Detecting Curb Ramps in Google Street View Using Crowdsourcing, Computer Vision, and Machine Learning

Kotaro Hara, Jin Sun, Robert Moore, David Jacobs, Jon E. Froehlich

Proceedings of UIST 2014

keywords: crowdsourcing accessibility, computer vision, google street view, amazon mechanical turk

PDF | doi | Citation | Project Sidewalk • Tohme

Disasters in Personal Informatics: The Unpublished Stories of Failure and Lessons Learned

Jon E. Froehlich, Matthew Kay, Jakob Eg Larsen, Edison Thomaz

UbiComp2014 Workshop: Disasters in Personal Informatics: The Unpublished Stories of Failure and Lessons Learned

keywords: personal informatics, field studies, quantified self, failures

PDF | Citation

The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind

Lee Stearns, Ruofei Du, Uran Oh, Yumeng Wang, Rama Chellappa, Leah Findlater, Jon E. Froehlich

Proceedings of ACVR 2014

keywords: wearables, accessibility, real-time ocr, text reading for blind

PDF | doi | Citation | HandSight

Towards Automated Thermal Profiling of Buildings at Scale Using Unmanned Aerial Vehicles and 3D-Reconstruction

Matthew L Mauriello, Jon E. Froehlich

Poster Proceedings of UbiComp 2014

keywords: environmental sustainability, 3d thermography, aerial robotics, automated energy auditing, building assessment

PDF | doi | Citation | Pervasive Thermography

Physically Computing Physical Computing: Creative Tools for Building with Physical Materials and Computation

Michael Gubbels, Jon E. Froehlich

IDC '14 Extended Abstracts

keywords: children, making, physical computing, tangible user interfaces, makers, pixel, sensors, actuators, programming, materials

PDF | Citation | Pixel

BodyVis: Body Learning Through Wearable Sensing and Visualization

Leyla Norooz

UMD iSchool MS Thesis

keywords: bodyvis, physiological sensing, stem, wearables, educational technology

PDF | doi | Citation | BodyVis

Social Fabric Fitness: The Design and Evaluation of Wearable E-Textile Displays to Support Group Running

Matthew L Mauriello, Michael Gubbels, Jon E. Froehlich

Proceedings of CHI 2014

keywords: wearables, wearable displays, e-textiles, personal informatics, running, sports, health, fitness

PDF | doi | Citation | Social Fabric Fitness

An Initial Study of Automatic Curb Ramp Detection with Crowdsourced Verification using Google Street View Images

Kotaro Hara, Jin Sun, Noa Chazan, David Jacobs, Jon E. Froehlich

Poster Proceedings of HCOMP 2013

keywords: computer vision, accessible urban navigation, mechanical turk, data collection, accessible cities, physical accessibility, crowdsourcing, google streetview, crowd verification

PDF | doi | Citation | Project Sidewalk • Tohme

Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View

Kotaro Hara, Shiri Azenkot, Megan Campbell, Cynthia Bennett, Sean Pannella, Robert Moore, Kelly Minckler, Rochelle Ng, Jon E. Froehlich

Proceedings of ASSETS 2013 | Best Paper Award

keywords: crowdsourcing accessibility, google street view, accessible public transit, blind, low-vision, accessible urban navigation, mechanical turk, data collection, accessible cities

PDF | doi | Citation | Talk | Crowdsourcing Bus Stop Landmarks

Surveying the Accessibility of Touchscreen Games for Persons with Motor Impairments: A Preliminary Analysis

Yoojin Kim, Nitaben Sutreja, Jon E. Froehlich, Leah Findlater

Poster Proceedings of ASSETS 2013

keywords: accessibility, motor impairments, smartphones, accessible touchscreens, tablets

PDF | doi | Citation | Touchscreen Accessibility

Exploring Early Designs for Teaching Anatomy and Physiology to Children Using Wearable E-Textiles

Leyla Norooz, Jon E. Froehlich

IDC '13 Extended Abstracts

keywords: wearables, e-textiles, sensing and feedback, children, live physiology, educational technology, teaching, anatomy, body learning

PDF | doi | Citation | BodyVis

Exploring Early Solutions for Automatically Identifying Inaccessible Sidewalks in the Physical World using Google Street View

Kotaro Hara, Victoria Le, Jin Sun, David Jacobs, Jon E. Froehlich

HCIC2013 Workshop

keywords: computer vision, google street view, machine learning, crowdsourcing, physical world accessibility, street-level accessibility

PDF | Citation | Project Sidewalk • Tohme

Combining Crowdsourcing and Google Street View to Identify Street-level Accessibility Problems

Kotaro Hara, Victoria Le, Jon E. Froehlich

Proceedings of CHI 2013

keywords: crowdsourcing accessibility, google street view, accessible urban navigation, mechanical turk, data collection, accessible cities, physical accessibility, wheelchair, urban informatics

PDF | doi | Citation | Project Sidewalk

Mind the Theoretical Gap: Interpreting, Using, and Developing Behavioral Theory in HCI Research

Eric Hekler, Predrag Klasnja, Jon E. Froehlich, Matthew Buman

Proceedings of CHI 2013 | Best Paper Award

keywords: health, behavioral science, behavioral theory, persuasive technology, persuasive design, behavior change, environmental sustainability, eco-feedback

PDF | doi | Citation

Age-Related Differences in Performance with Touchscreens Compared to Traditional Mouse Input

Leah Findlater, Jon E. Froehlich, Kays Fattal, Jacob Wobbrock, Tanya Dastyar

Proceedings of CHI 2013 | Honorable Mention

keywords: touchscreen accessibility, older adults, motor impaired users, controlled lab study

PDF | doi | Citation | Touchscreen Accessibility

Personal Informatics in the Wild: Hacking Habits for Health & Happiness

Ian Li, Jon E. Froehlich, Jakob Eg Larsen, Catherine Grevet, Ernesto Ramirez

CHI2013 Workshop: Personal Informatics in the Wild: Hacking Habits for Health & Happiness

keywords: personal informatics, health, quantified self, reflective interfaces, wellbeing

PDF | Citation

Bear-With-Me: An Embodied Prototype to Explore Tangible Two-Way Exchanges of Emotional Language

Allan Fong, Zahra Ashktorab, Jon E. Froehlich

CHI '13 Extended Abstracts

keywords: tangible interaction, embodied communication, intimacy sharing, emotional language

PDF | doi | Citation | Bear-With-Me

Individuals Among Commuters: Building Personalised Transport Information Services from Fare Collection Systems

Neal Lathia, Chris Smith, Jon E. Froehlich, Licia Capra

Pervasive and Mobile Computing (PMC) 2012

keywords: urban informatics, smart cities, personalization, public transport, urban data mining

PDF | doi | Citation | Transportation Analytics

A feasibility study of crowdsourcing and google street view to determine sidewalk accessibility

Kotaro Hara, Victoria Le, Jon E. Froehlich

Poster Proceedings of ASSETS 2012

keywords: crowdsourcing accessibility, google street view, accessible urban navigation, mechanical turk

PDF | doi | Citation | Project Sidewalk

The Design and Evaluation of Prototype Eco-Feedback Displays for Fixture-Level Water Usage Data

Jon E. Froehlich, Leah Findlater, Marilyn Ostergren, Solai Ramanathan, Josh Peterson, Inness Wragg, Eric Larson, Fabia Fu, Mazhengmin Bai, Shwetak Patel, James Landay

Proceedings of CHI 2012 | Honorable Mention

keywords: persuasive design, eco-feedback, water, environmental hci, water conservation, iterative design

PDF | doi | Citation |

Personal Informatics in Practice: Improving Quality of Life Through Data

Ian Li, Yevgeniy Medynskiy, Jon E. Froehlich, Jakob Eg Larsen

CHI2012 Workshop: Personal Informatics in Practice: Improving Quality of Life Through Data

keywords: personal informatics, health, quantified self, reflective interfaces, wellbeing

PDF | Citation