ARTennis

2023–Present 10

CookAR

2023–Present
RASSAR

2022–Present
HoloSound

2020
AR Captioning

2016–2022
AR Magnification

2016–2018

Project Description

Individuals with low vision (LV) can experience vision-related challenges when participating in sports, especially those with fast-moving objects. We introduce ARTennis, a prototype for wearable augmented reality (AR) that utilizes real-time computer vision (CV) to enhance the visual saliency of tennis balls. As initial design, a red dot is placed over the tennis ball and four green arrows point at the ball, forming a crosshair. As AR and CV technologies continue to improve, we expect head-worn AR to broaden the inclusivity of sports, such as tennis and basketball.

Publications

Towards Real-time Computer Vision and Augmented Reality to Support Low Vision Sports: A Demonstration of ARTennis

Jaewook Lee, Devesh Sarda, Eujean Lee, Amy S. Lee, Jun Wang, Adrian Rodriguez, Jon E. Froehlich

Extended Abstract Proceedings of UIST 2023

keywords: accessibility, head-mounted display, sports, augmented reality, ar glasses

PDF | doi | Citation | ARTennis

Videos

AI-Powered AR Accessibility

YouTube | RASSAR • GazePointAR • ARTennis • CookAR • DIAM: Drone-based Indoor Accessibility Mapping

Talks

AI-Powered AR Accessibility

Aug. 8, 2024 | Apple's HCML Workshop

Cupertino, CA

Jon E. Froehlich

PDF | PPTX | Video | CookAR • DIAM: Drone-based Indoor Accessibility Mapping • RASSAR • ARTennis • GazePointAR

We design, build, and evaluate new interactive tools and techniques to address pressing societal challenges. Makeability refers both to how our technological innovations make new abilities possible for humans as well as our educational mission to help students gain new abilities as they learn and grow through research, invention, and human-centered design.