Project Description

2018–2020
We introduce ARMath, a mobile Augmented Reality (AR) system that allows children to discover mathematical concepts in familiar, ordinary objects and engage with math problems in meaningful contexts. Leveraging advanced computer vision, ARMath recognizes everyday objects, visualizes their mathematical attributes, and turns them into tangible or virtual manipulatives. Using the manipulatives, children can solve problems that situate math operations or concepts in specific everyday contexts. Informed by four participatory design sessions with teachers and children, we developed five ARMath modules to support basic arithmetic and 2D geometry. We also conducted an exploratory evaluation of ARMath with 27 children (ages 5-8) at a local children’s museum. Our findings demonstrate how ARMath engages children in math learning, how failures in AI can be used as learning opportunities, and challenges that children face when using ARMath.

Publications

Augmented Reality Systems and User Interaction Techniques for Stem Learning

Seokbin Kang

UMD CS PhD Dissertation 2020

ARMath: Augmenting Everyday Life with Math Learning

Seokbin Kang, Ekta Shokeen, Virginia Byrne, Leyla Norooz, Elizabeth Bonsignore, Caro Williams-Pierce, Jon E. Froehlich

Proceedings of CHI 2020 | Acceptance Rate: 24.3% (760 / 3126)