Project Description

Date

2014–2019
Improving energy efficiency in the built environment is an important global concern. In the United States, for example, buildings account for 41% of primary energy consumption–more than any other sector–and contribute an increasing portion of carbon dioxide emissions (33% in 1980 vs. 40% in 2009). To reduce consumption and emission levels, the U.S. Department of Energy (DOE) recommends energy audits to help identify sources of inefficiencies and reduce consumption (e.g., home energy audits typically identify improvements that lead to 5-30% reductions in utility use). Moreover, energy audits are increasingly becoming part of building efficiency certification programs. In response, interest in energy auditing has increased.

Our work focuses on thermography, a data collection and visual analytics technique utilizing thermal cameras, which energy auditors use to identify, diagnose, and document efficiency issues (e.g., missing insulation, air leakage) in buildings. The use of thermography during an energy audit helps the auditor find and communicate problems to building owners and including thermal imagery in inspection reports has been shown to lead to two primary outcomes: (i) an increased likelihood that the building owners will make retrofit decisions and (ii) an increased likelihood that building occupants will engage in conservation behaviors. With respect to increasing the overall energy efficiency of the built environment, both outcomes are desirable.

Our work investigates scaling thermographic inspections along two dimensions: first, scaling in terms of who can perform thermographic audits by building and evaluating computer assisted thermographic tools to help with both capture and analysis; second, scaling in terms of time by building and evaluating new indoor, automated temporal data collection and analysis tools. Related to this, we explore three key areas: (i) current thermographic energy auditing practices, (ii) the application of machine learning, image processing, and information visualization techniques to classify and gather insights from real world thermographic data, and (iii) developing new methods and tools to support human-oriented thermographic data collection and analysis activities.

Publications

Thermporal: An Easy-to-Deploy Temporal Thermographic Sensor System to Support Residential Energy Audits

Matthew L Mauriello, Brenna McNally, Jon E. Froehlich

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)

PDF | doi | Citation | Talk | Pervasive Thermography • Thermporal

A Large-Scale Analysis of YouTube Videos Depicting Everyday Thermal Camera Use

Matthew L Mauriello, Brenna McNally, Cody Buntain, Sapna Bagalkotkar, Samuel Kushnir, Jon E. Froehlich

Proceedings of MobileHCI 2018

PDF | doi | Citation | Talk | Pervasive Thermography

Designing and Evaluating Next-Generation Thermographic Systems to Support Residential Energy Audits

Matthew L Mauriello

UMD CS PhD Dissertation 2018

PDF | Citation | Talk | Pervasive Thermography

A Temporal Thermography System for Supporting Longitudinal Building Energy Audits

Matthew L Mauriello, Jamie H Gilkeson, Noa Chazan, Jon E. Froehlich

Extended Abstract Proceedings of Ubicomp 2017

PDF | doi | Citation | Pervasive Thermography • Thermporal

Scalable Methods and Tools to Support Thermographic Data Collection and Analysis for Energy Audits

Matthew L Mauriello

Extended Abstract Proceedings of ACM Ubicomp 2017 Doctoral Colloquium 2017

PDF | doi | Citation | Pervasive Thermography

Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study

Matthew L Mauriello, Manaswi Saha, Erica Brown, Jon E. Froehlich

Proceedings of CHI 2017 | Acceptance Rate: 25.0% (606 / 2424)

PDF | doi | Citation | Talk | Pervasive Thermography

The Future Role of Thermography in Human-Building Interaction

Matthew L Mauriello, Matthew Dahlhausen, Erica Brown, Manaswi Saha, Jon E. Froehlich

CHI 2016 Workshop: Future of Human-Building Interaction 2016

PDF | Citation | Pervasive Thermography

Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions

Matthew L Mauriello, Leyla Norooz, Jon E. Froehlich

Proceedings of CHI 2015 | Honorable Mention

PDF | doi | Citation | Pervasive Thermography

Towards Automated Thermal Profiling of Buildings at Scale Using Unmanned Aerial Vehicles and 3D-Reconstruction

Matthew L Mauriello, Jon E. Froehlich

Extended Abstract Proceedings of UbiComp 2014

PDF | doi | Citation | Pervasive Thermography

We design, build, and evaluate new interactive tools and techniques to address pressing societal challenges. Makeability refers both to how our technological innovations make new abilities possible for humans as well as our educational mission to help students gain new abilities as they learn and grow through research, invention, and human-centered design.

Recent News

May 23, 2025

Makeability Lab at the Post-CHI Miraikan Accessibility Networking Event

May 16, 2025

CFP: ICCV Workshop on GenAI for Accessibility

April 23, 2025

Arnavi Passes Quals!

Links