Makeability Lab
  • Home
  • News
  • People
  • Projects
  • Publications
  • Lab Handbook
  • Apply
Pervasive Thermography
Two handheld thermal cameras
Pervasive Thermography
Using a FLIR handheld thermal camera

Quick Info

Project Date Jan. 19, 2014 - May 9, 2019
PIs: Jon E. Froehlich (PI)
Sponsors: University of Maryland Office of Sustainability
Keywords: energy audits, thermography, robotics, formative inquiry, design probes, sustainable hci, human-robotic interaction, environmental sustainability, human-building interaction, thermal cameras, 3d thermography, aerial robotics, automated energy auditing, building assessment

News

The CHI'19 conference logo

Five Papers Conditionally Accepted to CHI'19!

Dec 10, 2018 | Jon

The Makeability Lab had five papers conditionally accepted to CHI'19. We'll see you in Glasgow! Stay tuned for more information. Hoping to post pre-prints in January!

Picture of newly minted Drs. Matt Mauriello and Lee Stearns with their advisor Jon Froehlich

Congratulations to Drs. Mauriello and Stearns

Aug 01, 2018 | Jon

Please join me in congratulating Drs. Matt Mauriello and Lee Stearns who successfully passed their PhD defenses today. One of the true joys of being a professor is seeing students develop into independent scholars like Matt and Lee. Matt is now off to a post-doc at Stanford and Lee will join APL at Johns Hopkins. Thanks to the fantastic committee members as well who spanned from multiple disciplines, universities, and parts of the US! :) Matt's dissertation is entitled " Designing and Evaluating Next-generation Thermographic Systems to Support Residential Energy Audits" and available for download here and Lee's dissertation is entitled "Handsight: A Touch-based Wearable System to Increase Information Accessibility for People With Visual Impairments" and available here.

Presenting Temporal Thermography Work at HCIL Symposium

Congratulations Matt Mauriello on Ubicomp Submissions

Jul 03, 2017 | Jon

Excited to announce that Matt Mauriello and his team had their temporal thermography poster accepted to this year's ACM Conference on Pervasive and Ubiquitous Computing (Ubicomp 2017). In addition to the poster, Matt also had his work accepted into the Doctoral Colloquium. Congratulations and keep up the good work!

Matt Mauriello Selected as All-S.T.A.R. Fellow!

Apr 25, 2017 | Jon

Congratulations to Matt Mauriello who was just selected as an All-S.T.A.R Fellow for his work on scalable thermography--one of sixteen across the entire Graduate School at UMD. The Graduate All-S.T.A.R. Fellowship honors graduate students who are both outstanding scholars and outstanding graduate assistants. Read more about the award here.

Matt and his Phd committee

Congratulations to Matt Mauriello for Passing his PhD Proposal

Dec 16, 2016 | Jon

Congratulations to Matt Mauriello for passing his PhD proposal on mixed-initiative methods to scale thermographic energy auditing in space and time. Matt has much to celebrate this semester with getting into the Clark Faculty Fellow program, receiving two CHI paper acceptances, and now becoming a PhD candidate. Congrats Matt! And thanks to Andrea Wiggins and David Jacobs for serving on his committee.

Sensor Prototype:

Join the Scalable Thermography Team

Sep 02, 2016 | Matthew

Our research group (the Makeability Lab in the HCIL) is investigating new, scalable methods and tools for thermographic data collection and analysis. We are looking for talented, creative, and self-motivated undergraduate research assistants with strong technical backgrounds and an interest in environmental sustainability to work on a new, easily deployable thermographic sensor. We are specifically looking for student volunteers interested in developing valuable hardware and software skills over the course of the academic year while supporting an ongoing research project. Interested students should have one or more of the following skills and a keen interest in expanding their abilities in some of the other areas: Experience working with single-board computers and accessories Experience designing front-end and back-end web components Experience prototyping applications with Android devices Eagerness to learn and make with rapid prototyping technologies You will be working in the HCIL Hackerspace, will attend weekly research meetings, and will join a team of other talented undergraduate and graduate students. Our short term goal is a publication at CHI2017 and a potential submission to UIST2017. For best consideration, please read this page about undergraduate research and then send your CV and unofficial transcripts to mattm401@umd.edu and CC jonf@cs.umd.edu by September 21st. We will contact a subset of qualified candidates to setup interviews and request other materials. Full details are available on our announcement webpage. Please feel free to forward this announcement.

About

Smartphone-based Thermography

Building new methods and tools to support data collection and analysis

Improving energy efficiency in the built environment is an important global concern. In the United States, for example, buildings account for 41% of primary energy consumption–more than any other sector–and contribute an increasing portion of carbon dioxide emissions (33% in 1980 vs. 40% in 2009). To reduce consumption and emission levels, the U.S. Department of Energy (DOE) recommends energy audits to help identify sources of inefficiencies and reduce consumption (e.g., home energy audits typically identify improvements that lead to 5-30% reductions in utility use). Moreover, energy audits are increasingly becoming part of building efficiency certification programs. In response, interest in energy auditing has increased.

Our work focuses on thermography, a data collection and visual analytics technique utilizing thermal cameras, which energy auditors use to identify, diagnose, and document efficiency issues (e.g., missing insulation, air leakage) in buildings. The use of thermography during an energy audit helps the auditor find and communicate problems to building owners and including thermal imagery in inspection reports has been shown to lead to two primary outcomes: (i) an increased likelihood that the building owners will make retrofit decisions and (ii) an increased likelihood that building occupants will engage in conservation behaviors. With respect to increasing the overall energy efficiency of the built environment, both outcomes are desirable.

Our work investigates scaling thermographic inspections along two dimensions: first, scaling in terms of who can perform thermographic audits by building and evaluating computer assisted thermographic tools to help with both capture and analysis; second, scaling in terms of time by building and evaluating new indoor, automated temporal data collection and analysis tools. Related to this, we explore three key areas: (i) current thermographic energy auditing practices, (ii) the application of machine learning, image processing, and information visualization techniques to classify and gather insights from real world thermographic data, and (iii) developing new methods and tools to support human-oriented thermographic data collection and analysis activities.

Publications

Thermporal: An Easy-to-Deploy Temporal Thermographic Sensor System to Support Residential Energy Audits

Matthew L Mauriello, Brenna McNally, Jon E. Froehlich

Proceedings of CHI 2019 | Acceptance Rate: 23.8% (705 / 2960)

keywords: thermography, sensing, thermal cameras, field deployments

PDF | doi | Citation | Talk | Pervasive Thermography • Thermporal

A Large-Scale Analysis of YouTube Videos Depicting Everyday Thermal Camera Use

Matthew L Mauriello, Brenna McNally, Cody Buntain, Sapna Bagalkotkar, Samuel Kushnir, Jon E. Froehlich

Proceedings of MobileHCI2018

keywords: thermography, sustainable hci, environmental sustainability, thermal cameras, youtube, user-generated content

PDF | doi | Citation | Talk | Pervasive Thermography

Designing and Evaluating Next-Generation Thermographic Systems to Support Residential Energy Audits

Matthew L Mauriello

UMD CS PhD Dissertation

keywords: thermography, sustainable hci, environmental sustainability, thermal cameras

PDF | Citation | Talk | Pervasive Thermography

A Temporal Thermography System for Supporting Longitudinal Building Energy Audits

Matthew L Mauriello, Jamie H Gilkeson, Noa Chazan, Jon E. Froehlich

Extended Abstract Proceedings of Ubicomp 2017

keywords: thermography, sustainable hci, environmental sustainability, environmental hci, sustainability, information visualization, thermal cameras, environmental sensing, sensors, design, environment, sustainability

PDF | doi | Citation | Pervasive Thermography • Thermporal

Scalable Methods and Tools to Support Thermographic Data Collection and Analysis for Energy Audits

Matthew L Mauriello

Extended Abstract ACM Ubicomp 2017 Doctoral Colloquium

keywords: thermography, sustainable hci, environmental sustainability, sustainability, thermal cameras, mobile, sensors, design, environment, sustainability

PDF | doi | Citation | Pervasive Thermography

Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study

Matthew L Mauriello, Manaswi Saha, Erica Brown, Jon E. Froehlich

Proceedings of CHI 2017 | Acceptance Rate: 25.0% (606 / 2424)

keywords: formative inquiry, sustainable hci, urban informatics, environmental sustainability, environmental hci, sustainability

PDF | doi | Citation | Talk | Pervasive Thermography

The Future Role of Thermography in Human-Building Interaction

Matthew L Mauriello, Matthew Dahlhausen, Erica Brown, Manaswi Saha, Jon E. Froehlich

CHI 2016 Workshop: Future of Human-Building Interaction

keywords: thermography, human-building interaction, thermal cameras

PDF | Citation | Pervasive Thermography

Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions

Matthew L Mauriello, Leyla Norooz, Jon E. Froehlich

Proceedings of CHI 2015 | Honorable Mention

keywords: energy audits, thermography, robotics, formative inquiry, design probes, sustainable hci, human-robotic interaction

PDF | doi | Citation | Pervasive Thermography

Towards Automated Thermal Profiling of Buildings at Scale Using Unmanned Aerial Vehicles and 3D-Reconstruction

Matthew L Mauriello, Jon E. Froehlich

Poster Proceedings of UbiComp 2014

keywords: environmental sustainability, 3d thermography, aerial robotics, automated energy auditing, building assessment

PDF | doi | Citation | Pervasive Thermography

Videos

Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions

YouTube | Paper | Pervasive Thermography

Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions

YouTube | Pervasive Thermography

Talks

A Large-Scale Analysis of YouTube Videos Depicting Everyday Thermal Camera Use

Sept. 5, 2018 | MobileHCI 2018

Barcelona, Spain

Matthew L Mauriello

PDF | PPTX | SlideShare | Paper | Pervasive Thermography

Designing and Evaluating Next-Generation Thermographic Systems to Support Residential Energy Audits

Aug. 1, 2018 | PhD Defense, Computer Science

University of Maryland, College Park

Matthew L Mauriello

PDF | PPTX | Paper | Pervasive Thermography

Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study

May 9, 2017 | CHI2017

Denver, Colorado, USA

Matthew L Mauriello

PDF | Paper | Pervasive Thermography

Making with a Social Purpose

April 6, 2017 | Lecture Series at the Laboratory for Telecommunication Sciences

LTS Auditorium, College Park, MD

Jon E. Froehlich

PDF | HandSight | Project Sidewalk | Pervasive Thermography | MakerWear | BodyVis

Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions

April 22, 2015 | CHI2015

Seoul, Republic of Korea

Matthew L Mauriello

PDF | Video | SlideShare | Pervasive Thermography

Photo Gallery

Anomaly Detection
Support Tools
Energy Analysis
×

Anomaly Detection

Support Tools

Energy Analysis

❮ ❯

Project Members

Jon E. Froehlich

Jan 2014 - May 2019

Associate Professor

Computer Science

University of Washington

All Projects


Professor()
Matthew L Mauriello

Jan 2014 - May 2019

PhD Student

Computer Science

University of Maryland

Pervasive Thermography | Thermporal | BodyVis


PhD Student()
Leyla Norooz

Aug 2014 - Apr 2015

PhD Student

iSchool

University of Maryland

BodyVis | SharedPhys | PrototypAR


PhD Student()
Erica Brown

May 2015 - Jan 2016

Undergrad

Bioengineering

University of Maryland

Pervasive Thermography


Undergrad()
Manaswi Saha

Aug 2015 - Jan 2017

PhD Student

Computer Science and Engineering

University of Washington

Project Sidewalk | Accessibility-Infused Maps | AccessVis


PhD Student()
Matthew Dahlhausen

Aug 2015 - Jan 2016

PhD Student

Building Sciences

University of Maryland

Pervasive Thermography


PhD Student()
Jamie H Gilkeson

Jun 2016 - Aug 2016

Undergrad

Computer Science

Drexel University

Pervasive Thermography | Thermporal | GlassEar


Undergrad()
Noa Chazan

Sep 2016 - Dec 2017

Undergrad

Computer Science

University of Maryland

Pervasive Thermography | Thermporal | Project Sidewalk


Undergrad()
Julia Zheng

Sep 2016 - Jan 2017

Undergrad

Computer Engineering

University of Maryland

Undergrad()
Matthew Brady

Jan 2017 - May 2017

Undergrad

Computer Science

University of Maryland

Undergrad()
Anthony Castrio

Jan 2017 - May 2017

Undergrad

Computer Science

University of Maryland

Undergrad()
Brenna McNally

Jun 2017 - Sep 2017

PhD Student

iSchool

University of Maryland

Pervasive Thermography | Thermporal | BodyVis


PhD Student()
Sapna Bagalkotkar

Jun 2017 - Aug 2017

High School Student

Poolesville High School

Pervasive Thermography


High School Student()
Cody Buntain

Jun 2017 - Sep 2017

Post-doc

Computer Science

University of Maryland

Pervasive Thermography


Post-doc()
Samuel Kushnir

Jul 2017 - Aug 2017

High School Student

Berman Hebrew Academy

Pervasive Thermography


High School Student()
Simran Chawla

Jul 2017 - Dec 2017

Undergrad

Computer Engineering

University of Maryland

Undergrad()

We design, build, and evaluate interactive tools and techniques to address pressing societal challenges in accessibility, sustainability, education, and beyond.

Recent News

Jan. 30, 2023

Dhruv Jain Honored with Willian Chan Memorial Dissertation Award

Jan. 11, 2023

SciStarter + Project Sidewalk: MLK Jr. Day of Service

Dec. 16, 2022

Congrats Michael Duan for CRA Undergrad Award

Links

  •  >   Home
  •  >   People
  •  >   News
  •  >   Publications
  •  >   Talks
  •  >   Videos