Quick Info
Project Date
Jan. 19, 2014 - Present
PIs:
Jon E. Froehlich (PI)
Sponsors:
University of Maryland Office of Sustainability
Keywords:
energy audits,
thermography,
robotics,
formative inquiry,
design probes,
sustainable hci,
human-robotic interaction,
environmental sustainability,
human-building interaction,
thermal cameras,
3d thermography,
aerial robotics,
automated energy auditing,
building assessment
Recent News
Jul 03, 2017 | Jon
Excited to announce that Matt Mauriello and his team had their temporal thermography poster accepted to this year's ACM Conference on Pervasive and Ubiquitous Computing (Ubicomp 2017). In addition to the poster, Matt also had his work accepted into the Doctoral Colloquium. Congratulations and keep up the good work!
Apr 25, 2017 | Jon
Congratulations to Matt Mauriello who was just selected as an All-S.T.A.R Fellow for his work on scalable thermography--one of sixteen across the entire Graduate School at UMD. The Graduate All-S.T.A.R. Fellowship honors graduate students who are both outstanding scholars and outstanding graduate assistants. Read more about the award here.
Congratulations to Matt Mauriello for passing his PhD proposal on mixed-initiative methods to scale thermographic energy auditing in space and time. Matt has much to celebrate this semester with getting into the Clark Faculty Fellow program, receiving two CHI paper acceptances, and now becoming a PhD candidate. Congrats Matt! And thanks to Andrea Wiggins and David Jacobs for serving on his committee.
Sep 02, 2016 | Matthew
Our research group (the Makeability Lab in the HCIL) is investigating new, scalable methods and tools for thermographic data collection and analysis. We are looking for talented, creative, and self-motivated undergraduate research assistants with strong technical backgrounds and an interest in environmental sustainability to work on a new, easily deployable thermographic sensor.
We are specifically looking for student volunteers interested in developing valuable hardware and software skills over the course of the academic year while supporting an ongoing research project. Interested students should have one or more of the following skills and a keen interest in expanding their abilities in some of the other areas:
- Experience working with single-board computers and accessories
- Experience designing front-end and back-end web components
- Experience prototyping applications with Android devices
- Eagerness to learn and make with rapid prototyping technologies
For best consideration, please read this page about undergraduate research and then send your CV and unofficial transcripts to mattm401@umd.edu and CC jonf@cs.umd.edu by September 21st. We will contact a subset of qualified candidates to setup interviews and request other materials. Full details are available on our announcement webpage.
Please feel free to forward this announcement.
About
Smartphone-based Thermography
Building new methods and tools to support data collection and analysis
Our work focuses on thermography, a data collection and visual analytics technique utilizing thermal cameras, which energy auditors use to identify, diagnose, and document efficiency issues (e.g., missing insulation, air leakage) in buildings. The use of thermography during an energy audit helps the auditor find and communicate problems to building owners and including thermal imagery in inspection reports has been shown to lead to two primary outcomes: (i) an increased likelihood that the building owners will make retrofit decisions and (ii) an increased likelihood that building occupants will engage in conservation behaviors. With respect to increasing the overall energy efficiency of the built environment, both outcomes are desirable.
Our work investigates scaling thermographic inspections along two dimensions: first, scaling in terms of who can perform thermographic audits by building and evaluating computer assisted thermographic tools to help with both capture and analysis; second, scaling in terms of time by building and evaluating new indoor, automated temporal data collection and analysis tools. Related to this, we explore three key areas: (i) current thermographic energy auditing practices, (ii) the application of machine learning, image processing, and information visualization techniques to classify and gather insights from real world thermographic data, and (iii) developing new methods and tools to support human-oriented thermographic data collection and analysis activities.
Publications
A Large-Scale Analysis of YouTube Videos Depicting Everyday Thermal Camera Use
Proceedings of MobileHCI2018
Scalable Methods and Tools to Support Thermographic Data Collection and Analysis for Energy Audits
ACM Ubicomp 2017 Doctoral Colloquium
A Temporal Thermography System for Supporting Longitudinal Building Energy Audits
Proceedings of Ubicomp 2017
Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study
Proceedings of CHI2017 | Acceptance Rate: 25.0% (606 / 2424)
The Future Role of Thermography in Human-Building Interaction
CHI 2016 Workshop: Future of Human-Building Interaction
Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions
Proceedings of CHI 2015
Towards Automated Thermal Profiling of Buildings at Scale Using Unmanned Aerial Vehicles and 3D-Reconstruction
Poster Proceedings of UbiComp 2014
Recent Videos
Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions
Proceedings of CHI 2015
Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions
Design Probes Video Figure
Recent Talks
Designing and Evaluating Next-Generation Thermographic Systems to Support Residential Energy Audits
Aug. 1, 2018 University of Maryland, College Park
Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study
May 9, 2017 Denver, Colorado, USA
Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions
April 22, 2015 Seoul, Republic of Korea
Photo Gallery
Current Project Members
Jon E. Froehlich
Jan 2014 - PresentPI | Assistant Professor
Computer Science
University of Maryland
Past Project Members
Manaswi Saha
Aug 2015 - Jan 2017PhD Student
Computer Science & Engineering
University of Washington
