A 360-Degree Video Analytics Service for In-Classroom Firefighter Training

Ayush Sarkar, Anh Nguyen, Zhisheng Yan, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Demonstrating firefighting operations in search and rescue missions through videos is a common approach to in-classroom firefighter training. Unfortunately, traditional 2D cameras have fundamental weaknesses - they can only capture a narrow field of view and miss a lot of information coming from the surroundings of the firefighter, which may become the matter of life and death in certain situations. In this paper, we propose a system combining the advantage of 360° videos and deep learning to automatically detect important objects in the panoramic scene, assisting firefighting instructors in classroom teaching scenarios. Specifically, we summarize the salient objects and events relevant to firefighting through an interview with an experienced firefighting instructor. Leveraging this knowledge, we investigate the detection of firefighting objects on 360° videos through a transfer learning approach. We report insightful results for object detectors trained on generic objects and 2D videos and discuss the next steps in designing a customized object detector.

Original languageEnglish (US)
Title of host publicationProceedings - 1st Workshop on Cyber Physical Systems for Emergency Response, CPS-ER 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages13-18
Number of pages6
ISBN (Electronic)9781665470360
DOIs
StatePublished - 2022
Event1st Workshop on Cyber Physical Systems for Emergency Response, CPS-ER 2022 - Virtual, Online, Italy
Duration: May 3 2022 → …

Publication series

NameProceedings - 1st Workshop on Cyber Physical Systems for Emergency Response, CPS-ER 2022

Conference

Conference1st Workshop on Cyber Physical Systems for Emergency Response, CPS-ER 2022
Country/TerritoryItaly
CityVirtual, Online
Period5/3/22 → …

Keywords

  • 360° video
  • firefighting
  • object detection

ASJC Scopus subject areas

  • Safety, Risk, Reliability and Quality
  • Public Administration
  • Artificial Intelligence
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'A 360-Degree Video Analytics Service for In-Classroom Firefighter Training'. Together they form a unique fingerprint.

Cite this