Real-time dynamic 3D view for tactical weather avoidance using head tracking

Christopher Nusbaum, Daniela Kratchounova, Jason Merret, Albert Helfrick, James Ladesic

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Today, some of the more advanced flight decks are equipped with both a lateral and vertical presentation of weather products (e.g. ownship RADAR) on a multi-function display (MFD). The lateral view is overlaid on a map display, whereas the vertical view is on a separate vertical situation display (VSD). This requires the pilots to integrate the two views in order to build a good mental picture of the weather situation along the flight path. The goal of this study is to evaluate the feasibility and utility of a real-time tactical weather avoidance concept that would provide decision-making support to flight crews by the application of head tracking technology. Specifically, the intended function of the system is to support flight crews in making tactical weather avoidance decisions by using a three dimensional (3D) real-time, dynamic weather view integrated into a synthetic vision (SV) primary flight display (PFD) controlled by head tracking technology. This would allow flight crews to 'look around' into, above, and below a weather system along the flight path in a real-time, dynamic 3D presentation. The use of head tracking technology would eliminate the need for a designated control of this added functionality because the head movements will be automatically translated into a real-time, dynamic view of the area of interest (e.g. a system of thunderstorms). The results of the proof of concept evaluation supported the notion that providing the capability to look around and accurately assess the position of objects/events (e.g., weather phenomena, obstacles, traffic) along the flight path within a synthetic vision display has the potential to optimize the pilot decision-making process during elevated workload situations (such as flight adverse weather avoidance).

Original languageEnglish (US)
Title of host publication2017 IEEE/AIAA 36th Digital Avionics Systems Conference, DASC 2017 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538603659
StatePublished - Nov 8 2017
Externally publishedYes
Event36th IEEE/AIAA Digital Avionics Systems Conference, DASC 2017 - St. Petersburg, United States
Duration: Sep 17 2017Sep 21 2017

Publication series

NameAIAA/IEEE Digital Avionics Systems Conference - Proceedings
ISSN (Print)2155-7195
ISSN (Electronic)2155-7209


Other36th IEEE/AIAA Digital Avionics Systems Conference, DASC 2017
Country/TerritoryUnited States
CitySt. Petersburg

ASJC Scopus subject areas

  • Aerospace Engineering
  • Electrical and Electronic Engineering


Dive into the research topics of 'Real-time dynamic 3D view for tactical weather avoidance using head tracking'. Together they form a unique fingerprint.

Cite this