Real-time dynamic 3D view for tactical weather avoidance using head tracking

Christopher Nusbaum, Daniela Kratchounova, Jason M Merret, Albert Helfrick, James Ladesic

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Today, some of the more advanced flight decks are equipped with both a lateral and vertical presentation of weather products (e.g. ownship RADAR) on a multi-function display (MFD). The lateral view is overlaid on a map display, whereas the vertical view is on a separate vertical situation display (VSD). This requires the pilots to integrate the two views in order to build a good mental picture of the weather situation along the flight path. The goal of this study is to evaluate the feasibility and utility of a real-time tactical weather avoidance concept that would provide decision-making support to flight crews by the application of head tracking technology. Specifically, the intended function of the system is to support flight crews in making tactical weather avoidance decisions by using a three dimensional (3D) real-time, dynamic weather view integrated into a synthetic vision (SV) primary flight display (PFD) controlled by head tracking technology. This would allow flight crews to 'look around' into, above, and below a weather system along the flight path in a real-time, dynamic 3D presentation. The use of head tracking technology would eliminate the need for a designated control of this added functionality because the head movements will be automatically translated into a real-time, dynamic view of the area of interest (e.g. a system of thunderstorms). The results of the proof of concept evaluation supported the notion that providing the capability to look around and accurately assess the position of objects/events (e.g., weather phenomena, obstacles, traffic) along the flight path within a synthetic vision display has the potential to optimize the pilot decision-making process during elevated workload situations (such as flight adverse weather avoidance).

Original languageEnglish (US)
Title of host publication2017 IEEE/AIAA 36th Digital Avionics Systems Conference, DASC 2017 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Volume2017-September
ISBN (Electronic)9781538603659
DOIs
StatePublished - Nov 8 2017
Externally publishedYes
Event36th IEEE/AIAA Digital Avionics Systems Conference, DASC 2017 - St. Petersburg, United States
Duration: Sep 17 2017Sep 21 2017

Other

Other36th IEEE/AIAA Digital Avionics Systems Conference, DASC 2017
CountryUnited States
CitySt. Petersburg
Period9/17/179/21/17

Fingerprint

Display devices
Flight paths
Decision making
Thunderstorms

ASJC Scopus subject areas

  • Aerospace Engineering
  • Electrical and Electronic Engineering

Cite this

Nusbaum, C., Kratchounova, D., Merret, J. M., Helfrick, A., & Ladesic, J. (2017). Real-time dynamic 3D view for tactical weather avoidance using head tracking. In 2017 IEEE/AIAA 36th Digital Avionics Systems Conference, DASC 2017 - Proceedings (Vol. 2017-September). [8102061] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/DASC.2017.8102061

Real-time dynamic 3D view for tactical weather avoidance using head tracking. / Nusbaum, Christopher; Kratchounova, Daniela; Merret, Jason M; Helfrick, Albert; Ladesic, James.

2017 IEEE/AIAA 36th Digital Avionics Systems Conference, DASC 2017 - Proceedings. Vol. 2017-September Institute of Electrical and Electronics Engineers Inc., 2017. 8102061.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nusbaum, C, Kratchounova, D, Merret, JM, Helfrick, A & Ladesic, J 2017, Real-time dynamic 3D view for tactical weather avoidance using head tracking. in 2017 IEEE/AIAA 36th Digital Avionics Systems Conference, DASC 2017 - Proceedings. vol. 2017-September, 8102061, Institute of Electrical and Electronics Engineers Inc., 36th IEEE/AIAA Digital Avionics Systems Conference, DASC 2017, St. Petersburg, United States, 9/17/17. https://doi.org/10.1109/DASC.2017.8102061
Nusbaum C, Kratchounova D, Merret JM, Helfrick A, Ladesic J. Real-time dynamic 3D view for tactical weather avoidance using head tracking. In 2017 IEEE/AIAA 36th Digital Avionics Systems Conference, DASC 2017 - Proceedings. Vol. 2017-September. Institute of Electrical and Electronics Engineers Inc. 2017. 8102061 https://doi.org/10.1109/DASC.2017.8102061
Nusbaum, Christopher ; Kratchounova, Daniela ; Merret, Jason M ; Helfrick, Albert ; Ladesic, James. / Real-time dynamic 3D view for tactical weather avoidance using head tracking. 2017 IEEE/AIAA 36th Digital Avionics Systems Conference, DASC 2017 - Proceedings. Vol. 2017-September Institute of Electrical and Electronics Engineers Inc., 2017.
@inproceedings{02b26277f086471abb76e92b55e906c7,
title = "Real-time dynamic 3D view for tactical weather avoidance using head tracking",
abstract = "Today, some of the more advanced flight decks are equipped with both a lateral and vertical presentation of weather products (e.g. ownship RADAR) on a multi-function display (MFD). The lateral view is overlaid on a map display, whereas the vertical view is on a separate vertical situation display (VSD). This requires the pilots to integrate the two views in order to build a good mental picture of the weather situation along the flight path. The goal of this study is to evaluate the feasibility and utility of a real-time tactical weather avoidance concept that would provide decision-making support to flight crews by the application of head tracking technology. Specifically, the intended function of the system is to support flight crews in making tactical weather avoidance decisions by using a three dimensional (3D) real-time, dynamic weather view integrated into a synthetic vision (SV) primary flight display (PFD) controlled by head tracking technology. This would allow flight crews to 'look around' into, above, and below a weather system along the flight path in a real-time, dynamic 3D presentation. The use of head tracking technology would eliminate the need for a designated control of this added functionality because the head movements will be automatically translated into a real-time, dynamic view of the area of interest (e.g. a system of thunderstorms). The results of the proof of concept evaluation supported the notion that providing the capability to look around and accurately assess the position of objects/events (e.g., weather phenomena, obstacles, traffic) along the flight path within a synthetic vision display has the potential to optimize the pilot decision-making process during elevated workload situations (such as flight adverse weather avoidance).",
author = "Christopher Nusbaum and Daniela Kratchounova and Merret, {Jason M} and Albert Helfrick and James Ladesic",
year = "2017",
month = "11",
day = "8",
doi = "10.1109/DASC.2017.8102061",
language = "English (US)",
volume = "2017-September",
booktitle = "2017 IEEE/AIAA 36th Digital Avionics Systems Conference, DASC 2017 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - Real-time dynamic 3D view for tactical weather avoidance using head tracking

AU - Nusbaum, Christopher

AU - Kratchounova, Daniela

AU - Merret, Jason M

AU - Helfrick, Albert

AU - Ladesic, James

PY - 2017/11/8

Y1 - 2017/11/8

N2 - Today, some of the more advanced flight decks are equipped with both a lateral and vertical presentation of weather products (e.g. ownship RADAR) on a multi-function display (MFD). The lateral view is overlaid on a map display, whereas the vertical view is on a separate vertical situation display (VSD). This requires the pilots to integrate the two views in order to build a good mental picture of the weather situation along the flight path. The goal of this study is to evaluate the feasibility and utility of a real-time tactical weather avoidance concept that would provide decision-making support to flight crews by the application of head tracking technology. Specifically, the intended function of the system is to support flight crews in making tactical weather avoidance decisions by using a three dimensional (3D) real-time, dynamic weather view integrated into a synthetic vision (SV) primary flight display (PFD) controlled by head tracking technology. This would allow flight crews to 'look around' into, above, and below a weather system along the flight path in a real-time, dynamic 3D presentation. The use of head tracking technology would eliminate the need for a designated control of this added functionality because the head movements will be automatically translated into a real-time, dynamic view of the area of interest (e.g. a system of thunderstorms). The results of the proof of concept evaluation supported the notion that providing the capability to look around and accurately assess the position of objects/events (e.g., weather phenomena, obstacles, traffic) along the flight path within a synthetic vision display has the potential to optimize the pilot decision-making process during elevated workload situations (such as flight adverse weather avoidance).

AB - Today, some of the more advanced flight decks are equipped with both a lateral and vertical presentation of weather products (e.g. ownship RADAR) on a multi-function display (MFD). The lateral view is overlaid on a map display, whereas the vertical view is on a separate vertical situation display (VSD). This requires the pilots to integrate the two views in order to build a good mental picture of the weather situation along the flight path. The goal of this study is to evaluate the feasibility and utility of a real-time tactical weather avoidance concept that would provide decision-making support to flight crews by the application of head tracking technology. Specifically, the intended function of the system is to support flight crews in making tactical weather avoidance decisions by using a three dimensional (3D) real-time, dynamic weather view integrated into a synthetic vision (SV) primary flight display (PFD) controlled by head tracking technology. This would allow flight crews to 'look around' into, above, and below a weather system along the flight path in a real-time, dynamic 3D presentation. The use of head tracking technology would eliminate the need for a designated control of this added functionality because the head movements will be automatically translated into a real-time, dynamic view of the area of interest (e.g. a system of thunderstorms). The results of the proof of concept evaluation supported the notion that providing the capability to look around and accurately assess the position of objects/events (e.g., weather phenomena, obstacles, traffic) along the flight path within a synthetic vision display has the potential to optimize the pilot decision-making process during elevated workload situations (such as flight adverse weather avoidance).

UR - http://www.scopus.com/inward/record.url?scp=85040995893&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85040995893&partnerID=8YFLogxK

U2 - 10.1109/DASC.2017.8102061

DO - 10.1109/DASC.2017.8102061

M3 - Conference contribution

AN - SCOPUS:85040995893

VL - 2017-September

BT - 2017 IEEE/AIAA 36th Digital Avionics Systems Conference, DASC 2017 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -