Hands off the wheel in autonomous vehicles?: A systems perspective on over a million miles of field data

Subho S. Banerjee; Saurabh Jha; James Cyriac; Zbigniew T. Kalbarczyk; Ravishankar K. Iyer

doi:10.1109/DSN.2018.00066

Hands off the wheel in autonomous vehicles? A systems perspective on over a million miles of field data

Subho S. Banerjee, Saurabh Jha, James Cyriac, Zbigniew T. Kalbarczyk, Ravishankar K. Iyer

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Autonomous vehicle (AV) technology is rapidly becoming a reality on U.S. roads, offering the promise of improvements in traffic management, safety, and the comfort and efficiency of vehicular travel. The California Department of Motor Vehicles (DMV) reports that between 2014 and 2017, manufacturers tested 144 AVs, driving a cumulative 1,116,605 autonomous miles, and reported 5,328 disengagements and 42 accidents involving AVs on public roads. This paper investigates the causes, dynamics, and impacts of such AV failures by analyzing disengagement and accident reports obtained from public DMV databases. We draw several conclusions. For example, we find that autonomous vehicles are 15 - 4000Ã - worse than human drivers for accidents per cumulative mile driven; that drivers of AVs need to be as alert as drivers of non-AVs; and that the AVs' machine-learning-based systems for perception and decision-and-control are the primary cause of 64% of all disengagements.

Original language	English (US)
Title of host publication	Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	586-597
Number of pages	12
ISBN (Electronic)	9781538655955
DOIs	https://doi.org/10.1109/DSN.2018.00066
State	Published - Jul 19 2018
Event	48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018 - Luxembourg City, Luxembourg Duration: Jun 25 2018 → Jun 28 2018

Publication series

Name	Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018

Other

Other	48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018
Country/Territory	Luxembourg
City	Luxembourg City
Period	6/25/18 → 6/28/18

Keywords

Accident
Autonomous Vehicles
Disengagement
Fault Characterization
Reliability

ASJC Scopus subject areas

Safety, Risk, Reliability and Quality
Computer Networks and Communications
Hardware and Architecture
Energy Engineering and Power Technology

Online availability

10.1109/DSN.2018.00066

Library availability

Discover UIUC Full Text

Cite this

Banerjee, S. S., Jha, S., Cyriac, J., Kalbarczyk, Z. T., & Iyer, R. K. (2018). Hands off the wheel in autonomous vehicles? A systems perspective on over a million miles of field data. In Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018 (pp. 586-597). Article 8416518 (Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/DSN.2018.00066

Hands off the wheel in autonomous vehicles? A systems perspective on over a million miles of field data. / Banerjee, Subho S.; Jha, Saurabh; Cyriac, James et al.
Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 586-597 8416518 (Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Banerjee, SS, Jha, S, Cyriac, J, Kalbarczyk, ZT & Iyer, RK 2018, Hands off the wheel in autonomous vehicles? A systems perspective on over a million miles of field data. in Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018., 8416518, Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018, Institute of Electrical and Electronics Engineers Inc., pp. 586-597, 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018, Luxembourg City, Luxembourg, 6/25/18. https://doi.org/10.1109/DSN.2018.00066

Banerjee SS, Jha S, Cyriac J, Kalbarczyk ZT , Iyer RK. Hands off the wheel in autonomous vehicles? A systems perspective on over a million miles of field data. In Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 586-597. 8416518. (Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018). doi: 10.1109/DSN.2018.00066

Banerjee, Subho S. ; Jha, Saurabh ; Cyriac, James et al. / Hands off the wheel in autonomous vehicles? A systems perspective on over a million miles of field data. Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 586-597 (Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018).

@inproceedings{6a01c2943dde43679908f9b3a8dd8a2d,

title = "Hands off the wheel in autonomous vehicles?: A systems perspective on over a million miles of field data",

abstract = "Autonomous vehicle (AV) technology is rapidly becoming a reality on U.S. roads, offering the promise of improvements in traffic management, safety, and the comfort and efficiency of vehicular travel. The California Department of Motor Vehicles (DMV) reports that between 2014 and 2017, manufacturers tested 144 AVs, driving a cumulative 1,116,605 autonomous miles, and reported 5,328 disengagements and 42 accidents involving AVs on public roads. This paper investigates the causes, dynamics, and impacts of such AV failures by analyzing disengagement and accident reports obtained from public DMV databases. We draw several conclusions. For example, we find that autonomous vehicles are 15 - 4000{\~A} - worse than human drivers for accidents per cumulative mile driven; that drivers of AVs need to be as alert as drivers of non-AVs; and that the AVs' machine-learning-based systems for perception and decision-and-control are the primary cause of 64% of all disengagements.",

keywords = "Accident, Autonomous Vehicles, Disengagement, Fault Characterization, Reliability",

author = "Banerjee, {Subho S.} and Saurabh Jha and James Cyriac and Kalbarczyk, {Zbigniew T.} and Iyer, {Ravishankar K.}",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE.; 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018 ; Conference date: 25-06-2018 Through 28-06-2018",

year = "2018",

month = jul,

day = "19",

doi = "10.1109/DSN.2018.00066",

language = "English (US)",

series = "Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "586--597",

booktitle = "Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018",

address = "United States",

}

TY - GEN

T1 - Hands off the wheel in autonomous vehicles?

T2 - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018

AU - Banerjee, Subho S.

AU - Jha, Saurabh

AU - Cyriac, James

AU - Kalbarczyk, Zbigniew T.

AU - Iyer, Ravishankar K.

PY - 2018/7/19

Y1 - 2018/7/19

N2 - Autonomous vehicle (AV) technology is rapidly becoming a reality on U.S. roads, offering the promise of improvements in traffic management, safety, and the comfort and efficiency of vehicular travel. The California Department of Motor Vehicles (DMV) reports that between 2014 and 2017, manufacturers tested 144 AVs, driving a cumulative 1,116,605 autonomous miles, and reported 5,328 disengagements and 42 accidents involving AVs on public roads. This paper investigates the causes, dynamics, and impacts of such AV failures by analyzing disengagement and accident reports obtained from public DMV databases. We draw several conclusions. For example, we find that autonomous vehicles are 15 - 4000Ã - worse than human drivers for accidents per cumulative mile driven; that drivers of AVs need to be as alert as drivers of non-AVs; and that the AVs' machine-learning-based systems for perception and decision-and-control are the primary cause of 64% of all disengagements.

AB - Autonomous vehicle (AV) technology is rapidly becoming a reality on U.S. roads, offering the promise of improvements in traffic management, safety, and the comfort and efficiency of vehicular travel. The California Department of Motor Vehicles (DMV) reports that between 2014 and 2017, manufacturers tested 144 AVs, driving a cumulative 1,116,605 autonomous miles, and reported 5,328 disengagements and 42 accidents involving AVs on public roads. This paper investigates the causes, dynamics, and impacts of such AV failures by analyzing disengagement and accident reports obtained from public DMV databases. We draw several conclusions. For example, we find that autonomous vehicles are 15 - 4000Ã - worse than human drivers for accidents per cumulative mile driven; that drivers of AVs need to be as alert as drivers of non-AVs; and that the AVs' machine-learning-based systems for perception and decision-and-control are the primary cause of 64% of all disengagements.

KW - Accident

KW - Autonomous Vehicles

KW - Disengagement

KW - Fault Characterization

KW - Reliability

UR - http://www.scopus.com/inward/record.url?scp=85051079564&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051079564&partnerID=8YFLogxK

U2 - 10.1109/DSN.2018.00066

DO - 10.1109/DSN.2018.00066

M3 - Conference contribution

AN - SCOPUS:85051079564

T3 - Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018

SP - 586

EP - 597

BT - Proceedings - 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2018

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 25 June 2018 through 28 June 2018

ER -