3D Detection and Tracking for On-road Vehicles with a Monovision Camera and Dual Low-cost 4D mmWave Radars

Hang Cui, Junzhe Wu, Jiaming Zhang, Girish Chowdhary, William R. Norris

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

High resolution 4D millimeter wave radar has been increasingly used for robust 3D detection and tracking of on-road vehicles. Rich point clouds generated by 4D radars can not only provide more reliable detection in harsh weather environments, but also offers 3D tracking capabilities for on-road objects. In this paper, a convolutional neural network (CNN) with cross fusion strategy is proposed for 3D on-road vehicle detection. The trained CNN model was also tested with dual low-cost 4D millimeter wave radars and a single monovision camera. An extended version of radar-camera calibration in three dimensions and 3D tracking with an extended Kalman filter (EKF) were also presented. The detection results showed that the proposed convolutional neural network model outperformed the one used on the Astyx dataset which provided up to 1500 radar detection points, on average, per frame.

Original languageEnglish (US)
Title of host publication2021 IEEE International Intelligent Transportation Systems Conference, ITSC 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2931-2937
Number of pages7
ISBN (Electronic)9781728191423
DOIs
StatePublished - Sep 19 2021
Event2021 IEEE International Intelligent Transportation Systems Conference, ITSC 2021 - Indianapolis, United States
Duration: Sep 19 2021Sep 22 2021

Publication series

NameIEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC
Volume2021-September

Conference

Conference2021 IEEE International Intelligent Transportation Systems Conference, ITSC 2021
Country/TerritoryUnited States
CityIndianapolis
Period9/19/219/22/21

Keywords

  • 3D detection and tracking
  • 4D radar
  • CNN
  • EKF

ASJC Scopus subject areas

  • Automotive Engineering
  • Mechanical Engineering
  • Computer Science Applications

Fingerprint

Dive into the research topics of '3D Detection and Tracking for On-road Vehicles with a Monovision Camera and Dual Low-cost 4D mmWave Radars'. Together they form a unique fingerprint.

Cite this