Interacting Tracklets for Multi-Object Tracking

Long Lan, Xinchao Wang, Shiliang Zhang, Dacheng Tao, Wen Gao, Thomas S. Huang

Research output: Contribution to journalArticlepeer-review


In this paper, we propose to exploit the interactions between non-associable tracklets to facilitate multi-object tracking. We introduce two types of tracklet interactions, close interaction and distant interaction. The close interaction imposes physical constraints between two temporally overlapping tracklets, and more importantly, allows us to learn local classifiers to distinguish targets that are close to each other in the spatiotemporal domain. The distant interaction, on the other hand, accounts for the higher order motion and appearance consistency between two temporally isolated tracklets. Our approach is modeled as a binary labeling problem and solved using the efficient quadratic pseudo-Boolean optimization. It yields promising tracking performance on the challenging PETS09 and MOT16 dataset.

Original languageEnglish (US)
Pages (from-to)4585-4597
Number of pages13
JournalIEEE Transactions on Image Processing
Issue number9
StatePublished - Sep 2018


  • Multi-object tracking
  • interactions
  • tracklets

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Interacting Tracklets for Multi-Object Tracking'. Together they form a unique fingerprint.

Cite this