Grand challenge: MtDetector: A high-performance marine traic detector at stream scale

Chun Xun Lin, Tsung Wei Huang, Guannan Guo, Martin D.F. Wong

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we present MtDetector, a high performance marine trac detector that can predict the destination and the arrival time of travelling vessels. MtDetector accepts streaming data reported by the moving vessels and generates continuous predictions of the arrival port and arrival time for those vessels. To predict the destination for a ship, MtDetector builds a neural network for every port and infers the arrival port for vessels based on their departure port. For the arrival time prediction, we derive informative features from training data and apply Deep Neural Network (DNN) to estimate the traveling time. MtDetector is built on top of DtCraft [1, 2], a high-performance distributed execution engine for stream programming. By utilizing the task-based parallelism in DtCraft, MtDetector can process multiple predictions concurrently to achieve high throughput and low latency.

Original languageEnglish (US)
Title of host publicationDEBS 2018 - Proceedings of the 12th ACM International Conference on Distributed and Event-Based Systems
PublisherAssociation for Computing Machinery
Pages205-208
Number of pages4
ISBN (Electronic)9781450357821
DOIs
StatePublished - Jun 25 2018
Event12th ACM International Conference on Distributed and Event-Based Systems, DEBS 2018 - Hamilton, New Zealand
Duration: Jun 25 2018Jun 26 2018

Publication series

NameDEBS 2018 - Proceedings of the 12th ACM International Conference on Distributed and Event-Based Systems

Other

Other12th ACM International Conference on Distributed and Event-Based Systems, DEBS 2018
Country/TerritoryNew Zealand
CityHamilton
Period6/25/186/26/18

Keywords

  • Distributed System
  • Machine Learning
  • Marine Trac
  • Stream Processing

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Networks and Communications
  • Software
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Grand challenge: MtDetector: A high-performance marine traic detector at stream scale'. Together they form a unique fingerprint.

Cite this