Change-point estimation of high-dimensional streaming data via sketching

Yuejie Chi, Yihong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Change-point detection is of great interest in applications such as target tracking, anomaly detection and trend filtering. In many cases, it is also desirable to localize the change- point, if it exists. Motivated by the unprecedented scale and rate of modern high-dimensional streaming data, we propose a change-point detection and estimation procedure based on data sketching, which only requires a single sketch per high- dimensional data vector, by cyclically applying a small set of Gaussian sketching vectors. We demonstrate that when the underlying changes exhibit certain low-dimensional structures, such as sparsity, and the signal-to-noise ratio is not too small, the change-points can be reliably detected and located with a small number of sketching vectors based on filtering via convex optimization. Our procedure can be implemented in an online fashion to handle multiple change-points, since it sequentially operates on small windows of observations.

Original languageEnglish (US)
Title of host publicationConference Record of the 49th Asilomar Conference on Signals, Systems and Computers, ACSSC 2015
EditorsMichael B. Matthews
PublisherIEEE Computer Society
Pages102-106
Number of pages5
ISBN (Electronic)9781467385763
DOIs
StatePublished - Feb 26 2016
Event49th Asilomar Conference on Signals, Systems and Computers, ACSSC 2015 - Pacific Grove, United States
Duration: Nov 8 2015Nov 11 2015

Publication series

NameConference Record - Asilomar Conference on Signals, Systems and Computers
Volume2016-February
ISSN (Print)1058-6393

Other

Other49th Asilomar Conference on Signals, Systems and Computers, ACSSC 2015
Country/TerritoryUnited States
CityPacific Grove
Period11/8/1511/11/15

Keywords

  • atomic norm
  • change-point detection
  • sketching
  • streaming data

ASJC Scopus subject areas

  • Signal Processing
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Change-point estimation of high-dimensional streaming data via sketching'. Together they form a unique fingerprint.

Cite this