Abstract
With the growing complexity in computer systems, it has been a real challenge to detect and diagnose problems in today's large-scale distributed systems. Usually, the correlations between measurements collected across the distributed system contain rich information about the system behaviors, and thus a reasonable model to describe such correlations is crucially important in detecting and locating system problems. In this paper, we propose a transition probability model based on markov properties to characterize pairwise measurement correlations. The proposed method can discover both the spatial (across system measurements) and temporal (across observation time) correlations, and thus such a model can successfully represent the system normal profiles. Problem determination and localization under this framework is fast and convenient. The framework is general enough to discover any types of correlations (e.g. linear or non-linear). Also, model updating, system problem detection and diagnosis can be conducted effectively and efficiently. Experimental results show that, the proposed method can detect the anomalous events and locate the problematic sources by analyzing the real monitoring data collected from three companies' infrastructures.
Original language | English (US) |
---|---|
Title of host publication | 2009 29th IEEE International Conference on Distributed Computing Systems Workshops, ICDCS, 09 |
Pages | 623-630 |
Number of pages | 8 |
DOIs | |
State | Published - 2009 |
Event | 2009 29th IEEE International Conference on Distributed Computing Systems Workshops, ICDCS, 09 - Montreal, QC, Canada Duration: Jun 22 2009 → Jun 26 2009 |
Other
Other | 2009 29th IEEE International Conference on Distributed Computing Systems Workshops, ICDCS, 09 |
---|---|
Country/Territory | Canada |
City | Montreal, QC |
Period | 6/22/09 → 6/26/09 |
ASJC Scopus subject areas
- Software
- Hardware and Architecture
- Computer Networks and Communications