Analysis and diagnosis of SLA violations in a production saas cloud

Catello Di Martino, Daniel Chen, Geetika Goel, Rajeshwari Ganesan, Zbigniew T Kalbarczyk, Ravishankar K Iyer

Research output: Contribution to journalConference articlepeer-review

Abstract

This paper investigates SLA violations of a production SaaS platform by means of joint use of field failure data analysis (FFDA) and fault injection. The objective of this study is to diagnose the causes of SLA violations, pinpoint critical failure modes under realistic error assumptions and identify potential means to increase the user perceived availability of the platform and assurance of SLA requirements. We base our study on 283 days of logs obtained during the production time of the platform, while it was employed to process business data received by 42 customers in 22 countries. In this paper, we develop a set of tools that include i) a FFDA toolset used to analyze the data extracted from the platform and by the operating system event logs and ii) a. NET/C++ injector able to automate the injection of specific runtime errors in the production code and the collection of results. Major findings include i) 93% of all service level agreement (SLA) violations were due to system failures, ii) there were a few cases of bursts of SLA violations that could not be diagnosed from the logs and were revealed from the performed injections, and iii) the error injection revealed several error propagation paths leading to data corruptions that could not be detected from the analysis of failure data.

Original languageEnglish (US)
Article number6982625
Pages (from-to)178-188
Number of pages11
JournalProceedings - International Symposium on Software Reliability Engineering, ISSRE
DOIs
StatePublished - Dec 11 2014
Event25th IEEE International Symposium on Software Reliability Engineering, ISSRE 2014 - Naples, Italy
Duration: Nov 3 2014Nov 6 2014

Keywords

  • SLA violations
  • SaaS
  • empirical reliability
  • fault injection
  • hazard analysis
  • log analysis

ASJC Scopus subject areas

  • Software
  • Safety, Risk, Reliability and Quality

Fingerprint Dive into the research topics of 'Analysis and diagnosis of SLA violations in a production saas cloud'. Together they form a unique fingerprint.

Cite this