This paper investigates SLA violations of a production SaaS platform by means of joint use of field failure data analysis (FFDA) and fault injection. The objective of this study is to diagnose the causes of SLA violations, pinpoint critical failure modes under realistic error assumptions and identify potential means to increase the user perceived availability of the platform and assurance of SLA requirements. We base our study on 283 days of logs obtained during the production time of the platform, while it was employed to process business data received by 42 customers in 22 countries. In this paper, we develop a set of tools that include i) a FFDA toolset used to analyze the data extracted from the platform and by the operating system event logs and ii) a. NET/C++ injector able to automate the injection of specific runtime errors in the production code and the collection of results. Major findings include i) 93% of all service level agreement (SLA) violations were due to system failures, ii) there were a few cases of bursts of SLA violations that could not be diagnosed from the logs and were revealed from the performed injections, and iii) the error injection revealed several error propagation paths leading to data corruptions that could not be detected from the analysis of failure data.
|Original language||English (US)|
|Number of pages||11|
|Journal||Proceedings - International Symposium on Software Reliability Engineering, ISSRE|
|State||Published - Dec 11 2014|
|Event||25th IEEE International Symposium on Software Reliability Engineering, ISSRE 2014 - Naples, Italy|
Duration: Nov 3 2014 → Nov 6 2014
- SLA violations
- empirical reliability
- fault injection
- hazard analysis
- log analysis
ASJC Scopus subject areas
- Safety, Risk, Reliability and Quality
Analysis and diagnosis of SLA violations in a production saas cloud. / Martino, Catello Di; Chen, Daniel; Goel, Geetika; Ganesan, Rajeshwari; Kalbarczyk, Zbigniew T; Iyer, Ravishankar K.In: Proceedings - International Symposium on Software Reliability Engineering, ISSRE, 11.12.2014, p. 178-188.
Research output: Contribution to journal › Conference article