Autonomous delay regulation for multi-threaded internet servers

Jin Heo, Xue Liu, Lui Sha, Tarek F. Abdelzaher

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

How to properly assign system resources to satisfy the Service Level Agreement (SLA) is a challenging research problem. Previous approaches include queuing model based feedback control strategies with queuing predictor for feed-forward delay prediction. However, ignorance of the multi-threaded nature can induce large model errors. To compensate this, previous approaches typically perform offline identification, thus making the system dependent on a particular workload and a specific Internet application. In this paper, we propose a novel framework for autonomous delay regulation for multi-threaded Internet servers. We formulate a processor-sharing queuing model for the multi-threaded server architecture to precisely predict service rate for worker threads. In addition, the proposed scheme uses the sleep actuator to properly assign resources based on the calculated service rale. We evaluate our techniques experimentally using an Apache web server test-bed. We demonstrate that the proposed strategy performs better than the previous approaches under a realistic workload.

Original languageEnglish (US)
Title of host publicationInternational Symposium on Performance Evaluation of Computer and Telecommunication Systems 2006, SPECTS'06, Part of the 2006 Summer Simulation Multiconference, SummerSim'06
Pages465-472
Number of pages8
StatePublished - 2006
EventInternational Symposium on Performance Evaluation of Computer and Telecommunication Systems 2006, SPECTS 2006, Part of the 2006 Summer Simulation Multiconference, SummerSim 2006 - Calgary, AB, Canada
Duration: Jul 31 2006Aug 2 2006

Publication series

NameInternational Symposium on Performance Evaluation of Computer and Telecommunication Systems 2006, SPECTS'06, Part of the 2006 Summer Simulation Multiconference, SummerSim'06

Other

OtherInternational Symposium on Performance Evaluation of Computer and Telecommunication Systems 2006, SPECTS 2006, Part of the 2006 Summer Simulation Multiconference, SummerSim 2006
CountryCanada
CityCalgary, AB
Period7/31/068/2/06

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Modeling and Simulation

Fingerprint Dive into the research topics of 'Autonomous delay regulation for multi-threaded internet servers'. Together they form a unique fingerprint.

Cite this