Online VM Auto-Scaling Algorithms for Application Hosting in a Cloud

Yang Guo, Alexander Stolyar, Anwar Walid

Research output: Contribution to journalArticle

Abstract

We consider the auto-scaling problem for application hosting in a cloud, where applications are elastic and the number of requests changes over time. The application requests are serviced by Virtual Machines (VMs), which reside on Physical Machines (PMs) in a cloud. We aim to minimize the number of hosting PMs by intelligently packing VMs into PMs, while the VMs are auto-scaled, i.e., dynamically acquired and released, to accommodate varying application needs. We consider a shadow routing based approach for this problem. The proposed shadow algorithm employs a specially constructed virtual queueing system to dynamically produce an optimal solution that guides the VM auto-scaling and the VM-to-PM packing. The proposed algorithm runs continuously without the need to re-solve the underlying optimization problem "from scratch", and adapts automatically to the changes in the application demands. We prove the asymptotic optimality of the shadow algorithm. The simulation experiments further demonstrate the algorithm's good performance and high adaptivity.

Original languageEnglish (US)
JournalIEEE Transactions on Cloud Computing
DOIs
StateAccepted/In press - Apr 26 2018

Fingerprint

Virtual machine
Experiments

Keywords

  • Adaptation models
  • Cloud computing
  • Electronic mail
  • Heuristic algorithms
  • Optimization
  • Routing
  • Virtual machining

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Hardware and Architecture
  • Computer Science Applications
  • Computer Networks and Communications

Cite this

Online VM Auto-Scaling Algorithms for Application Hosting in a Cloud. / Guo, Yang; Stolyar, Alexander; Walid, Anwar.

In: IEEE Transactions on Cloud Computing, 26.04.2018.

Research output: Contribution to journalArticle

@article{b5e37c70ecf5439abe0f90df65836336,
title = "Online VM Auto-Scaling Algorithms for Application Hosting in a Cloud",
abstract = "We consider the auto-scaling problem for application hosting in a cloud, where applications are elastic and the number of requests changes over time. The application requests are serviced by Virtual Machines (VMs), which reside on Physical Machines (PMs) in a cloud. We aim to minimize the number of hosting PMs by intelligently packing VMs into PMs, while the VMs are auto-scaled, i.e., dynamically acquired and released, to accommodate varying application needs. We consider a shadow routing based approach for this problem. The proposed shadow algorithm employs a specially constructed virtual queueing system to dynamically produce an optimal solution that guides the VM auto-scaling and the VM-to-PM packing. The proposed algorithm runs continuously without the need to re-solve the underlying optimization problem {"}from scratch{"}, and adapts automatically to the changes in the application demands. We prove the asymptotic optimality of the shadow algorithm. The simulation experiments further demonstrate the algorithm's good performance and high adaptivity.",
keywords = "Adaptation models, Cloud computing, Electronic mail, Heuristic algorithms, Optimization, Routing, Virtual machining",
author = "Yang Guo and Alexander Stolyar and Anwar Walid",
year = "2018",
month = "4",
day = "26",
doi = "10.1109/TCC.2018.2830793",
language = "English (US)",
journal = "IEEE Transactions on Cloud Computing",
issn = "2168-7161",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Online VM Auto-Scaling Algorithms for Application Hosting in a Cloud

AU - Guo, Yang

AU - Stolyar, Alexander

AU - Walid, Anwar

PY - 2018/4/26

Y1 - 2018/4/26

N2 - We consider the auto-scaling problem for application hosting in a cloud, where applications are elastic and the number of requests changes over time. The application requests are serviced by Virtual Machines (VMs), which reside on Physical Machines (PMs) in a cloud. We aim to minimize the number of hosting PMs by intelligently packing VMs into PMs, while the VMs are auto-scaled, i.e., dynamically acquired and released, to accommodate varying application needs. We consider a shadow routing based approach for this problem. The proposed shadow algorithm employs a specially constructed virtual queueing system to dynamically produce an optimal solution that guides the VM auto-scaling and the VM-to-PM packing. The proposed algorithm runs continuously without the need to re-solve the underlying optimization problem "from scratch", and adapts automatically to the changes in the application demands. We prove the asymptotic optimality of the shadow algorithm. The simulation experiments further demonstrate the algorithm's good performance and high adaptivity.

AB - We consider the auto-scaling problem for application hosting in a cloud, where applications are elastic and the number of requests changes over time. The application requests are serviced by Virtual Machines (VMs), which reside on Physical Machines (PMs) in a cloud. We aim to minimize the number of hosting PMs by intelligently packing VMs into PMs, while the VMs are auto-scaled, i.e., dynamically acquired and released, to accommodate varying application needs. We consider a shadow routing based approach for this problem. The proposed shadow algorithm employs a specially constructed virtual queueing system to dynamically produce an optimal solution that guides the VM auto-scaling and the VM-to-PM packing. The proposed algorithm runs continuously without the need to re-solve the underlying optimization problem "from scratch", and adapts automatically to the changes in the application demands. We prove the asymptotic optimality of the shadow algorithm. The simulation experiments further demonstrate the algorithm's good performance and high adaptivity.

KW - Adaptation models

KW - Cloud computing

KW - Electronic mail

KW - Heuristic algorithms

KW - Optimization

KW - Routing

KW - Virtual machining

UR - http://www.scopus.com/inward/record.url?scp=85046353332&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85046353332&partnerID=8YFLogxK

U2 - 10.1109/TCC.2018.2830793

DO - 10.1109/TCC.2018.2830793

M3 - Article

AN - SCOPUS:85046353332

JO - IEEE Transactions on Cloud Computing

JF - IEEE Transactions on Cloud Computing

SN - 2168-7161

ER -