Optimizing cost of serverless computing through function fusion and placement

Tarek Elgamal, Atul Sandur, Klara Nahrstedt, Gul Agha

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Serverless computing has recently experienced significant adoption by several applications, especially Internet of Things (IoT) applications. In serverless computing, rather than deploying and managing dedicated virtual machines, users are able to deploy individual functions, and pay only for the time that their code is actually executing. However, since serverless platforms are relatively new, they have a completely different pricing model that depends on the memory, duration, and the number of executions of a sequence/workflow of functions. In this paper we present an algorithm that optimizes the price of serverless applications in AWS Lambda. We first describe the factors affecting price of serverless applications which include: (1) fusing a sequence of functions, (2) splitting functions across edge and cloud resources, and (3) allocating the memory for each function. We then present an efficient algorithm to explore different function fusion-placement solutions and find the solution that optimizes the application’s price while keeping the latency under a certain threshold. Our results on image processing workflows show that the algorithm can find solutions optimizing the price by more than 35%-57% with only 5%-15% increase in latency. We also show that our algorithm can find non-trivial memory configurations that reduce both latency and price.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 3rd ACM/IEEE Symposium on Edge Computing, SEC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages300-312
Number of pages13
ISBN (Electronic)9781538694459
DOIs
StatePublished - Dec 6 2018
Event3rd ACM/IEEE Symposium on Edge Computing, SEC 2018 - Bellevue, United States
Duration: Oct 25 2018Oct 27 2018

Publication series

NameProceedings - 2018 3rd ACM/IEEE Symposium on Edge Computing, SEC 2018

Other

Other3rd ACM/IEEE Symposium on Edge Computing, SEC 2018
Country/TerritoryUnited States
CityBellevue
Period10/25/1810/27/18

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Safety, Risk, Reliability and Quality
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Optimizing cost of serverless computing through function fusion and placement'. Together they form a unique fingerprint.

Cite this