TY - GEN
T1 - Exploring the Efficiency of Renewable Energy-based Modular Data Centers at Scale
AU - Sun, Jinghan
AU - Gong, Zibo
AU - Agarwal, Anup
AU - Noghabi, Shadi
AU - Chandra, Ranveer
AU - Snir, Marc
AU - Huang, Jian
N1 - We thank the anonymous reviewers and our shepherd Prashant Shenoy for their insightful comments and feedback. We also thank the members in the Systems Platform Research Group at University of Illinois Urbana-Champaign for discussing and proofreading this paper. They include Daixuan Li, Shaobo Li, Benjamin Reidys, Haoyang Zhang, and Yiqi Liu. This work was partially supported by NSF grant CCF- 1919044.
PY - 2024/11/20
Y1 - 2024/11/20
N2 - Modular data centers (MDCs) that can be placed right at the energy farms and powered mostly by renewable energy, is a flexible and effective approach to lowering the carbon footprint of data centers. However, the main challenge of using renewable energy is the high variability of power produced, which implies large volatility in powering computing resources at MDCs, and degraded application performance due to the task evictions and migrations. This causes challenges for platform operators to decide the MDC deployment. To this end, we present SkyBox, a framework that employs a learning-based approach for platform operators to explore the efficient use of renewable energy with MDC deployment across geographical regions. SkyBox is driven by the insights based on our study of real-world power traces from a variety of renewable energy farms - the predictable production of renewable energy and the complementary nature of energy production patterns across different renewable energy sources and locations. With these insights, SkyBox uses the coefficient of variation metric to select the qualified renewable farms, it can identify a set of farms with complementary energy production patterns with a subgraph identification algorithm. After that, SkyBox enables smart workload placement and migrations to further tolerate the power variability. Our experiments with real power traces and datacenter workloads show that SkyBox has the lowest carbon emissions compared with existing approaches. SkyBox also minimizes the negative impact of the power variability on cloud applications, enabling it an effective solution of utilizing renewable energy for modern data centers.
AB - Modular data centers (MDCs) that can be placed right at the energy farms and powered mostly by renewable energy, is a flexible and effective approach to lowering the carbon footprint of data centers. However, the main challenge of using renewable energy is the high variability of power produced, which implies large volatility in powering computing resources at MDCs, and degraded application performance due to the task evictions and migrations. This causes challenges for platform operators to decide the MDC deployment. To this end, we present SkyBox, a framework that employs a learning-based approach for platform operators to explore the efficient use of renewable energy with MDC deployment across geographical regions. SkyBox is driven by the insights based on our study of real-world power traces from a variety of renewable energy farms - the predictable production of renewable energy and the complementary nature of energy production patterns across different renewable energy sources and locations. With these insights, SkyBox uses the coefficient of variation metric to select the qualified renewable farms, it can identify a set of farms with complementary energy production patterns with a subgraph identification algorithm. After that, SkyBox enables smart workload placement and migrations to further tolerate the power variability. Our experiments with real power traces and datacenter workloads show that SkyBox has the lowest carbon emissions compared with existing approaches. SkyBox also minimizes the negative impact of the power variability on cloud applications, enabling it an effective solution of utilizing renewable energy for modern data centers.
KW - Renewable energy
KW - cloud computing
KW - modular data center
KW - workload scheduling
UR - https://www.scopus.com/pages/publications/85215533769
UR - https://www.scopus.com/pages/publications/85215533769#tab=citedBy
U2 - 10.1145/3698038.3698544
DO - 10.1145/3698038.3698544
M3 - Conference contribution
AN - SCOPUS:85215533769
T3 - SoCC 2024 - Proceedings of the 2024 ACM Symposium on Cloud Computing
SP - 552
EP - 569
BT - SoCC 2024 - Proceedings of the 2024 ACM Symposium on Cloud Computing
PB - Association for Computing Machinery
T2 - 15th Annual ACM Symposium on Cloud Computing, SoCC 2024
Y2 - 20 November 2024 through 22 November 2024
ER -