Network Packet Processing Mode-Aware Power Management for Data Center Servers

Ki Dong Kang; Gyeongseo Park; Nam Sung Kim; Daehoon Kim

doi:10.1109/LCA.2019.2926079

Network Packet Processing Mode-Aware Power Management for Data Center Servers

Ki Dong Kang
, Gyeongseo Park
, Nam Sung Kim
, Daehoon Kim

Research output: Contribution to journal › Article › peer-review

Abstract

In data center servers, power management (PM) exploiting Dynamic Voltage and Frequency Scaling (DVFS) for processors can play a crucial role to improve energy efficiency. However, we observe that current PM policies (i.e., governors) not only considerably increase tail response time (i.e., violate a given Service Level Objective (SLO)) but also hurt energy efficiency. Tackling limitations of current PM governors, we propose NMAP, Network packet processing Mode-Aware Power management. NMAP improves energy efficiency while satisfying given SLOs, considering packet processing status on a core for PM by monitoring transitions between network packet processing modes - interrupt and polling. Tracking the transitions, NMAP detects moments that a core cannot process packets fast enough and forces the core to immediately raise the voltage and frequency (V/F) state. As a result, NMAP can provide not only low response time but also low energy consumption. Our experiment shows that NMAP improves tail response time by up to 4.1× compared with the ondemand governor, reducing energy by up to 44.6 percent compared with the performance governor.

Original language	English (US)
Article number	8752066
Pages (from-to)	1-4
Number of pages	4
Journal	IEEE Computer Architecture Letters
Volume	19
Issue number	1
DOIs	https://doi.org/10.1109/LCA.2019.2926079
State	Published - Jan 1 2020

Keywords

Data center server
dynamic voltage and frequency scaling
power management
tail latency

ASJC Scopus subject areas

Hardware and Architecture

Online availability

10.1109/LCA.2019.2926079

Library availability

Discover UIUC Full Text

Cite this

@article{1e9624a882614fbca0ea44d413356485,

title = "Network Packet Processing Mode-Aware Power Management for Data Center Servers",

abstract = "In data center servers, power management (PM) exploiting Dynamic Voltage and Frequency Scaling (DVFS) for processors can play a crucial role to improve energy efficiency. However, we observe that current PM policies (i.e., governors) not only considerably increase tail response time (i.e., violate a given Service Level Objective (SLO)) but also hurt energy efficiency. Tackling limitations of current PM governors, we propose NMAP, Network packet processing Mode-Aware Power management. NMAP improves energy efficiency while satisfying given SLOs, considering packet processing status on a core for PM by monitoring transitions between network packet processing modes - interrupt and polling. Tracking the transitions, NMAP detects moments that a core cannot process packets fast enough and forces the core to immediately raise the voltage and frequency (V/F) state. As a result, NMAP can provide not only low response time but also low energy consumption. Our experiment shows that NMAP improves tail response time by up to 4.1× compared with the ondemand governor, reducing energy by up to 44.6 percent compared with the performance governor.",

keywords = "Data center server, dynamic voltage and frequency scaling, power management, tail latency",

author = "Kang, \{Ki Dong\} and Gyeongseo Park and Kim, \{Nam Sung\} and Daehoon Kim",

note = "This research was supported in part by a National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. NRF-2017R1C1B2008571), an Institute for Information \& communications Technology Promotion(IITP) funded by the Korea government (MSIP) (No. 2014-0-00065, Resilient Cyber-Physical Systems Research), and NSF grants (CNS-1600669 and CNS-1557244).",

year = "2020",

month = jan,

day = "1",

doi = "10.1109/LCA.2019.2926079",

language = "English (US)",

volume = "19",

pages = "1--4",

journal = "IEEE Computer Architecture Letters",

issn = "1556-6056",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "1",

}

TY - JOUR

T1 - Network Packet Processing Mode-Aware Power Management for Data Center Servers

AU - Kang, Ki Dong

AU - Park, Gyeongseo

AU - Kim, Nam Sung

AU - Kim, Daehoon

N1 - This research was supported in part by a National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. NRF-2017R1C1B2008571), an Institute for Information & communications Technology Promotion(IITP) funded by the Korea government (MSIP) (No. 2014-0-00065, Resilient Cyber-Physical Systems Research), and NSF grants (CNS-1600669 and CNS-1557244).

PY - 2020/1/1

Y1 - 2020/1/1

N2 - In data center servers, power management (PM) exploiting Dynamic Voltage and Frequency Scaling (DVFS) for processors can play a crucial role to improve energy efficiency. However, we observe that current PM policies (i.e., governors) not only considerably increase tail response time (i.e., violate a given Service Level Objective (SLO)) but also hurt energy efficiency. Tackling limitations of current PM governors, we propose NMAP, Network packet processing Mode-Aware Power management. NMAP improves energy efficiency while satisfying given SLOs, considering packet processing status on a core for PM by monitoring transitions between network packet processing modes - interrupt and polling. Tracking the transitions, NMAP detects moments that a core cannot process packets fast enough and forces the core to immediately raise the voltage and frequency (V/F) state. As a result, NMAP can provide not only low response time but also low energy consumption. Our experiment shows that NMAP improves tail response time by up to 4.1× compared with the ondemand governor, reducing energy by up to 44.6 percent compared with the performance governor.

AB - In data center servers, power management (PM) exploiting Dynamic Voltage and Frequency Scaling (DVFS) for processors can play a crucial role to improve energy efficiency. However, we observe that current PM policies (i.e., governors) not only considerably increase tail response time (i.e., violate a given Service Level Objective (SLO)) but also hurt energy efficiency. Tackling limitations of current PM governors, we propose NMAP, Network packet processing Mode-Aware Power management. NMAP improves energy efficiency while satisfying given SLOs, considering packet processing status on a core for PM by monitoring transitions between network packet processing modes - interrupt and polling. Tracking the transitions, NMAP detects moments that a core cannot process packets fast enough and forces the core to immediately raise the voltage and frequency (V/F) state. As a result, NMAP can provide not only low response time but also low energy consumption. Our experiment shows that NMAP improves tail response time by up to 4.1× compared with the ondemand governor, reducing energy by up to 44.6 percent compared with the performance governor.

KW - Data center server

KW - dynamic voltage and frequency scaling

KW - power management

KW - tail latency

UR - https://www.scopus.com/pages/publications/85078958256

UR - https://www.scopus.com/pages/publications/85078958256#tab=citedBy

U2 - 10.1109/LCA.2019.2926079

DO - 10.1109/LCA.2019.2926079

M3 - Article

AN - SCOPUS:85078958256

SN - 1556-6056

VL - 19

SP - 1

EP - 4

JO - IEEE Computer Architecture Letters

JF - IEEE Computer Architecture Letters

IS - 1

M1 - 8752066

ER -

Network Packet Processing Mode-Aware Power Management for Data Center Servers

Abstract

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this