TY - GEN
T1 - Context-aware image compression optimization for visual analytics offloading
AU - Chen, Bo
AU - Yan, Zhisheng
AU - Nahrstedt, Klara
N1 - This work is funded by the US Army Research Laboratory under cooperative agreement W911NF17-2-0196 and NSF OAC 2151463, 2144764. The publication presents the work of the authors and does not represent any opinions of the funding agency.
PY - 2022/6/14
Y1 - 2022/6/14
N2 - Convolutional Neural Networks (CNN) have given rise to numerous visual analytics applications at the edge of the Internet. The image is typically captured by cameras and then live-streamed to edge servers for analytics due to the prohibitive cost of running CNN on computation-constrained end devices. A critical component to ensure low-latency and accurate visual analytics offloading over low bandwidth networks is image compression that minimizes the amount of visual data to offload and maximizes the decoding quality of salient pixels for analytics. Despite the wide adoption, JPEG standard and traditional image compression do not address the accuracy of analytics tasks, leading to ineffective compression for visual analytics offloading. Although recent machine-centric image compression techniques leverage sophisticated neural network models or hardware architecture to support the accuracy-bandwidth trade-off, they introduce excessive latency in the visual analytics offloading pipeline. This paper presents CICO, a Context-aware Image Compression Optimization framework to achieve low-bandwidth and low-latency visual analytics offloading. CICO contextualizes image compression for offloading by employing easily-computable low-level image features to understand the importance of different image regions for a visual analytics task. Accordingly, CICO can optimize the trade-off between compression size and analytics accuracy. Extensive real-world experiments demonstrate that CICO reduces the bandwidth consumption of existing compression methods by up to 40% under a comparable analytics accuracy. In terms of the low-latency support, CICO achieves up to a 2x speedup over state-of-the-art compression techniques.
AB - Convolutional Neural Networks (CNN) have given rise to numerous visual analytics applications at the edge of the Internet. The image is typically captured by cameras and then live-streamed to edge servers for analytics due to the prohibitive cost of running CNN on computation-constrained end devices. A critical component to ensure low-latency and accurate visual analytics offloading over low bandwidth networks is image compression that minimizes the amount of visual data to offload and maximizes the decoding quality of salient pixels for analytics. Despite the wide adoption, JPEG standard and traditional image compression do not address the accuracy of analytics tasks, leading to ineffective compression for visual analytics offloading. Although recent machine-centric image compression techniques leverage sophisticated neural network models or hardware architecture to support the accuracy-bandwidth trade-off, they introduce excessive latency in the visual analytics offloading pipeline. This paper presents CICO, a Context-aware Image Compression Optimization framework to achieve low-bandwidth and low-latency visual analytics offloading. CICO contextualizes image compression for offloading by employing easily-computable low-level image features to understand the importance of different image regions for a visual analytics task. Accordingly, CICO can optimize the trade-off between compression size and analytics accuracy. Extensive real-world experiments demonstrate that CICO reduces the bandwidth consumption of existing compression methods by up to 40% under a comparable analytics accuracy. In terms of the low-latency support, CICO achieves up to a 2x speedup over state-of-the-art compression techniques.
KW - Computation Offloading
KW - Deep Learning
KW - Image Compression
UR - http://www.scopus.com/inward/record.url?scp=85137149266&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85137149266&partnerID=8YFLogxK
U2 - 10.1145/3524273.3528178
DO - 10.1145/3524273.3528178
M3 - Conference contribution
AN - SCOPUS:85137149266
T3 - MMSys 2022 - Proceedings of the 13th ACM Multimedia Systems Conference
SP - 27
EP - 38
BT - MMSys 2022 - Proceedings of the 13th ACM Multimedia Systems Conference
PB - Association for Computing Machinery
T2 - 13th ACM Multimedia Systems Conference, MMSys 2022
Y2 - 14 June 2022 through 17 June 2022
ER -