CPP-taskflow: Fast task-based parallel programming using modern C++

Tsung Wei Huang, Chun Xun Lin, Guannan Guo, Martin Wong

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we introduce Cpp-Taskflow, a new C++ tasking library to help developers quickly write parallel programs using task dependency graphs. Cpp-Taskflow leverages the power of modern C++ and task-based approaches to enable efficient implementations of parallel decomposition strategies. Our programming model can quickly handle not only traditional loop-level parallelism, but also irregular patterns such as graph algorithms, incremental flows, and dynamic data structures. Compared with existing libraries, Cpp-Taskflow is more cost efficient in performance scaling and software integration. We have evaluated Cpp-Taskflow on both micro-benchmarks and real-world applications with million-scale tasking. In a machine learning example, Cpp-Taskflow achieved 1.5-2.7× less coding complexity and 14-38% speed-up over two industrial-strength libraries OpenMP Tasking and Intel Threading Building Blocks (TBB).

Original languageEnglish (US)
Title of host publicationProceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages974-983
Number of pages10
ISBN (Electronic)9781728112466
DOIs
StatePublished - May 2019
Event33rd IEEE International Parallel and Distributed Processing Symposium, IPDPS 2019 - Rio de Janeiro, Brazil
Duration: May 20 2019May 24 2019

Publication series

NameProceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019

Conference

Conference33rd IEEE International Parallel and Distributed Processing Symposium, IPDPS 2019
CountryBrazil
CityRio de Janeiro
Period5/20/195/24/19

Fingerprint

Parallel programming
Data structures
Learning systems
Decomposition
Programming
Costs
Graph

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Information Systems and Management

Cite this

Huang, T. W., Lin, C. X., Guo, G., & Wong, M. (2019). CPP-taskflow: Fast task-based parallel programming using modern C++. In Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019 (pp. 974-983). [8821011] (Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IPDPS.2019.00105

CPP-taskflow : Fast task-based parallel programming using modern C++. / Huang, Tsung Wei; Lin, Chun Xun; Guo, Guannan; Wong, Martin.

Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 974-983 8821011 (Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Huang, TW, Lin, CX, Guo, G & Wong, M 2019, CPP-taskflow: Fast task-based parallel programming using modern C++. in Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019., 8821011, Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019, Institute of Electrical and Electronics Engineers Inc., pp. 974-983, 33rd IEEE International Parallel and Distributed Processing Symposium, IPDPS 2019, Rio de Janeiro, Brazil, 5/20/19. https://doi.org/10.1109/IPDPS.2019.00105
Huang TW, Lin CX, Guo G, Wong M. CPP-taskflow: Fast task-based parallel programming using modern C++. In Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 974-983. 8821011. (Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019). https://doi.org/10.1109/IPDPS.2019.00105
Huang, Tsung Wei ; Lin, Chun Xun ; Guo, Guannan ; Wong, Martin. / CPP-taskflow : Fast task-based parallel programming using modern C++. Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 974-983 (Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019).
@inproceedings{b6c62dc6fefb45cfbae52fb5d298ffb9,
title = "CPP-taskflow: Fast task-based parallel programming using modern C++",
abstract = "In this paper we introduce Cpp-Taskflow, a new C++ tasking library to help developers quickly write parallel programs using task dependency graphs. Cpp-Taskflow leverages the power of modern C++ and task-based approaches to enable efficient implementations of parallel decomposition strategies. Our programming model can quickly handle not only traditional loop-level parallelism, but also irregular patterns such as graph algorithms, incremental flows, and dynamic data structures. Compared with existing libraries, Cpp-Taskflow is more cost efficient in performance scaling and software integration. We have evaluated Cpp-Taskflow on both micro-benchmarks and real-world applications with million-scale tasking. In a machine learning example, Cpp-Taskflow achieved 1.5-2.7× less coding complexity and 14-38{\%} speed-up over two industrial-strength libraries OpenMP Tasking and Intel Threading Building Blocks (TBB).",
author = "Huang, {Tsung Wei} and Lin, {Chun Xun} and Guannan Guo and Martin Wong",
year = "2019",
month = "5",
doi = "10.1109/IPDPS.2019.00105",
language = "English (US)",
series = "Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "974--983",
booktitle = "Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019",
address = "United States",

}

TY - GEN

T1 - CPP-taskflow

T2 - Fast task-based parallel programming using modern C++

AU - Huang, Tsung Wei

AU - Lin, Chun Xun

AU - Guo, Guannan

AU - Wong, Martin

PY - 2019/5

Y1 - 2019/5

N2 - In this paper we introduce Cpp-Taskflow, a new C++ tasking library to help developers quickly write parallel programs using task dependency graphs. Cpp-Taskflow leverages the power of modern C++ and task-based approaches to enable efficient implementations of parallel decomposition strategies. Our programming model can quickly handle not only traditional loop-level parallelism, but also irregular patterns such as graph algorithms, incremental flows, and dynamic data structures. Compared with existing libraries, Cpp-Taskflow is more cost efficient in performance scaling and software integration. We have evaluated Cpp-Taskflow on both micro-benchmarks and real-world applications with million-scale tasking. In a machine learning example, Cpp-Taskflow achieved 1.5-2.7× less coding complexity and 14-38% speed-up over two industrial-strength libraries OpenMP Tasking and Intel Threading Building Blocks (TBB).

AB - In this paper we introduce Cpp-Taskflow, a new C++ tasking library to help developers quickly write parallel programs using task dependency graphs. Cpp-Taskflow leverages the power of modern C++ and task-based approaches to enable efficient implementations of parallel decomposition strategies. Our programming model can quickly handle not only traditional loop-level parallelism, but also irregular patterns such as graph algorithms, incremental flows, and dynamic data structures. Compared with existing libraries, Cpp-Taskflow is more cost efficient in performance scaling and software integration. We have evaluated Cpp-Taskflow on both micro-benchmarks and real-world applications with million-scale tasking. In a machine learning example, Cpp-Taskflow achieved 1.5-2.7× less coding complexity and 14-38% speed-up over two industrial-strength libraries OpenMP Tasking and Intel Threading Building Blocks (TBB).

UR - http://www.scopus.com/inward/record.url?scp=85067794112&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85067794112&partnerID=8YFLogxK

U2 - 10.1109/IPDPS.2019.00105

DO - 10.1109/IPDPS.2019.00105

M3 - Conference contribution

AN - SCOPUS:85067794112

T3 - Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019

SP - 974

EP - 983

BT - Proceedings - 2019 IEEE 33rd International Parallel and Distributed Processing Symposium, IPDPS 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -