TY - JOUR
T1 - A communication-aware framework for parallel spatially explicit agent-based models
AU - Shook, Eric
AU - Wang, Shaowen
AU - Tang, Wenwu
N1 - Funding Information:
This paper is based upon work supported by the National Science Foundation (NSF) under Grant Numbers: BCS-0846655 and OCI-1047916. Computational resources were provided through a supercomputing resource allocation award – SES070004 – by the NSF Extreme Science and Engineering Discovery Environment Project. The authors greatly appreciate the insightful comments from Editor Dr. May Yuan and three anonymous reviewers on the originally submitted version of this manuscript.
PY - 2013/11
Y1 - 2013/11
N2 - Parallel spatially explicit agent-based models (SE-ABM) exploit high-performance and parallel computing to simulate spatial dynamics of complex geographic systems. The integration of parallel SE-ABM with CyberGIS could facilitate straightforward access to massive computational resources and geographic information systems to support pre- and post-simulation analysis and visualization. However, to benefit from CyberGIS integration, parallel SE-ABM must overcome the challenge of communication management for orchestrating many processor cores in parallel computing environments. This paper examines and addresses this challenge by describing a generic framework for the management of inter-processor communication to enable parallel SE-ABM to scale to high-performance parallel computers. The framework synthesizes four interrelated components: agent grouping, rectilinear domain decomposition, a communication-aware load-balancing strategy, and entity proxies. The results of a series of computational experiments based on a template agent-based model demonstrate that parallel computational efficiency diminishes as inter-processor communication increases, particularly when scaling a fixed-size model to thousands of processor cores. Therefore, effective communication management is crucial. The communication framework is shown to efficiently scale up to 2048 cores, demonstrating its ability to effectively scale to thousands of processor cores to support the simulation of billions of agents. In a simulated scenario, the communication-aware load-balancer reduced both overall simulation time and communication percentage improving overall computational efficiency. By examining and addressing inter-processor communication challenges, this research enables parallel SE-ABM to efficiently use high-performance computing resources, which reduces the barriers for synergistic integration with CyberGIS.
AB - Parallel spatially explicit agent-based models (SE-ABM) exploit high-performance and parallel computing to simulate spatial dynamics of complex geographic systems. The integration of parallel SE-ABM with CyberGIS could facilitate straightforward access to massive computational resources and geographic information systems to support pre- and post-simulation analysis and visualization. However, to benefit from CyberGIS integration, parallel SE-ABM must overcome the challenge of communication management for orchestrating many processor cores in parallel computing environments. This paper examines and addresses this challenge by describing a generic framework for the management of inter-processor communication to enable parallel SE-ABM to scale to high-performance parallel computers. The framework synthesizes four interrelated components: agent grouping, rectilinear domain decomposition, a communication-aware load-balancing strategy, and entity proxies. The results of a series of computational experiments based on a template agent-based model demonstrate that parallel computational efficiency diminishes as inter-processor communication increases, particularly when scaling a fixed-size model to thousands of processor cores. Therefore, effective communication management is crucial. The communication framework is shown to efficiently scale up to 2048 cores, demonstrating its ability to effectively scale to thousands of processor cores to support the simulation of billions of agents. In a simulated scenario, the communication-aware load-balancer reduced both overall simulation time and communication percentage improving overall computational efficiency. By examining and addressing inter-processor communication challenges, this research enables parallel SE-ABM to efficiently use high-performance computing resources, which reduces the barriers for synergistic integration with CyberGIS.
KW - agent-based modeling
KW - cyberGIS
KW - high performance computing
KW - parallel communication
UR - http://www.scopus.com/inward/record.url?scp=84887196556&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84887196556&partnerID=8YFLogxK
U2 - 10.1080/13658816.2013.771740
DO - 10.1080/13658816.2013.771740
M3 - Article
AN - SCOPUS:84887196556
VL - 27
SP - 2160
EP - 2181
JO - International Journal of Geographical Information Science
JF - International Journal of Geographical Information Science
SN - 1365-8816
IS - 11
ER -