Proposal for a Flexible Benchmark for Agent Based Models

Elizabeth Koning, William Gropp

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As hardware capabilities and scientific understanding of social and biological systems improves, researchers are able to model complex system with increasing detail. This change increases the demand on Agent Based Modeling (ABM) software, making the performance of the software more critical. For researchers to choose the best system to implement their models, they must understand not only the capabilities of the platforms, which is available in the documentation, but also the relative performance to other software options. Currently, there is a dearth of information on the performance of ABM platforms and no standardized way to compare the performance of different platforms. To address this gap, the proposed NothingModel benchmark is a flexible benchmark to reflect a wide variety of ABMs and allow the developers of models and ABM platforms to compare platforms under a range of conditions. Set up as a series of building blocks, it allows the users to vary the scale, memory use, communication, computation, and heterogeneity of a sample model, implemented with multiple tools. Along with the written description of the model, we include a reference implementation in NetLogo to demonstrate the specifics and provide comparison to other tools.

Original languageEnglish (US)
Title of host publication2024 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages835-838
Number of pages4
ISBN (Electronic)9798350364606
DOIs
StatePublished - 2024
Event2024 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2024 - San Francisco, United States
Duration: May 27 2024May 31 2024

Publication series

Name2024 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2024

Conference

Conference2024 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2024
Country/TerritoryUnited States
CitySan Francisco
Period5/27/245/31/24

Keywords

  • ABM
  • Agent Based Models
  • Benchmarking
  • MAS
  • Multi-agent systems
  • Performance

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Proposal for a Flexible Benchmark for Agent Based Models'. Together they form a unique fingerprint.

Cite this