Scaling eCGA model building via data-intensive computing

Abhishek Verma, Xavier Llorà, Shivaram Venkataraman, David E. Goldberg, Roy H. Campbell

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended compact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous efforts with other techniques that either required specialized high-performance hardware or shared memory environments.

Original languageEnglish (US)
Title of host publication2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010
DOIs
StatePublished - Dec 1 2010
Event2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010 - Barcelona, Spain
Duration: Jul 18 2010Jul 23 2010

Publication series

Name2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

Other

Other2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010
CountrySpain
CityBarcelona
Period7/18/107/23/10

Fingerprint

MapReduce
Genetic algorithms
Scaling
Computing
Genetic Algorithm
Computer hardware
Large-scale Problems
Shared Memory
Data storage equipment
High Performance
Hardware
Framework

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Applied Mathematics

Cite this

Verma, A., Llorà, X., Venkataraman, S., Goldberg, D. E., & Campbell, R. H. (2010). Scaling eCGA model building via data-intensive computing. In 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010 [5586468] (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010). https://doi.org/10.1109/CEC.2010.5586468

Scaling eCGA model building via data-intensive computing. / Verma, Abhishek; Llorà, Xavier; Venkataraman, Shivaram; Goldberg, David E.; Campbell, Roy H.

2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. 2010. 5586468 (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Verma, A, Llorà, X, Venkataraman, S, Goldberg, DE & Campbell, RH 2010, Scaling eCGA model building via data-intensive computing. in 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010., 5586468, 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010, 2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010, Barcelona, Spain, 7/18/10. https://doi.org/10.1109/CEC.2010.5586468
Verma A, Llorà X, Venkataraman S, Goldberg DE, Campbell RH. Scaling eCGA model building via data-intensive computing. In 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. 2010. 5586468. (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010). https://doi.org/10.1109/CEC.2010.5586468
Verma, Abhishek ; Llorà, Xavier ; Venkataraman, Shivaram ; Goldberg, David E. ; Campbell, Roy H. / Scaling eCGA model building via data-intensive computing. 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. 2010. (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010).
@inproceedings{2d08f091e4ed468da1b77c7fb237c782,
title = "Scaling eCGA model building via data-intensive computing",
abstract = "This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended compact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous efforts with other techniques that either required specialized high-performance hardware or shared memory environments.",
author = "Abhishek Verma and Xavier Llor{\`a} and Shivaram Venkataraman and Goldberg, {David E.} and Campbell, {Roy H.}",
year = "2010",
month = "12",
day = "1",
doi = "10.1109/CEC.2010.5586468",
language = "English (US)",
isbn = "9781424469109",
series = "2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010",
booktitle = "2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010",

}

TY - GEN

T1 - Scaling eCGA model building via data-intensive computing

AU - Verma, Abhishek

AU - Llorà, Xavier

AU - Venkataraman, Shivaram

AU - Goldberg, David E.

AU - Campbell, Roy H.

PY - 2010/12/1

Y1 - 2010/12/1

N2 - This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended compact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous efforts with other techniques that either required specialized high-performance hardware or shared memory environments.

AB - This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended compact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous efforts with other techniques that either required specialized high-performance hardware or shared memory environments.

UR - http://www.scopus.com/inward/record.url?scp=79959484276&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79959484276&partnerID=8YFLogxK

U2 - 10.1109/CEC.2010.5586468

DO - 10.1109/CEC.2010.5586468

M3 - Conference contribution

AN - SCOPUS:79959484276

SN - 9781424469109

T3 - 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

BT - 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

ER -