Scaling eCGA model building via data-intensive computing

Abhishek Verma; Xavier Llorà; Shivaram Venkataraman; David E. Goldberg; Roy H. Campbell

doi:10.1109/CEC.2010.5586468

Scaling eCGA model building via data-intensive computing

Abhishek Verma, Xavier Llorà, Shivaram Venkataraman, David E. Goldberg, Roy H. Campbell

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended compact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous efforts with other techniques that either required specialized high-performance hardware or shared memory environments.

Original language	English (US)
Title of host publication	2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010
DOIs	https://doi.org/10.1109/CEC.2010.5586468
State	Published - 2010
Event	2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010 - Barcelona, Spain Duration: Jul 18 2010 → Jul 23 2010

Publication series

Name	2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

Other

Other	2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010
Country/Territory	Spain
City	Barcelona
Period	7/18/10 → 7/23/10

ASJC Scopus subject areas

Computational Theory and Mathematics
Applied Mathematics

Online availability

10.1109/CEC.2010.5586468

Library availability

Discover UIUC Full Text

Cite this

Verma, A., Llorà, X., Venkataraman, S., Goldberg, D. E., & Campbell, R. H. (2010). Scaling eCGA model building via data-intensive computing. In 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010 Article 5586468 (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010). https://doi.org/10.1109/CEC.2010.5586468

Scaling eCGA model building via data-intensive computing. / Verma, Abhishek; Llorà, Xavier; Venkataraman, Shivaram et al.
2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. 2010. 5586468 (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Verma, A, Llorà, X, Venkataraman, S, Goldberg, DE & Campbell, RH 2010, Scaling eCGA model building via data-intensive computing. in 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010., 5586468, 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010, 2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010, Barcelona, Spain, 7/18/10. https://doi.org/10.1109/CEC.2010.5586468

Verma A, Llorà X, Venkataraman S, Goldberg DE, Campbell RH. Scaling eCGA model building via data-intensive computing. In 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. 2010. 5586468. (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010). doi: 10.1109/CEC.2010.5586468

Verma, Abhishek ; Llorà, Xavier ; Venkataraman, Shivaram et al. / Scaling eCGA model building via data-intensive computing. 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. 2010. (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010).

@inproceedings{2d08f091e4ed468da1b77c7fb237c782,

title = "Scaling eCGA model building via data-intensive computing",

abstract = "This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended compact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous efforts with other techniques that either required specialized high-performance hardware or shared memory environments.",

author = "Abhishek Verma and Xavier Llor{\`a} and Shivaram Venkataraman and Goldberg, {David E.} and Campbell, {Roy H.}",

note = "Copyright: Copyright 2011 Elsevier B.V., All rights reserved.; 2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010 ; Conference date: 18-07-2010 Through 23-07-2010",

year = "2010",

doi = "10.1109/CEC.2010.5586468",

language = "English (US)",

isbn = "9781424469109",

series = "2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010",

booktitle = "2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010",

}

TY - GEN

T1 - Scaling eCGA model building via data-intensive computing

AU - Verma, Abhishek

AU - Llorà, Xavier

AU - Venkataraman, Shivaram

AU - Goldberg, David E.

AU - Campbell, Roy H.

PY - 2010

Y1 - 2010

N2 - This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended compact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous efforts with other techniques that either required specialized high-performance hardware or shared memory environments.

AB - This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended compact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous efforts with other techniques that either required specialized high-performance hardware or shared memory environments.

UR - http://www.scopus.com/inward/record.url?scp=79959484276&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79959484276&partnerID=8YFLogxK

U2 - 10.1109/CEC.2010.5586468

DO - 10.1109/CEC.2010.5586468

M3 - Conference contribution

AN - SCOPUS:79959484276

SN - 9781424469109

T3 - 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

BT - 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

T2 - 2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

Y2 - 18 July 2010 through 23 July 2010

ER -

Scaling eCGA model building via data-intensive computing

Abstract

Publication series

Other

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this