A cybergis-jupyter framework for geospatial analytics at scale

Dandong Yin, Yan Liu, Anand Padmanabhan, Jeff Terstriep, Johnathan Rush, Shaowen Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The interdisciplinary field of cyberGIS (geographic information science and systems (GIS) based on advanced cyberinfrastructure) has a major focus on data-and computation-intensive geospatial analytics. The rapidly growing needs across many application and science domains for such analytics based on disparate geospatial big data poses significant challenges to conventional GIS approaches. This paper describes CyberGIS-Jupyter, an innovative cyberGIS framework for achieving data-intensive, reproducible, and scalable geospatial analytics using the Jupyter Notebook based on ROGER-the first cyberGIS supercomputer. The framework adapts the Notebook with built-in cyberGIS capabilities to accelerate gateway application development and sharing while associated data, analytics and workflow runtime environments are encapsulated into application packages that can be elastically reproduced through cloud computing approaches. As a desirable outcome, data-intensive and scalable geospatial analytics can be efficiently developed and improved, and seamlessly reproduced among multidisciplinary users in a novel cyberGIS science gateway environment.

LanguageEnglish (US)
Title of host publicationPEARC 2017 - Practice and Experience in Advanced Research Computing 2017
Subtitle of host publicationSustainability, Success and Impact
PublisherAssociation for Computing Machinery
VolumePart F128771
ISBN (Electronic)9781450352727
DOIs
StatePublished - Jul 9 2017
Event2017 Practice and Experience in Advanced Research Computing, PEARC 2017 - New Orleans, United States
Duration: Jul 9 2017Jul 13 2017

Other

Other2017 Practice and Experience in Advanced Research Computing, PEARC 2017
CountryUnited States
CityNew Orleans
Period7/9/177/13/17

Fingerprint

Information science
Information systems
Supercomputers
Cloud computing
Big data

Keywords

  • Computational reproducibility
  • CyberGIS
  • Flood mapping
  • Geospatial big data
  • Science gateway

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Yin, D., Liu, Y., Padmanabhan, A., Terstriep, J., Rush, J., & Wang, S. (2017). A cybergis-jupyter framework for geospatial analytics at scale. In PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact (Vol. Part F128771). [a18] Association for Computing Machinery. DOI: 10.1145/3093338.3093378

A cybergis-jupyter framework for geospatial analytics at scale. / Yin, Dandong; Liu, Yan; Padmanabhan, Anand; Terstriep, Jeff; Rush, Johnathan; Wang, Shaowen.

PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact. Vol. Part F128771 Association for Computing Machinery, 2017. a18.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yin, D, Liu, Y, Padmanabhan, A, Terstriep, J, Rush, J & Wang, S 2017, A cybergis-jupyter framework for geospatial analytics at scale. in PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact. vol. Part F128771, a18, Association for Computing Machinery, 2017 Practice and Experience in Advanced Research Computing, PEARC 2017, New Orleans, United States, 7/9/17. DOI: 10.1145/3093338.3093378
Yin D, Liu Y, Padmanabhan A, Terstriep J, Rush J, Wang S. A cybergis-jupyter framework for geospatial analytics at scale. In PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact. Vol. Part F128771. Association for Computing Machinery. 2017. a18. Available from, DOI: 10.1145/3093338.3093378
Yin, Dandong ; Liu, Yan ; Padmanabhan, Anand ; Terstriep, Jeff ; Rush, Johnathan ; Wang, Shaowen. / A cybergis-jupyter framework for geospatial analytics at scale. PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact. Vol. Part F128771 Association for Computing Machinery, 2017.
@inproceedings{5d969773a4b342e8a240168b9d091649,
title = "A cybergis-jupyter framework for geospatial analytics at scale",
abstract = "The interdisciplinary field of cyberGIS (geographic information science and systems (GIS) based on advanced cyberinfrastructure) has a major focus on data-and computation-intensive geospatial analytics. The rapidly growing needs across many application and science domains for such analytics based on disparate geospatial big data poses significant challenges to conventional GIS approaches. This paper describes CyberGIS-Jupyter, an innovative cyberGIS framework for achieving data-intensive, reproducible, and scalable geospatial analytics using the Jupyter Notebook based on ROGER-the first cyberGIS supercomputer. The framework adapts the Notebook with built-in cyberGIS capabilities to accelerate gateway application development and sharing while associated data, analytics and workflow runtime environments are encapsulated into application packages that can be elastically reproduced through cloud computing approaches. As a desirable outcome, data-intensive and scalable geospatial analytics can be efficiently developed and improved, and seamlessly reproduced among multidisciplinary users in a novel cyberGIS science gateway environment.",
keywords = "Computational reproducibility, CyberGIS, Flood mapping, Geospatial big data, Science gateway",
author = "Dandong Yin and Yan Liu and Anand Padmanabhan and Jeff Terstriep and Johnathan Rush and Shaowen Wang",
year = "2017",
month = "7",
day = "9",
doi = "10.1145/3093338.3093378",
language = "English (US)",
volume = "Part F128771",
booktitle = "PEARC 2017 - Practice and Experience in Advanced Research Computing 2017",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - A cybergis-jupyter framework for geospatial analytics at scale

AU - Yin,Dandong

AU - Liu,Yan

AU - Padmanabhan,Anand

AU - Terstriep,Jeff

AU - Rush,Johnathan

AU - Wang,Shaowen

PY - 2017/7/9

Y1 - 2017/7/9

N2 - The interdisciplinary field of cyberGIS (geographic information science and systems (GIS) based on advanced cyberinfrastructure) has a major focus on data-and computation-intensive geospatial analytics. The rapidly growing needs across many application and science domains for such analytics based on disparate geospatial big data poses significant challenges to conventional GIS approaches. This paper describes CyberGIS-Jupyter, an innovative cyberGIS framework for achieving data-intensive, reproducible, and scalable geospatial analytics using the Jupyter Notebook based on ROGER-the first cyberGIS supercomputer. The framework adapts the Notebook with built-in cyberGIS capabilities to accelerate gateway application development and sharing while associated data, analytics and workflow runtime environments are encapsulated into application packages that can be elastically reproduced through cloud computing approaches. As a desirable outcome, data-intensive and scalable geospatial analytics can be efficiently developed and improved, and seamlessly reproduced among multidisciplinary users in a novel cyberGIS science gateway environment.

AB - The interdisciplinary field of cyberGIS (geographic information science and systems (GIS) based on advanced cyberinfrastructure) has a major focus on data-and computation-intensive geospatial analytics. The rapidly growing needs across many application and science domains for such analytics based on disparate geospatial big data poses significant challenges to conventional GIS approaches. This paper describes CyberGIS-Jupyter, an innovative cyberGIS framework for achieving data-intensive, reproducible, and scalable geospatial analytics using the Jupyter Notebook based on ROGER-the first cyberGIS supercomputer. The framework adapts the Notebook with built-in cyberGIS capabilities to accelerate gateway application development and sharing while associated data, analytics and workflow runtime environments are encapsulated into application packages that can be elastically reproduced through cloud computing approaches. As a desirable outcome, data-intensive and scalable geospatial analytics can be efficiently developed and improved, and seamlessly reproduced among multidisciplinary users in a novel cyberGIS science gateway environment.

KW - Computational reproducibility

KW - CyberGIS

KW - Flood mapping

KW - Geospatial big data

KW - Science gateway

UR - http://www.scopus.com/inward/record.url?scp=85025820717&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85025820717&partnerID=8YFLogxK

U2 - 10.1145/3093338.3093378

DO - 10.1145/3093338.3093378

M3 - Conference contribution

VL - Part F128771

BT - PEARC 2017 - Practice and Experience in Advanced Research Computing 2017

PB - Association for Computing Machinery

ER -