LSST data management software development practices and tools

Tim Jenness; Frossie Economou; Krzysztof Findeisen; Fabio Hernandez; Josh Hoblitt; K. Simon Krughoff; K. T. Lim; Robert H. Lupton; Fritz Mueller; William O'Mullane; Russell Owen; Stephen R. Pietrowicz; Pim Schellart; Jonathan Sick; John Swinbank; Adam Thornton; James Bosch; Jeffrey Kantor; John K. Parejko; Paul Price; Brian Van Klaveren

doi:10.1117/12.2312157

LSST data management software development practices and tools

Tim Jenness, Frossie Economou, Krzysztof Findeisen, Fabio Hernandez, Josh Hoblitt, K. Simon Krughoff, K. T. Lim, Robert H. Lupton, Fritz Mueller, William O'Mullane, Russell Owen, Stephen R. Pietrowicz, Pim Schellart, Jonathan Sick, John Swinbank, Adam Thornton, James Bosch, Jeffrey Kantor, John K. Parejko, Paul PriceBrian Van Klaveren

National Center for Supercomputing Applications (NCSA)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The Large Synoptic Survey Telescope (LSST) is an 8.4m optical survey telescope being constructed on Cerro Pachón in Chile. The data management system being developed must be able to process the nightly alert data, 20,000 expected transient alerts per minute, in near real time, and construct annual data releases at the petabyte scale. The development team consists of more than 90 people working in six different sites across the US developing an integrated set of software to realize the LSST science goals. In this paper we discuss our agile software development methodology and our API and developer decision making process. We also discuss the software tools that we use for continuous integration and deployment.

Original language	English (US)
Title of host publication	Software and Cyberinfrastructure for Astronomy V
Editors	Juan C. Guzman, Jorge Ibsen
Publisher	SPIE
ISBN (Print)	9781510619678
DOIs	https://doi.org/10.1117/12.2312157
State	Published - 2018
Event	Software and Cyberinfrastructure for Astronomy V 2018 - Austin, United States Duration: Jun 10 2018 → Jun 13 2018

Publication series

Name	Proceedings of SPIE - The International Society for Optical Engineering
Volume	10707
ISSN (Print)	0277-786X
ISSN (Electronic)	1996-756X

Conference

Conference	Software and Cyberinfrastructure for Astronomy V 2018
Country	United States
City	Austin
Period	6/10/18 → 6/13/18

Keywords

Agile Development
Continuous Integration
Distributed Development
LSST

ASJC Scopus subject areas

Electronic, Optical and Magnetic Materials
Condensed Matter Physics
Computer Science Applications
Applied Mathematics
Electrical and Electronic Engineering

Access to Document

10.1117/12.2312157

Fingerprint Dive into the research topics of 'LSST data management software development practices and tools'. Together they form a unique fingerprint.

Cite this

Jenness, T., Economou, F., Findeisen, K., Hernandez, F., Hoblitt, J., Krughoff, K. S., Lim, K. T., Lupton, R. H., Mueller, F., O'Mullane, W., Owen, R., Pietrowicz, S. R., Schellart, P., Sick, J., Swinbank, J., Thornton, A., Bosch, J., Kantor, J., Parejko, J. K., ... Van Klaveren, B. (2018). LSST data management software development practices and tools. In J. C. Guzman, & J. Ibsen (Eds.), Software and Cyberinfrastructure for Astronomy V [1070709] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10707). SPIE. https://doi.org/10.1117/12.2312157

LSST data management software development practices and tools. / Jenness, Tim; Economou, Frossie; Findeisen, Krzysztof; Hernandez, Fabio; Hoblitt, Josh; Krughoff, K. Simon; Lim, K. T.; Lupton, Robert H.; Mueller, Fritz; O'Mullane, William; Owen, Russell; Pietrowicz, Stephen R.; Schellart, Pim; Sick, Jonathan; Swinbank, John; Thornton, Adam; Bosch, James; Kantor, Jeffrey; Parejko, John K.; Price, Paul; Van Klaveren, Brian.

Software and Cyberinfrastructure for Astronomy V. ed. / Juan C. Guzman; Jorge Ibsen. SPIE, 2018. 1070709 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10707).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Jenness, T, Economou, F, Findeisen, K, Hernandez, F, Hoblitt, J, Krughoff, KS, Lim, KT, Lupton, RH, Mueller, F, O'Mullane, W, Owen, R, Pietrowicz, SR, Schellart, P, Sick, J, Swinbank, J, Thornton, A, Bosch, J, Kantor, J, Parejko, JK, Price, P & Van Klaveren, B 2018, LSST data management software development practices and tools. in JC Guzman & J Ibsen (eds), Software and Cyberinfrastructure for Astronomy V., 1070709, Proceedings of SPIE - The International Society for Optical Engineering, vol. 10707, SPIE, Software and Cyberinfrastructure for Astronomy V 2018, Austin, United States, 6/10/18. https://doi.org/10.1117/12.2312157

Jenness, Tim ; Economou, Frossie ; Findeisen, Krzysztof ; Hernandez, Fabio ; Hoblitt, Josh ; Krughoff, K. Simon ; Lim, K. T. ; Lupton, Robert H. ; Mueller, Fritz ; O'Mullane, William ; Owen, Russell ; Pietrowicz, Stephen R. ; Schellart, Pim ; Sick, Jonathan ; Swinbank, John ; Thornton, Adam ; Bosch, James ; Kantor, Jeffrey ; Parejko, John K. ; Price, Paul ; Van Klaveren, Brian. / LSST data management software development practices and tools. Software and Cyberinfrastructure for Astronomy V. editor / Juan C. Guzman ; Jorge Ibsen. SPIE, 2018. (Proceedings of SPIE - The International Society for Optical Engineering).

@inproceedings{d8a5c60692ad45a28bac8dbb1159104f,

title = "LSST data management software development practices and tools",

abstract = "The Large Synoptic Survey Telescope (LSST) is an 8.4m optical survey telescope being constructed on Cerro Pach{\'o}n in Chile. The data management system being developed must be able to process the nightly alert data, 20,000 expected transient alerts per minute, in near real time, and construct annual data releases at the petabyte scale. The development team consists of more than 90 people working in six different sites across the US developing an integrated set of software to realize the LSST science goals. In this paper we discuss our agile software development methodology and our API and developer decision making process. We also discuss the software tools that we use for continuous integration and deployment.",

keywords = "Agile Development, Continuous Integration, Distributed Development, LSST",

author = "Tim Jenness and Frossie Economou and Krzysztof Findeisen and Fabio Hernandez and Josh Hoblitt and Krughoff, {K. Simon} and Lim, {K. T.} and Lupton, {Robert H.} and Fritz Mueller and William O'Mullane and Russell Owen and Pietrowicz, {Stephen R.} and Pim Schellart and Jonathan Sick and John Swinbank and Adam Thornton and James Bosch and Jeffrey Kantor and Parejko, {John K.} and Paul Price and {Van Klaveren}, Brian",

year = "2018",

doi = "10.1117/12.2312157",

language = "English (US)",

isbn = "9781510619678",

series = "Proceedings of SPIE - The International Society for Optical Engineering",

publisher = "SPIE",

editor = "Guzman, {Juan C.} and Jorge Ibsen",

booktitle = "Software and Cyberinfrastructure for Astronomy V",

address = "United States",

note = "Software and Cyberinfrastructure for Astronomy V 2018 ; Conference date: 10-06-2018 Through 13-06-2018",

}

TY - GEN

T1 - LSST data management software development practices and tools

AU - Jenness, Tim

AU - Economou, Frossie

AU - Findeisen, Krzysztof

AU - Hernandez, Fabio

AU - Hoblitt, Josh

AU - Krughoff, K. Simon

AU - Lim, K. T.

AU - Lupton, Robert H.

AU - Mueller, Fritz

AU - O'Mullane, William

AU - Owen, Russell

AU - Pietrowicz, Stephen R.

AU - Schellart, Pim

AU - Sick, Jonathan

AU - Swinbank, John

AU - Thornton, Adam

AU - Bosch, James

AU - Kantor, Jeffrey

AU - Parejko, John K.

AU - Price, Paul

AU - Van Klaveren, Brian

PY - 2018

Y1 - 2018

N2 - The Large Synoptic Survey Telescope (LSST) is an 8.4m optical survey telescope being constructed on Cerro Pachón in Chile. The data management system being developed must be able to process the nightly alert data, 20,000 expected transient alerts per minute, in near real time, and construct annual data releases at the petabyte scale. The development team consists of more than 90 people working in six different sites across the US developing an integrated set of software to realize the LSST science goals. In this paper we discuss our agile software development methodology and our API and developer decision making process. We also discuss the software tools that we use for continuous integration and deployment.

AB - The Large Synoptic Survey Telescope (LSST) is an 8.4m optical survey telescope being constructed on Cerro Pachón in Chile. The data management system being developed must be able to process the nightly alert data, 20,000 expected transient alerts per minute, in near real time, and construct annual data releases at the petabyte scale. The development team consists of more than 90 people working in six different sites across the US developing an integrated set of software to realize the LSST science goals. In this paper we discuss our agile software development methodology and our API and developer decision making process. We also discuss the software tools that we use for continuous integration and deployment.

KW - Agile Development

KW - Continuous Integration

KW - Distributed Development

KW - LSST

UR - http://www.scopus.com/inward/record.url?scp=85052618803&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85052618803&partnerID=8YFLogxK

U2 - 10.1117/12.2312157

DO - 10.1117/12.2312157

M3 - Conference contribution

AN - SCOPUS:85052618803

SN - 9781510619678

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Software and Cyberinfrastructure for Astronomy V

A2 - Guzman, Juan C.

A2 - Ibsen, Jorge

PB - SPIE

T2 - Software and Cyberinfrastructure for Astronomy V 2018

Y2 - 10 June 2018 through 13 June 2018

ER -