File-storage cyberinfrastructure for large-scale projects: Years before first-light

Arun S. Jagatheesan, Jeff Kantor, Raymond Plante, Jacek Becla, D. Michael Freemon, Kian Tat Lim, Michael Wan

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Large ground-based and space-based telescopes are expected to make exciting discoveries in the upcoming decade. These large projects start their construction phase many years before first-light and continue to operate for many years after first-light and usually span multiple countries. The file-storage cyberinfrastructure ("file-storage CI") of these largescale projects has to evolve over several years from a conceptual prototype to a highly flexible data distribution network. During this long period the file-storage CI has to transition into multiple stages, starting with a conceptual prototype before first-light, to a large-scale distributed network in production, and finally into a persistent archive once the project is decommissioned. While the project makes these transitions, the file-storage CI has to incorporate several requirements including but not limited to: Technology Evolution, due to changes in Cyberinfrastructure (CI) software or hardware during the lifetime of the project; International Partnerships that are updated during the various phases of the project; and Data Lifecycle that exists in the project. The file-storage and management software's architecture has to be designed with significant consideration of these requirements for these large projects. In this paper, we provide the generic requirements, for file-storage and management cyberinfrastructure in a large project similar to LSST before first-light.

Original languageEnglish (US)
Title of host publicationSoftware and Cyberinfrastructure for Astronomy
EditionPART 1
StatePublished - 2010
EventSoftware and Cyberinfrastructure for Astronomy - San Diego, CA, United States
Duration: Jun 27 2010Jun 30 2010

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
NumberPART 1
ISSN (Print)0277-786X


OtherSoftware and Cyberinfrastructure for Astronomy
Country/TerritoryUnited States
CitySan Diego, CA


  • Cyberinfrastructure
  • Data Grid
  • Data Management
  • File Management
  • File Storage
  • LSST

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'File-storage cyberinfrastructure for large-scale projects: Years before first-light'. Together they form a unique fingerprint.

Cite this