Demonstration of ElasticNotebook: Migrating Live Computational Notebook States

Zhaoheng Li, Supawit Chockchowwat, Hanxi Fang, Ribhav Sahu, Sumay Thakurdesai, Kantanat Pridaphatrakun, Yongjoo Park

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Computational notebooks (e.g., Jupyter, Google Colab) are widely used for interactive data science and machine learning. However, existing notebook systems lack the functionality of reliably and efficiently persisting thenotebook session state consisting of user-defined variables (e.g., processed datasets, ML models), hence the termination of a session often leads to loss of work. In this demo, we introduce a new notebook system, ElasticNotebook, that offers live migration of session states via computational checkpointing/restoration for notebook systems (e.g., Jupyter Notebook, Colab). ElasticNotebook's frontend allows users to configure the periodic creation of session state checkpoints, which can then be restored at will through a drop-down menu. ElasticNotebook's backend utilizes novel lightweight monitoring techniques to find a reliable and efficient way (i.e., replication plan ) for replicating session states when requested. This demo will showcase ElasticNotebook's ability to preserve the user's work progress in Jupyter Servers by replicating their session state in two common use cases: live migration across machines and resumption after termination.

Original languageEnglish (US)
Title of host publicationSIGMOD-Companion 2024 - Companion of the 2024 International Conferaence on Management of Data
PublisherAssociation for Computing Machinery
Pages540-543
Number of pages4
ISBN (Electronic)9798400704222
DOIs
StatePublished - Jun 9 2024
Event2024 International Conferaence on Management of Data, SIGMOD 2024 - Santiago, Chile
Duration: Jun 9 2024Jun 15 2024

Publication series

NameProceedings of the ACM SIGMOD International Conference on Management of Data
ISSN (Print)0730-8078

Conference

Conference2024 International Conferaence on Management of Data, SIGMOD 2024
Country/TerritoryChile
CitySantiago
Period6/9/246/15/24

Keywords

  • computing platforms
  • data replication tools

ASJC Scopus subject areas

  • Software
  • Information Systems

Fingerprint

Dive into the research topics of 'Demonstration of ElasticNotebook: Migrating Live Computational Notebook States'. Together they form a unique fingerprint.

Cite this