Helping scientists ReConnect their datasets

Abdussalam Alawini, David Maier, Bill Howe, Kristin Tufte

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

It seems inevitable that the datasets associated with a research project proliferate over time: collaborators may extend datasets with new measurements and new attributes, new experimental runs result in new files with similar structures, and subsets of data are extracted for independent analysis. As these "residual" datasets begin to accrete over time, scientists can lose track of the derivation history that connects them, complicating data sharing, provenance tracking, and scientific reproducibility. In this paper, focusing on data in spreadsheets, we consider how observable relationships between two datasets can help scientists recall their original derivation connection. For instance, if dataset A is wholly contained in dataset B, B may be a more recent version of A and should be preferred when archiving or publishing. We articulate a space of relevant relationships, develop a set of algorithms for efficient discovery of these relationships, and organize these algorithms into a new system called Re-Connect to assist scientists in relationship discovery. Our evaluation shows that existing approaches that rely on flagging differences between two spreadsheets are impractical for many relationship-discovery tasks, and a user study shows that ReConnect can improve scientists' ability to detect useful relationships and subsequently identify the best dataset for a given task.

Original languageEnglish (US)
Title of host publicationSSDBM 2014 - Proceedings of the 26th International Conference on Scientific and Statistical Database Management
PublisherAssociation for Computing Machinery
ISBN (Print)9781450327220
DOIs
StatePublished - 2014
Externally publishedYes
Event26th International Conference on Scientific and Statistical Database Management, SSDBM 2014 - Aalborg, Denmark
Duration: Jun 30 2014Jul 2 2014

Publication series

NameACM International Conference Proceeding Series

Other

Other26th International Conference on Scientific and Statistical Database Management, SSDBM 2014
Country/TerritoryDenmark
CityAalborg
Period6/30/147/2/14

Keywords

  • Relationship identification
  • Scientific data management
  • Spreadsheets

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Helping scientists ReConnect their datasets'. Together they form a unique fingerprint.

Cite this