Effortless data exploration with zenvisage: An expressive and interactive visual analytics system

Tarique Siddiqui, Albert Kim, John Lee, Kyratso George Karahalios, Aditya G Parameswaran

Research output: Contribution to journalConference article

Abstract

Data visualization is by far the most commonly used mechanism to explore and extract insights from datasets, especially by novice data scientists. And yet, current visual analytics tools are rather limited in their ability to operate on collections of visualizations-by composing, filtering, comparing, and sorting them-to find those that depict desired trends or patterns. The process of visual data exploration remains a tedious process of trial-and-error. We propose zenvisage, a visual analytics platform for effortlessly finding desired visual patterns from large datasets. We introduce zenvisage's general purpose visual exploration language, ZQL ("zee-quel") for specifying the desired visual patterns, drawing from use-cases in a variety of domains, including biology, mechanical engineering, climate science, and commerce. We formalize the expressiveness of ZQL via a visual exploration algebra-an algebra on collections of visualizations-and demonstrate that ZQL is as expressive as that algebra. Zenvisage exposes an interactive front-end that supports the issuing of ZQL queries, and also supports interactions that are "short-cuts" to certain commonly used ZQL queries. To execute these queries, zenvisage uses a novel ZQL graph-based query optimizer that leverages a suite of optimizations tailored to the goal of processing collections of visualizations in certain pre-defined ways. Lastly, a user survey and study demonstrates that data scientists are able to effectively use zenvisage to eliminate error-prone and tedious exploration and directly identify desired visualizations.

Original languageEnglish (US)
Pages (from-to)457-468
Number of pages12
JournalProceedings of the VLDB Endowment
Volume10
Issue number4
DOIs
StatePublished - Jan 1 2016
Event43rd International Conference on Very Large Data Bases, VLDB 2017 - Munich, Germany
Duration: Aug 28 2017Sep 1 2017

Fingerprint

Visualization
Algebra
Drawing (graphics)
Data visualization
Mechanical engineering
Sorting
Processing

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Computer Science(all)

Cite this

Effortless data exploration with zenvisage : An expressive and interactive visual analytics system. / Siddiqui, Tarique; Kim, Albert; Lee, John; Karahalios, Kyratso George; Parameswaran, Aditya G.

In: Proceedings of the VLDB Endowment, Vol. 10, No. 4, 01.01.2016, p. 457-468.

Research output: Contribution to journalConference article

Siddiqui, Tarique ; Kim, Albert ; Lee, John ; Karahalios, Kyratso George ; Parameswaran, Aditya G. / Effortless data exploration with zenvisage : An expressive and interactive visual analytics system. In: Proceedings of the VLDB Endowment. 2016 ; Vol. 10, No. 4. pp. 457-468.
@article{8b6de0e57a4f439998d123878b56d352,
title = "Effortless data exploration with zenvisage: An expressive and interactive visual analytics system",
abstract = "Data visualization is by far the most commonly used mechanism to explore and extract insights from datasets, especially by novice data scientists. And yet, current visual analytics tools are rather limited in their ability to operate on collections of visualizations-by composing, filtering, comparing, and sorting them-to find those that depict desired trends or patterns. The process of visual data exploration remains a tedious process of trial-and-error. We propose zenvisage, a visual analytics platform for effortlessly finding desired visual patterns from large datasets. We introduce zenvisage's general purpose visual exploration language, ZQL ({"}zee-quel{"}) for specifying the desired visual patterns, drawing from use-cases in a variety of domains, including biology, mechanical engineering, climate science, and commerce. We formalize the expressiveness of ZQL via a visual exploration algebra-an algebra on collections of visualizations-and demonstrate that ZQL is as expressive as that algebra. Zenvisage exposes an interactive front-end that supports the issuing of ZQL queries, and also supports interactions that are {"}short-cuts{"} to certain commonly used ZQL queries. To execute these queries, zenvisage uses a novel ZQL graph-based query optimizer that leverages a suite of optimizations tailored to the goal of processing collections of visualizations in certain pre-defined ways. Lastly, a user survey and study demonstrates that data scientists are able to effectively use zenvisage to eliminate error-prone and tedious exploration and directly identify desired visualizations.",
author = "Tarique Siddiqui and Albert Kim and John Lee and Karahalios, {Kyratso George} and Parameswaran, {Aditya G}",
year = "2016",
month = "1",
day = "1",
doi = "10.14778/3025111.3025126",
language = "English (US)",
volume = "10",
pages = "457--468",
journal = "Proceedings of the VLDB Endowment",
issn = "2150-8097",
publisher = "Very Large Data Base Endowment Inc.",
number = "4",

}

TY - JOUR

T1 - Effortless data exploration with zenvisage

T2 - An expressive and interactive visual analytics system

AU - Siddiqui, Tarique

AU - Kim, Albert

AU - Lee, John

AU - Karahalios, Kyratso George

AU - Parameswaran, Aditya G

PY - 2016/1/1

Y1 - 2016/1/1

N2 - Data visualization is by far the most commonly used mechanism to explore and extract insights from datasets, especially by novice data scientists. And yet, current visual analytics tools are rather limited in their ability to operate on collections of visualizations-by composing, filtering, comparing, and sorting them-to find those that depict desired trends or patterns. The process of visual data exploration remains a tedious process of trial-and-error. We propose zenvisage, a visual analytics platform for effortlessly finding desired visual patterns from large datasets. We introduce zenvisage's general purpose visual exploration language, ZQL ("zee-quel") for specifying the desired visual patterns, drawing from use-cases in a variety of domains, including biology, mechanical engineering, climate science, and commerce. We formalize the expressiveness of ZQL via a visual exploration algebra-an algebra on collections of visualizations-and demonstrate that ZQL is as expressive as that algebra. Zenvisage exposes an interactive front-end that supports the issuing of ZQL queries, and also supports interactions that are "short-cuts" to certain commonly used ZQL queries. To execute these queries, zenvisage uses a novel ZQL graph-based query optimizer that leverages a suite of optimizations tailored to the goal of processing collections of visualizations in certain pre-defined ways. Lastly, a user survey and study demonstrates that data scientists are able to effectively use zenvisage to eliminate error-prone and tedious exploration and directly identify desired visualizations.

AB - Data visualization is by far the most commonly used mechanism to explore and extract insights from datasets, especially by novice data scientists. And yet, current visual analytics tools are rather limited in their ability to operate on collections of visualizations-by composing, filtering, comparing, and sorting them-to find those that depict desired trends or patterns. The process of visual data exploration remains a tedious process of trial-and-error. We propose zenvisage, a visual analytics platform for effortlessly finding desired visual patterns from large datasets. We introduce zenvisage's general purpose visual exploration language, ZQL ("zee-quel") for specifying the desired visual patterns, drawing from use-cases in a variety of domains, including biology, mechanical engineering, climate science, and commerce. We formalize the expressiveness of ZQL via a visual exploration algebra-an algebra on collections of visualizations-and demonstrate that ZQL is as expressive as that algebra. Zenvisage exposes an interactive front-end that supports the issuing of ZQL queries, and also supports interactions that are "short-cuts" to certain commonly used ZQL queries. To execute these queries, zenvisage uses a novel ZQL graph-based query optimizer that leverages a suite of optimizations tailored to the goal of processing collections of visualizations in certain pre-defined ways. Lastly, a user survey and study demonstrates that data scientists are able to effectively use zenvisage to eliminate error-prone and tedious exploration and directly identify desired visualizations.

UR - http://www.scopus.com/inward/record.url?scp=85019872052&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85019872052&partnerID=8YFLogxK

U2 - 10.14778/3025111.3025126

DO - 10.14778/3025111.3025126

M3 - Conference article

AN - SCOPUS:85019872052

VL - 10

SP - 457

EP - 468

JO - Proceedings of the VLDB Endowment

JF - Proceedings of the VLDB Endowment

SN - 2150-8097

IS - 4

ER -