Media processing workflow design and execution with ARIA

Lina Peng, Gisik Kwon, K. Selçuk Candan, Kyung Ryu, Karam Chatha, Hari Sundaram, Yinpeng Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Recently, we introduced a novel ARchitecture for Interactive Arts (ARIA) middleware that processes, filters, and fuses sensory inputs and actuates responses in real-time while providing various Quality of Service (QoS) guarantees. The objective of ARIA is to incorporate realtime, sensed, and archived media and audience responses into live performances, on demand. An ARIA media workflow graph describes how the data sensed through media capture devices will be processed and what audio-visual responses will be actuated. Thus, each data object streamed between ARIA processing components is subject to transformations, as described by a media workflow graph. The media capture and processing components, such as media filters and fusion operators, are programmable and adaptable; i.e, the delay, size, frequency, and quality/precision characteristics of individual operators can be controlled via a number of parameters. In [1, 4, 5], we developed static and dynamic optimization algorithms which maximize the quality of the actuated responses, minimize the corresponding delay and the resource usage. In this demonstration, we present the ARIA GUI and the underlying kernel. More specifically, we describe how to design a media processing workflow, with adaptive operators, using the ARIA GUI and how to use the various optimization and adaptation alternatives provided by the ARIA kernel to execute media processing workflows.

Original languageEnglish (US)
Title of host publicationProceedings of the 13th ACM International Conference on Multimedia, MM 2005
Number of pages2
StatePublished - 2005
Externally publishedYes
Event13th ACM International Conference on Multimedia, MM 2005 - Singapore, Singapore
Duration: Nov 6 2005Nov 11 2005

Publication series

NameProceedings of the 13th ACM International Conference on Multimedia, MM 2005


Other13th ACM International Conference on Multimedia, MM 2005


  • Filtering
  • Fusion
  • Mul-timodal art
  • Multimedia
  • Realtime sensory/reactive environments
  • Tools for creating interactive

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Software


Dive into the research topics of 'Media processing workflow design and execution with ARIA'. Together they form a unique fingerprint.

Cite this