Build your world and play in it: Interacting with surface particles on complex objects

Brett R. Jones, Rajinder Sodhi, Roy H. Campbell, Guy Garnett, Brian P. Bailey

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We explore interacting with everyday objects by representing content as interactive surface particles. Users can build their own physical world, map virtual content onto their physical construction and play directly with the surface using a stylus. A surface particle representation allows programmed content to be created independent of the display object and to be reused on many surfaces. We demonstrated this idea through a projector-camera system that acquires the object geometry and enables direct interaction through an IR tracked stylus. We present three motivating example applications, each displayed on three example surfaces. We discuss a set of interaction techniques that show possible avenues for structuring interaction on complicated everyday objects, such as Surface Adaptive GUIs for menu selection. Through a preliminary informal evaluation and interviews with end users, we demonstrate the potential of interacting with surface particles and identify improvements necessary to make this interaction practical on everyday surfaces.

Original languageEnglish (US)
Title of host publication9th IEEE International Symposium on Mixed and Augmented Reality 2010
Subtitle of host publicationScience and Technology, ISMAR 2010 - Proceedings
Pages165-174
Number of pages10
DOIs
StatePublished - Dec 1 2010
Event9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Seoul, Korea, Republic of
Duration: Oct 13 2010Oct 16 2010

Publication series

Name9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings

Other

Other9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010
CountryKorea, Republic of
CitySeoul
Period10/13/1010/16/10

Fingerprint

Graphical user interfaces
Cameras
Display devices
Geometry

Keywords

  • H5.2 [information interfaces and presentation]
  • Multimedia information systems - artificial, augmented, and virtual realities
  • User interfaces - input devices and strategies, interaction styles H5.1 [information interfaces and presentation]

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computational Theory and Mathematics

Cite this

Jones, B. R., Sodhi, R., Campbell, R. H., Garnett, G., & Bailey, B. P. (2010). Build your world and play in it: Interacting with surface particles on complex objects. In 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings (pp. 165-174). [5643566] (9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings). https://doi.org/10.1109/ISMAR.2010.5643566

Build your world and play in it : Interacting with surface particles on complex objects. / Jones, Brett R.; Sodhi, Rajinder; Campbell, Roy H.; Garnett, Guy; Bailey, Brian P.

9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings. 2010. p. 165-174 5643566 (9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jones, BR, Sodhi, R, Campbell, RH, Garnett, G & Bailey, BP 2010, Build your world and play in it: Interacting with surface particles on complex objects. in 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings., 5643566, 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings, pp. 165-174, 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010, Seoul, Korea, Republic of, 10/13/10. https://doi.org/10.1109/ISMAR.2010.5643566
Jones BR, Sodhi R, Campbell RH, Garnett G, Bailey BP. Build your world and play in it: Interacting with surface particles on complex objects. In 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings. 2010. p. 165-174. 5643566. (9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings). https://doi.org/10.1109/ISMAR.2010.5643566
Jones, Brett R. ; Sodhi, Rajinder ; Campbell, Roy H. ; Garnett, Guy ; Bailey, Brian P. / Build your world and play in it : Interacting with surface particles on complex objects. 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings. 2010. pp. 165-174 (9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings).
@inproceedings{214487a3d4e14f7f9f16a3b7e6913ec3,
title = "Build your world and play in it: Interacting with surface particles on complex objects",
abstract = "We explore interacting with everyday objects by representing content as interactive surface particles. Users can build their own physical world, map virtual content onto their physical construction and play directly with the surface using a stylus. A surface particle representation allows programmed content to be created independent of the display object and to be reused on many surfaces. We demonstrated this idea through a projector-camera system that acquires the object geometry and enables direct interaction through an IR tracked stylus. We present three motivating example applications, each displayed on three example surfaces. We discuss a set of interaction techniques that show possible avenues for structuring interaction on complicated everyday objects, such as Surface Adaptive GUIs for menu selection. Through a preliminary informal evaluation and interviews with end users, we demonstrate the potential of interacting with surface particles and identify improvements necessary to make this interaction practical on everyday surfaces.",
keywords = "H5.2 [information interfaces and presentation], Multimedia information systems - artificial, augmented, and virtual realities, User interfaces - input devices and strategies, interaction styles H5.1 [information interfaces and presentation]",
author = "Jones, {Brett R.} and Rajinder Sodhi and Campbell, {Roy H.} and Guy Garnett and Bailey, {Brian P.}",
year = "2010",
month = "12",
day = "1",
doi = "10.1109/ISMAR.2010.5643566",
language = "English (US)",
isbn = "9781424493449",
series = "9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings",
pages = "165--174",
booktitle = "9th IEEE International Symposium on Mixed and Augmented Reality 2010",

}

TY - GEN

T1 - Build your world and play in it

T2 - Interacting with surface particles on complex objects

AU - Jones, Brett R.

AU - Sodhi, Rajinder

AU - Campbell, Roy H.

AU - Garnett, Guy

AU - Bailey, Brian P.

PY - 2010/12/1

Y1 - 2010/12/1

N2 - We explore interacting with everyday objects by representing content as interactive surface particles. Users can build their own physical world, map virtual content onto their physical construction and play directly with the surface using a stylus. A surface particle representation allows programmed content to be created independent of the display object and to be reused on many surfaces. We demonstrated this idea through a projector-camera system that acquires the object geometry and enables direct interaction through an IR tracked stylus. We present three motivating example applications, each displayed on three example surfaces. We discuss a set of interaction techniques that show possible avenues for structuring interaction on complicated everyday objects, such as Surface Adaptive GUIs for menu selection. Through a preliminary informal evaluation and interviews with end users, we demonstrate the potential of interacting with surface particles and identify improvements necessary to make this interaction practical on everyday surfaces.

AB - We explore interacting with everyday objects by representing content as interactive surface particles. Users can build their own physical world, map virtual content onto their physical construction and play directly with the surface using a stylus. A surface particle representation allows programmed content to be created independent of the display object and to be reused on many surfaces. We demonstrated this idea through a projector-camera system that acquires the object geometry and enables direct interaction through an IR tracked stylus. We present three motivating example applications, each displayed on three example surfaces. We discuss a set of interaction techniques that show possible avenues for structuring interaction on complicated everyday objects, such as Surface Adaptive GUIs for menu selection. Through a preliminary informal evaluation and interviews with end users, we demonstrate the potential of interacting with surface particles and identify improvements necessary to make this interaction practical on everyday surfaces.

KW - H5.2 [information interfaces and presentation]

KW - Multimedia information systems - artificial, augmented, and virtual realities

KW - User interfaces - input devices and strategies, interaction styles H5.1 [information interfaces and presentation]

UR - http://www.scopus.com/inward/record.url?scp=78651077225&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78651077225&partnerID=8YFLogxK

U2 - 10.1109/ISMAR.2010.5643566

DO - 10.1109/ISMAR.2010.5643566

M3 - Conference contribution

AN - SCOPUS:78651077225

SN - 9781424493449

T3 - 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings

SP - 165

EP - 174

BT - 9th IEEE International Symposium on Mixed and Augmented Reality 2010

ER -