Seeing Aural: An Installation Transferring the Materials You Gaze to Sounds You Hear

Yi-Ching Huang; Kuan-Ying Wu; Mon-Chu Chen

doi:10.1145/2540930.2555198

Seeing Aural: An Installation Transferring the Materials You Gaze to Sounds You Hear

Yi-Ching Huang
, Kuan-Ying Wu
, Mon-Chu Chen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

1 Citation (Scopus)

Abstract

We present an audio installation allowing participants to create sounds by looking at different parts of surfaces or objects in various color and texture. By hacking a desktop eye tracker to track gaze points in 3D space, and deploying a webcam to pick up the hue, saturation and brightness of gazed material, we create an experimental musical instrument that can be played by eye gaze. Users have the freedom of choosing different raw materials and explore ways of seeing as a mean of self-expression to create a unique audio experience.

Original language	English
Title of host publication	Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction
Place of Publication	New York, NY, USA
Publisher	Association for Computing Machinery, Inc.
Pages	323–324
ISBN (Print)	9781450326353
DOIs	https://doi.org/10.1145/2540930.2555198
Publication status	Published - 2014
Externally published	Yes

Access to Document

10.1145/2540930.2555198

Cite this

@inproceedings{02508bcb5dc94b4fbaa72f177bc8abb8,

title = "Seeing Aural: An Installation Transferring the Materials You Gaze to Sounds You Hear",

abstract = "We present an audio installation allowing participants to create sounds by looking at different parts of surfaces or objects in various color and texture. By hacking a desktop eye tracker to track gaze points in 3D space, and deploying a webcam to pick up the hue, saturation and brightness of gazed material, we create an experimental musical instrument that can be played by eye gaze. Users have the freedom of choosing different raw materials and explore ways of seeing as a mean of self-expression to create a unique audio experience.",

keywords = "eye tracking, sound design, gaze interaction",

author = "Yi-Ching Huang and Kuan-Ying Wu and Mon-Chu Chen",

year = "2014",

doi = "10.1145/2540930.2555198",

language = "English",

isbn = "9781450326353",

pages = "323–324",

booktitle = "Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction",

publisher = "Association for Computing Machinery, Inc.",

address = "United States",

}

Seeing Aural: An Installation Transferring the Materials You Gaze to Sounds You Hear. / Huang, Yi-Ching; Wu, Kuan-Ying; Chen, Mon-Chu.
Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. New York, NY, USA: Association for Computing Machinery, Inc., 2014. p. 323–324.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Seeing Aural: An Installation Transferring the Materials You Gaze to Sounds You Hear

AU - Huang, Yi-Ching

AU - Wu, Kuan-Ying

AU - Chen, Mon-Chu

PY - 2014

Y1 - 2014

N2 - We present an audio installation allowing participants to create sounds by looking at different parts of surfaces or objects in various color and texture. By hacking a desktop eye tracker to track gaze points in 3D space, and deploying a webcam to pick up the hue, saturation and brightness of gazed material, we create an experimental musical instrument that can be played by eye gaze. Users have the freedom of choosing different raw materials and explore ways of seeing as a mean of self-expression to create a unique audio experience.

AB - We present an audio installation allowing participants to create sounds by looking at different parts of surfaces or objects in various color and texture. By hacking a desktop eye tracker to track gaze points in 3D space, and deploying a webcam to pick up the hue, saturation and brightness of gazed material, we create an experimental musical instrument that can be played by eye gaze. Users have the freedom of choosing different raw materials and explore ways of seeing as a mean of self-expression to create a unique audio experience.

KW - eye tracking

KW - sound design

KW - gaze interaction

U2 - 10.1145/2540930.2555198

DO - 10.1145/2540930.2555198

M3 - Conference contribution

SN - 9781450326353

SP - 323

EP - 324

BT - Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction

PB - Association for Computing Machinery, Inc.

CY - New York, NY, USA

ER -

Seeing Aural: An Installation Transferring the Materials You Gaze to Sounds You Hear

Abstract

Access to Document

Fingerprint

Cite this