Seeing Aural: An Installation Transferring the Materials You Gaze to Sounds You Hear

Yi-Ching Huang, Kuan-Ying Wu, Mon-Chu Chen

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

1 Citation (Scopus)


We present an audio installation allowing participants to create sounds by looking at different parts of surfaces or objects in various color and texture. By hacking a desktop eye tracker to track gaze points in 3D space, and deploying a webcam to pick up the hue, saturation and brightness of gazed material, we create an experimental musical instrument that can be played by eye gaze. Users have the freedom of choosing different raw materials and explore ways of seeing as a mean of self-expression to create a unique audio experience.
Original languageUndefined
Title of host publicationProceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction
Place of PublicationNew York, NY, USA
PublisherAssociation for Computing Machinery, Inc
ISBN (Print)9781450326353
Publication statusPublished - 2014
Externally publishedYes

Cite this