Seeing Aural: An Installation Transferring the Materials You Gaze to Sounds You Hear

Yi-Ching Huang, Kuan-Ying Wu, Mon-Chu Chen

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

1 Citaat (Scopus)


We present an audio installation allowing participants to create sounds by looking at different parts of surfaces or objects in various color and texture. By hacking a desktop eye tracker to track gaze points in 3D space, and deploying a webcam to pick up the hue, saturation and brightness of gazed material, we create an experimental musical instrument that can be played by eye gaze. Users have the freedom of choosing different raw materials and explore ways of seeing as a mean of self-expression to create a unique audio experience.
Originele taal-2Niet gedefinieerd
TitelProceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction
Plaats van productieNew York, NY, USA
UitgeverijAssociation for Computing Machinery, Inc
ISBN van geprinte versie9781450326353
StatusGepubliceerd - 2014
Extern gepubliceerdJa

Publicatie series

NaamTEI '14
UitgeverijAssociation for Computing Machinery


  • eye tracking
  • sound design
  • gaze interaction

Citeer dit