Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade

Binh Vinh Duc Nguyen; Jihae Han; Maarten Houben; Yssmin Bayoumi; Andrew Vande moere

doi:10.1145/3544548.3580761

Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade

Binh Vinh Duc Nguyen, Jihae Han, Maarten Houben, Yssmin Bayoumi, Andrew Vande moere

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

4 Citations (Scopus)

Abstract

Media architecture exploits interactive technology to encourage passers-by to engage with an architectural environment. Whereas most media architecture installations focus on visual stimulation, we developed a permanent media facade that rhythmically knocks xylophone blocks embedded beneath 11 window sills, according to the human actions constantly traced via an overhead camera. In an attempt to overcome its apparent limitations in engaging passers-by more enduringly and purposefully, our study investigates the impact of feedforward learning, a constructive interaction method that instructs passers-by about the results of their actions. Based on a comparative (n=25) and a one-month in-the-wild (n=1877) study, we propose how feedforward learning could empower passers-by to understand the interaction of more abstract types of media architecture, and how particular quantitative indicators capturing this learning could predict how enduringly and purposefully a passer-might engage. We believe these contributions could inspire more creative integrations of non-visual modalities in future public interactive interventions.

Original language	English
Title of host publication	CHI '23
Subtitle of host publication	Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Editors	Albrecht Schmidt, Kaisa Väänänen, Tesh Goyal, Per Ola Kristensson, Anicia Peters, Stefanie Mueller, Julie R. Williamson, Max L. Wilson
Place of Publication	New York
Publisher	Association for Computing Machinery, Inc
Number of pages	21
ISBN (Electronic)	978-1-4503-9421-5
DOIs	https://doi.org/10.1145/3544548.3580761
Publication status	Published - 19 Apr 2023
Event	2023 Conference on Human Factors in Computing Systems, CHI 2023 - Hamburg, Germany Duration: 23 Apr 2023 → 28 Apr 2023 https://chi2023.acm.org

Conference

Conference	2023 Conference on Human Factors in Computing Systems, CHI 2023
Abbreviated title	CHI 2023
Country/Territory	Germany
City	Hamburg
Period	23/04/23 → 28/04/23
Internet address	https://chi2023.acm.org

Keywords

comparative study
feedforward learning
human-building interaction
in-the-wild study
interactive architecture
media architecture
musical expression
musical interface
placemaking
public display
rhythm

Access to Document

10.1145/3544548.3580761

pdfFinal published version, 9.55 MB

Cite this

Nguyen, B. V. D., Han, J., Houben, M., Bayoumi, Y., & Vande moere, A. (2023). Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade. In A. Schmidt, K. Väänänen, T. Goyal, P. O. Kristensson, A. Peters, S. Mueller, J. R. Williamson, & M. L. Wilson (Eds.), CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems Article 182 Association for Computing Machinery, Inc. https://doi.org/10.1145/3544548.3580761

Nguyen, Binh Vinh Duc ; Han, Jihae ; Houben, Maarten et al. / Engaging Passers-by with Rhythm : Applying Feedforward Learning to a Xylophonic Media Architecture Facade. CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. editor / Albrecht Schmidt ; Kaisa Väänänen ; Tesh Goyal ; Per Ola Kristensson ; Anicia Peters ; Stefanie Mueller ; Julie R. Williamson ; Max L. Wilson. New York : Association for Computing Machinery, Inc, 2023.

@inproceedings{b61a58cfa66e4e30ab9e838f39f22b70,

title = "Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade",

abstract = "Media architecture exploits interactive technology to encourage passers-by to engage with an architectural environment. Whereas most media architecture installations focus on visual stimulation, we developed a permanent media facade that rhythmically knocks xylophone blocks embedded beneath 11 window sills, according to the human actions constantly traced via an overhead camera. In an attempt to overcome its apparent limitations in engaging passers-by more enduringly and purposefully, our study investigates the impact of feedforward learning, a constructive interaction method that instructs passers-by about the results of their actions. Based on a comparative (n=25) and a one-month in-the-wild (n=1877) study, we propose how feedforward learning could empower passers-by to understand the interaction of more abstract types of media architecture, and how particular quantitative indicators capturing this learning could predict how enduringly and purposefully a passer-might engage. We believe these contributions could inspire more creative integrations of non-visual modalities in future public interactive interventions.",

keywords = "comparative study, feedforward learning, human-building interaction, in-the-wild study, interactive architecture, media architecture, musical expression, musical interface, placemaking, public display, rhythm",

author = "Nguyen, {Binh Vinh Duc} and Jihae Han and Maarten Houben and Yssmin Bayoumi and {Vande moere}, Andrew",

year = "2023",

month = apr,

day = "19",

doi = "10.1145/3544548.3580761",

language = "English",

editor = "Albrecht Schmidt and Kaisa V{\"a}{\"a}n{\"a}nen and Tesh Goyal and Kristensson, {Per Ola} and Anicia Peters and Stefanie Mueller and Williamson, {Julie R.} and Wilson, {Max L.}",

booktitle = "CHI '23",

publisher = "Association for Computing Machinery, Inc",

address = "United States",

note = "2023 Conference on Human Factors in Computing Systems, CHI 2023, CHI 2023 ; Conference date: 23-04-2023 Through 28-04-2023",

url = "https://chi2023.acm.org",

}

Nguyen, BVD, Han, J, Houben, M, Bayoumi, Y & Vande moere, A 2023, Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade. in A Schmidt, K Väänänen, T Goyal, PO Kristensson, A Peters, S Mueller, JR Williamson & ML Wilson (eds), CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems., 182, Association for Computing Machinery, Inc, New York, 2023 Conference on Human Factors in Computing Systems, CHI 2023, Hamburg, Germany, 23/04/23. https://doi.org/10.1145/3544548.3580761

Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade. / Nguyen, Binh Vinh Duc; Han, Jihae; Houben, Maarten et al.
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ed. / Albrecht Schmidt; Kaisa Väänänen; Tesh Goyal; Per Ola Kristensson; Anicia Peters; Stefanie Mueller; Julie R. Williamson; Max L. Wilson. New York: Association for Computing Machinery, Inc, 2023. 182.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Engaging Passers-by with Rhythm

T2 - 2023 Conference on Human Factors in Computing Systems, CHI 2023

AU - Nguyen, Binh Vinh Duc

AU - Han, Jihae

AU - Houben, Maarten

AU - Bayoumi, Yssmin

AU - Vande moere, Andrew

PY - 2023/4/19

Y1 - 2023/4/19

N2 - Media architecture exploits interactive technology to encourage passers-by to engage with an architectural environment. Whereas most media architecture installations focus on visual stimulation, we developed a permanent media facade that rhythmically knocks xylophone blocks embedded beneath 11 window sills, according to the human actions constantly traced via an overhead camera. In an attempt to overcome its apparent limitations in engaging passers-by more enduringly and purposefully, our study investigates the impact of feedforward learning, a constructive interaction method that instructs passers-by about the results of their actions. Based on a comparative (n=25) and a one-month in-the-wild (n=1877) study, we propose how feedforward learning could empower passers-by to understand the interaction of more abstract types of media architecture, and how particular quantitative indicators capturing this learning could predict how enduringly and purposefully a passer-might engage. We believe these contributions could inspire more creative integrations of non-visual modalities in future public interactive interventions.

AB - Media architecture exploits interactive technology to encourage passers-by to engage with an architectural environment. Whereas most media architecture installations focus on visual stimulation, we developed a permanent media facade that rhythmically knocks xylophone blocks embedded beneath 11 window sills, according to the human actions constantly traced via an overhead camera. In an attempt to overcome its apparent limitations in engaging passers-by more enduringly and purposefully, our study investigates the impact of feedforward learning, a constructive interaction method that instructs passers-by about the results of their actions. Based on a comparative (n=25) and a one-month in-the-wild (n=1877) study, we propose how feedforward learning could empower passers-by to understand the interaction of more abstract types of media architecture, and how particular quantitative indicators capturing this learning could predict how enduringly and purposefully a passer-might engage. We believe these contributions could inspire more creative integrations of non-visual modalities in future public interactive interventions.

KW - comparative study

KW - feedforward learning

KW - human-building interaction

KW - in-the-wild study

KW - interactive architecture

KW - media architecture

KW - musical expression

KW - musical interface

KW - placemaking

KW - public display

KW - rhythm

UR - http://www.scopus.com/inward/record.url?scp=85160015701&partnerID=8YFLogxK

U2 - 10.1145/3544548.3580761

DO - 10.1145/3544548.3580761

M3 - Conference contribution

BT - CHI '23

A2 - Schmidt, Albrecht

A2 - Väänänen, Kaisa

A2 - Goyal, Tesh

A2 - Kristensson, Per Ola

A2 - Peters, Anicia

A2 - Mueller, Stefanie

A2 - Williamson, Julie R.

A2 - Wilson, Max L.

PB - Association for Computing Machinery, Inc

CY - New York

Y2 - 23 April 2023 through 28 April 2023

ER -

Nguyen BVD, Han J, Houben M, Bayoumi Y, Vande moere A. Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade. In Schmidt A, Väänänen K, Goyal T, Kristensson PO, Peters A, Mueller S, Williamson JR, Wilson ML, editors, CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. New York: Association for Computing Machinery, Inc. 2023. 182 doi: 10.1145/3544548.3580761

Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this