Exploring gesture-based tangible interactions with a lighting AI agent

Milica Pavlovic; Sara Colombo; Yihyun Lim; Federico Casalegno

doi:10.1007/978-3-030-25629-6_67

Exploring gesture-based tangible interactions with a lighting AI agent

Milica Pavlovic
, Sara Colombo
, Yihyun Lim
, Federico Casalegno

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

3 Citations (Scopus)

Abstract

The paper explores a gestural and visual language to interact with an Artificial Intelligent agent controlling connected lighting systems. Six interaction modalities (four gestural and two visual) were designed and tested with users in order to collect feedback on their intuitiveness, comfort and engagement level. A comparison between traditional voice-based interaction modalities with AI and the proposed gesture-based language was performed. Preliminary results are discussed, including the importance of cognitive metaphors in gesture-based interaction, the relation between intuitiveness, innovation, and engagement, and the advantages provided by gesture-based interactions in terms of privacy, subtleness, and pleasantness, versus the limited options and the need to learn a codified language. Insights will help designers in the development of seamless interactions with AI agents for ambient intelligent systems.

Original language	English
Title of host publication	Human Interaction and Emerging Technologies - Proceedings of the 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019
Editors	Tareq Ahram, Redha Taiar, Serge Colson, Arnaud Choplin
Publisher	Springer
Pages	434-440
Number of pages	7
ISBN (Print)	9783030256289
DOIs	https://doi.org/10.1007/978-3-030-25629-6_67
Publication status	Published - 2020
Externally published	Yes
Event	1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019 - Nice, France Duration: 22 Aug 2019 → 24 Aug 2019

Publication series

Name	Advances in Intelligent Systems and Computing
Volume	1018
ISSN (Print)	2194-5357
ISSN (Electronic)	2194-5365

Conference

Conference	1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019
Country/Territory	France
City	Nice
Period	22/08/19 → 24/08/19

Bibliographical note

Funding Information:
Acknowledgments. This research is a result of collaboration between MIT Design Lab and Signify. Doctoral research of the author M. Pavlovic has been funded by TIM S.p.A., Services Innovation Department, Joint Open Lab Digital Life, Milan, Italy.

Funding Information:
This research is a result of collaboration between MIT Design Lab and Signify. Doctoral research of the author M. Pavlovic has been funded by TIM S.p.A., Services Innovation Department, Joint Open Lab Digital Life, Milan, Italy.

Publisher Copyright:
© 2020, Springer Nature Switzerland AG.

Funding

Acknowledgments. This research is a result of collaboration between MIT Design Lab and Signify. Doctoral research of the author M. Pavlovic has been funded by TIM S.p.A., Services Innovation Department, Joint Open Lab Digital Life, Milan, Italy. This research is a result of collaboration between MIT Design Lab and Signify. Doctoral research of the author M. Pavlovic has been funded by TIM S.p.A., Services Innovation Department, Joint Open Lab Digital Life, Milan, Italy.

Keywords

AI agent
Ambient UX
Hybrid materials
Tangible interactions

Access to Document

10.1007/978-3-030-25629-6_67

Cite this

Pavlovic, M., Colombo, S., Lim, Y., & Casalegno, F. (2020). Exploring gesture-based tangible interactions with a lighting AI agent. In T. Ahram, R. Taiar, S. Colson, & A. Choplin (Eds.), Human Interaction and Emerging Technologies - Proceedings of the 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019 (pp. 434-440). (Advances in Intelligent Systems and Computing; Vol. 1018). Springer. https://doi.org/10.1007/978-3-030-25629-6_67

Pavlovic, Milica ; Colombo, Sara ; Lim, Yihyun et al. / Exploring gesture-based tangible interactions with a lighting AI agent. Human Interaction and Emerging Technologies - Proceedings of the 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019. editor / Tareq Ahram ; Redha Taiar ; Serge Colson ; Arnaud Choplin. Springer, 2020. pp. 434-440 (Advances in Intelligent Systems and Computing).

@inproceedings{cbf1681729f74158a6f29ba5c935acf3,

title = "Exploring gesture-based tangible interactions with a lighting AI agent",

abstract = "The paper explores a gestural and visual language to interact with an Artificial Intelligent agent controlling connected lighting systems. Six interaction modalities (four gestural and two visual) were designed and tested with users in order to collect feedback on their intuitiveness, comfort and engagement level. A comparison between traditional voice-based interaction modalities with AI and the proposed gesture-based language was performed. Preliminary results are discussed, including the importance of cognitive metaphors in gesture-based interaction, the relation between intuitiveness, innovation, and engagement, and the advantages provided by gesture-based interactions in terms of privacy, subtleness, and pleasantness, versus the limited options and the need to learn a codified language. Insights will help designers in the development of seamless interactions with AI agents for ambient intelligent systems.",

keywords = "AI agent, Ambient UX, Hybrid materials, Tangible interactions",

author = "Milica Pavlovic and Sara Colombo and Yihyun Lim and Federico Casalegno",

note = "Funding Information: Acknowledgments. This research is a result of collaboration between MIT Design Lab and Signify. Doctoral research of the author M. Pavlovic has been funded by TIM S.p.A., Services Innovation Department, Joint Open Lab Digital Life, Milan, Italy. Funding Information: This research is a result of collaboration between MIT Design Lab and Signify. Doctoral research of the author M. Pavlovic has been funded by TIM S.p.A., Services Innovation Department, Joint Open Lab Digital Life, Milan, Italy. Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019 ; Conference date: 22-08-2019 Through 24-08-2019",

year = "2020",

doi = "10.1007/978-3-030-25629-6\_67",

language = "English",

isbn = "9783030256289",

series = "Advances in Intelligent Systems and Computing",

publisher = "Springer",

pages = "434--440",

editor = "Tareq Ahram and Redha Taiar and Serge Colson and Arnaud Choplin",

booktitle = "Human Interaction and Emerging Technologies - Proceedings of the 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019",

address = "Germany",

}

Pavlovic, M, Colombo, S, Lim, Y & Casalegno, F 2020, Exploring gesture-based tangible interactions with a lighting AI agent. in T Ahram, R Taiar, S Colson & A Choplin (eds), Human Interaction and Emerging Technologies - Proceedings of the 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019. Advances in Intelligent Systems and Computing, vol. 1018, Springer, pp. 434-440, 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019, Nice, France, 22/08/19. https://doi.org/10.1007/978-3-030-25629-6_67

Exploring gesture-based tangible interactions with a lighting AI agent. / Pavlovic, Milica; Colombo, Sara; Lim, Yihyun et al.
Human Interaction and Emerging Technologies - Proceedings of the 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019. ed. / Tareq Ahram; Redha Taiar; Serge Colson; Arnaud Choplin. Springer, 2020. p. 434-440 (Advances in Intelligent Systems and Computing; Vol. 1018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Exploring gesture-based tangible interactions with a lighting AI agent

AU - Pavlovic, Milica

AU - Colombo, Sara

AU - Lim, Yihyun

AU - Casalegno, Federico

N1 - Funding Information: Acknowledgments. This research is a result of collaboration between MIT Design Lab and Signify. Doctoral research of the author M. Pavlovic has been funded by TIM S.p.A., Services Innovation Department, Joint Open Lab Digital Life, Milan, Italy. Funding Information: This research is a result of collaboration between MIT Design Lab and Signify. Doctoral research of the author M. Pavlovic has been funded by TIM S.p.A., Services Innovation Department, Joint Open Lab Digital Life, Milan, Italy. Publisher Copyright: © 2020, Springer Nature Switzerland AG.

PY - 2020

Y1 - 2020

N2 - The paper explores a gestural and visual language to interact with an Artificial Intelligent agent controlling connected lighting systems. Six interaction modalities (four gestural and two visual) were designed and tested with users in order to collect feedback on their intuitiveness, comfort and engagement level. A comparison between traditional voice-based interaction modalities with AI and the proposed gesture-based language was performed. Preliminary results are discussed, including the importance of cognitive metaphors in gesture-based interaction, the relation between intuitiveness, innovation, and engagement, and the advantages provided by gesture-based interactions in terms of privacy, subtleness, and pleasantness, versus the limited options and the need to learn a codified language. Insights will help designers in the development of seamless interactions with AI agents for ambient intelligent systems.

AB - The paper explores a gestural and visual language to interact with an Artificial Intelligent agent controlling connected lighting systems. Six interaction modalities (four gestural and two visual) were designed and tested with users in order to collect feedback on their intuitiveness, comfort and engagement level. A comparison between traditional voice-based interaction modalities with AI and the proposed gesture-based language was performed. Preliminary results are discussed, including the importance of cognitive metaphors in gesture-based interaction, the relation between intuitiveness, innovation, and engagement, and the advantages provided by gesture-based interactions in terms of privacy, subtleness, and pleasantness, versus the limited options and the need to learn a codified language. Insights will help designers in the development of seamless interactions with AI agents for ambient intelligent systems.

KW - AI agent

KW - Ambient UX

KW - Hybrid materials

KW - Tangible interactions

UR - https://www.scopus.com/pages/publications/85070000619

U2 - 10.1007/978-3-030-25629-6_67

DO - 10.1007/978-3-030-25629-6_67

M3 - Conference contribution

AN - SCOPUS:85070000619

SN - 9783030256289

T3 - Advances in Intelligent Systems and Computing

SP - 434

EP - 440

BT - Human Interaction and Emerging Technologies - Proceedings of the 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019

A2 - Ahram, Tareq

A2 - Taiar, Redha

A2 - Colson, Serge

A2 - Choplin, Arnaud

PB - Springer

T2 - 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019

Y2 - 22 August 2019 through 24 August 2019

ER -

Pavlovic M, Colombo S, Lim Y, Casalegno F. Exploring gesture-based tangible interactions with a lighting AI agent. In Ahram T, Taiar R, Colson S, Choplin A, editors, Human Interaction and Emerging Technologies - Proceedings of the 1st International Conference on Human Interaction and Emerging Technologies, IHIET 2019. Springer. 2020. p. 434-440. (Advances in Intelligent Systems and Computing). doi: 10.1007/978-3-030-25629-6_67

Exploring gesture-based tangible interactions with a lighting AI agent

Abstract

Publication series

Conference

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this