Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations

Pei-Ying Lin; H.K.G. (Kristina) Andersen; R.P.W. Schmidt; Sanne Schoenmakers; Herm Hofmeyer; Pieter Pauwels; Wijnand A. IJsselsteijn

doi:10.1145/3643834.3661543

Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations

Pei-Ying Lin, H.K.G. (Kristina) Andersen, R.P.W. Schmidt, Sanne Schoenmakers, Herm Hofmeyer, Pieter Pauwels, Wijnand A. IJsselsteijn

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

1 Citation (Scopus)

22 Downloads (Pure)

Abstract

Design ideation requires both creative and divergent thinking as well as collaboration and exchange to bring forth new insights and design possibilities. In this paper, we investigate such a collaboration with the use of emerging generative AI tools, and we explore how they may help in achieving agreement and semantic convergence between designers. We conducted workshops using Text-to-Image AI with design students and found that in addition to known advantages of brainstorming, the text prompts required by the AI system engaged students in verbal articulations that aided their design process. In collaborative contexts, the generated images shifted the centre of attention for team members to reach convergence through sharing their interpretations. We conclude that text-to-image AI can be beneficial for students’ design processes as a catalyst for brainstorming rather than a tool for generating design imagery and presentations.

Original language	English
Title of host publication	DIS '24
Subtitle of host publication	Proceedings of the 2024 ACM Designing Interactive Systems Conference
Editors	Anna Vallgårda, Li Jönsson, Jonas Fritsch, Sarah Fdili Alaoui, Christopher A. Le Dantec
Place of Publication	New York
Publisher	ACM
Pages	2753-2767
Number of pages	15
ISBN (Electronic)	979-8-4007-0583-0
DOIs	https://doi.org/10.1145/3643834.3661543
Publication status	Published - 1 Jul 2024
Event	ACM Conference on Designing Interactive Systems 2024, DIS 2024 - Copenhagen, Denmark Duration: 1 Jul 2024 → 5 Jul 2024

Conference

Conference	ACM Conference on Designing Interactive Systems 2024, DIS 2024
Country/Territory	Denmark
City	Copenhagen
Period	1/07/24 → 5/07/24

Keywords

Research through design
co-creation
digital craftsmanship
human-AI collaboration
ideation
semantic convergence

Access to Document

10.1145/3643834.3661543

pdfFinal published version, 22 MBLicence: CC BY-NC-SA

Cite this

Lin, P.-Y., Andersen, H. K. G., Schmidt, R. P. W., Schoenmakers, S., Hofmeyer, H., Pauwels, P., & IJsselsteijn, W. A. (2024). Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations. In A. Vallgårda, L. Jönsson, J. Fritsch, S. Fdili Alaoui, & C. A. Le Dantec (Eds.), DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference (pp. 2753-2767). ACM. https://doi.org/10.1145/3643834.3661543

Lin, Pei-Ying ; Andersen, H.K.G. (Kristina) ; Schmidt, R.P.W. et al. / Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations. DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference. editor / Anna Vallgårda ; Li Jönsson ; Jonas Fritsch ; Sarah Fdili Alaoui ; Christopher A. Le Dantec. New York : ACM, 2024. pp. 2753-2767

@inproceedings{9019841fa4ae485cb779199b34e85ae2,

title = "Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations",

abstract = "Design ideation requires both creative and divergent thinking as well as collaboration and exchange to bring forth new insights and design possibilities. In this paper, we investigate such a collaboration with the use of emerging generative AI tools, and we explore how they may help in achieving agreement and semantic convergence between designers. We conducted workshops using Text-to-Image AI with design students and found that in addition to known advantages of brainstorming, the text prompts required by the AI system engaged students in verbal articulations that aided their design process. In collaborative contexts, the generated images shifted the centre of attention for team members to reach convergence through sharing their interpretations. We conclude that text-to-image AI can be beneficial for students{\textquoteright} design processes as a catalyst for brainstorming rather than a tool for generating design imagery and presentations.",

keywords = "Research through design, co-creation, digital craftsmanship, human-AI collaboration, ideation, semantic convergence",

author = "Pei-Ying Lin and Andersen, {H.K.G. (Kristina)} and R.P.W. Schmidt and Sanne Schoenmakers and Herm Hofmeyer and Pieter Pauwels and IJsselsteijn, {Wijnand A.}",

year = "2024",

month = jul,

day = "1",

doi = "10.1145/3643834.3661543",

language = "English",

pages = "2753--2767",

editor = "Anna Vallg{\aa}rda and Li J{\"o}nsson and Jonas Fritsch and {Fdili Alaoui}, Sarah and {Le Dantec}, {Christopher A.}",

booktitle = "DIS '24",

publisher = "ACM",

note = "ACM Conference on Designing Interactive Systems 2024, DIS 2024 ; Conference date: 01-07-2024 Through 05-07-2024",

}

Lin, P-Y , Andersen, HKG , Schmidt, RPW , Schoenmakers, S , Hofmeyer, H , Pauwels, P & IJsselsteijn, WA 2024, Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations. in A Vallgårda, L Jönsson, J Fritsch, S Fdili Alaoui & CA Le Dantec (eds), DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference. ACM, New York, pp. 2753-2767, ACM Conference on Designing Interactive Systems 2024, DIS 2024, Copenhagen, Denmark, 1/07/24. https://doi.org/10.1145/3643834.3661543

Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations. / Lin, Pei-Ying ; Andersen, H.K.G. (Kristina); Schmidt, R.P.W. et al.
DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference. ed. / Anna Vallgårda; Li Jönsson; Jonas Fritsch; Sarah Fdili Alaoui; Christopher A. Le Dantec. New York: ACM, 2024. p. 2753-2767.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations

AU - Lin, Pei-Ying

AU - Andersen, H.K.G. (Kristina)

AU - Schmidt, R.P.W.

AU - Schoenmakers, Sanne

AU - Hofmeyer, Herm

AU - Pauwels, Pieter

AU - IJsselsteijn, Wijnand A.

PY - 2024/7/1

Y1 - 2024/7/1

N2 - Design ideation requires both creative and divergent thinking as well as collaboration and exchange to bring forth new insights and design possibilities. In this paper, we investigate such a collaboration with the use of emerging generative AI tools, and we explore how they may help in achieving agreement and semantic convergence between designers. We conducted workshops using Text-to-Image AI with design students and found that in addition to known advantages of brainstorming, the text prompts required by the AI system engaged students in verbal articulations that aided their design process. In collaborative contexts, the generated images shifted the centre of attention for team members to reach convergence through sharing their interpretations. We conclude that text-to-image AI can be beneficial for students’ design processes as a catalyst for brainstorming rather than a tool for generating design imagery and presentations.

AB - Design ideation requires both creative and divergent thinking as well as collaboration and exchange to bring forth new insights and design possibilities. In this paper, we investigate such a collaboration with the use of emerging generative AI tools, and we explore how they may help in achieving agreement and semantic convergence between designers. We conducted workshops using Text-to-Image AI with design students and found that in addition to known advantages of brainstorming, the text prompts required by the AI system engaged students in verbal articulations that aided their design process. In collaborative contexts, the generated images shifted the centre of attention for team members to reach convergence through sharing their interpretations. We conclude that text-to-image AI can be beneficial for students’ design processes as a catalyst for brainstorming rather than a tool for generating design imagery and presentations.

KW - Research through design

KW - co-creation

KW - digital craftsmanship

KW - human-AI collaboration

KW - ideation

KW - semantic convergence

UR - http://www.scopus.com/inward/record.url?scp=85198905887&partnerID=8YFLogxK

U2 - 10.1145/3643834.3661543

DO - 10.1145/3643834.3661543

M3 - Conference contribution

SP - 2753

EP - 2767

BT - DIS '24

A2 - Vallgårda, Anna

A2 - Jönsson, Li

A2 - Fritsch, Jonas

A2 - Fdili Alaoui, Sarah

A2 - Le Dantec, Christopher A.

PB - ACM

CY - New York

T2 - ACM Conference on Designing Interactive Systems 2024, DIS 2024

Y2 - 1 July 2024 through 5 July 2024

ER -

Lin PY , Andersen HKG , Schmidt RPW , Schoenmakers S , Hofmeyer H , Pauwels P et al. Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations. In Vallgårda A, Jönsson L, Fritsch J, Fdili Alaoui S, Le Dantec CA, editors, DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference. New York: ACM. 2024. p. 2753-2767 doi: 10.1145/3643834.3661543

Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this