Visualizing natural language interaction for conversational in-vehicle information systems to minimize driver distraction

Michael Braun; Nora Broy; Bastian Pfleging; Florian Alt

doi:10.1007/s12193-019-00301-2

Visualizing natural language interaction for conversational in-vehicle information systems to minimize driver distraction

Michael Braun (Corresponding author), Nora Broy, Bastian Pfleging, Florian Alt

Future Everyday

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

In this paper we investigate how natural language interfaces can be integrated with cars in a way such that their influence on driving performance is being minimized. In particular, we focus on how speech-based interaction can be supported through a visualization of the conversation. Our work is motivated by the fact that speech interfaces (like Alexa, Siri, Cortana, etc.) are increasingly finding their way into our everyday life. We expect such interfaces to become commonplace in vehicles in the future. Cars are a challenging environment, since speech interaction here is a secondary task that should not negatively affect the primary task, that is driving. At the outset of our work, we identify the design space for such interfaces. We then compare different visualization concepts in a driving simulator study with 64 participants. Our results yield that (1) text summaries support drivers in recalling information and enhances user experience but can also increase distraction, (2) the use of keywords minimizes cognitive load and influence on driving performance, and (3) the use of icons increases the attractiveness of the interface.

Language	English
Pages	71-88
Number of pages	18
Journal	Journal on Multimodal User Interfaces
Volume	13
Issue number	2
Early online date	19 Mar 2019
DOIs	10.1007/s12193-019-00301-2
State	Published - Jun 2019

Fingerprint

Information systems

Railroad cars

Visualization

Simulators

Keywords

Automotive user interfaces
Human–computer interaction
Natural language interfaces

Cite this

Braun, M., Broy, N., Pfleging, B., & Alt, F. (2019). Visualizing natural language interaction for conversational in-vehicle information systems to minimize driver distraction. Journal on Multimodal User Interfaces, 13(2), 71-88. DOI: 10.1007/s12193-019-00301-2

Braun, Michael ; Broy, Nora ; Pfleging, Bastian ; Alt, Florian. / Visualizing natural language interaction for conversational in-vehicle information systems to minimize driver distraction. In: Journal on Multimodal User Interfaces. 2019 ; Vol. 13, No. 2. pp. 71-88

@article{216312a8419946b6ad17fa0bcb507218,

title = "Visualizing natural language interaction for conversational in-vehicle information systems to minimize driver distraction",

abstract = "In this paper we investigate how natural language interfaces can be integrated with cars in a way such that their influence on driving performance is being minimized. In particular, we focus on how speech-based interaction can be supported through a visualization of the conversation. Our work is motivated by the fact that speech interfaces (like Alexa, Siri, Cortana, etc.) are increasingly finding their way into our everyday life. We expect such interfaces to become commonplace in vehicles in the future. Cars are a challenging environment, since speech interaction here is a secondary task that should not negatively affect the primary task, that is driving. At the outset of our work, we identify the design space for such interfaces. We then compare different visualization concepts in a driving simulator study with 64 participants. Our results yield that (1) text summaries support drivers in recalling information and enhances user experience but can also increase distraction, (2) the use of keywords minimizes cognitive load and influence on driving performance, and (3) the use of icons increases the attractiveness of the interface.",

keywords = "Automotive user interfaces, Human–computer interaction, Natural language interfaces",

author = "Michael Braun and Nora Broy and Bastian Pfleging and Florian Alt",

year = "2019",

month = "6",

doi = "10.1007/s12193-019-00301-2",

language = "English",

volume = "13",

pages = "71--88",

journal = "Journal on Multimodal User Interfaces",

issn = "1783-7677",

publisher = "Springer",

number = "2",

}

Braun, M, Broy, N, Pfleging, B & Alt, F 2019, 'Visualizing natural language interaction for conversational in-vehicle information systems to minimize driver distraction' Journal on Multimodal User Interfaces, vol. 13, no. 2, pp. 71-88. DOI: 10.1007/s12193-019-00301-2

Visualizing natural language interaction for conversational in-vehicle information systems to minimize driver distraction. / Braun, Michael (Corresponding author); Broy, Nora; Pfleging, Bastian; Alt, Florian.

In: Journal on Multimodal User Interfaces, Vol. 13, No. 2, 06.2019, p. 71-88.

Research output: Contribution to journal › Article › Academic › peer-review

TY - JOUR

T1 - Visualizing natural language interaction for conversational in-vehicle information systems to minimize driver distraction

AU - Braun,Michael

AU - Broy,Nora

AU - Pfleging,Bastian

AU - Alt,Florian

PY - 2019/6

Y1 - 2019/6

N2 - In this paper we investigate how natural language interfaces can be integrated with cars in a way such that their influence on driving performance is being minimized. In particular, we focus on how speech-based interaction can be supported through a visualization of the conversation. Our work is motivated by the fact that speech interfaces (like Alexa, Siri, Cortana, etc.) are increasingly finding their way into our everyday life. We expect such interfaces to become commonplace in vehicles in the future. Cars are a challenging environment, since speech interaction here is a secondary task that should not negatively affect the primary task, that is driving. At the outset of our work, we identify the design space for such interfaces. We then compare different visualization concepts in a driving simulator study with 64 participants. Our results yield that (1) text summaries support drivers in recalling information and enhances user experience but can also increase distraction, (2) the use of keywords minimizes cognitive load and influence on driving performance, and (3) the use of icons increases the attractiveness of the interface.

AB - In this paper we investigate how natural language interfaces can be integrated with cars in a way such that their influence on driving performance is being minimized. In particular, we focus on how speech-based interaction can be supported through a visualization of the conversation. Our work is motivated by the fact that speech interfaces (like Alexa, Siri, Cortana, etc.) are increasingly finding their way into our everyday life. We expect such interfaces to become commonplace in vehicles in the future. Cars are a challenging environment, since speech interaction here is a secondary task that should not negatively affect the primary task, that is driving. At the outset of our work, we identify the design space for such interfaces. We then compare different visualization concepts in a driving simulator study with 64 participants. Our results yield that (1) text summaries support drivers in recalling information and enhances user experience but can also increase distraction, (2) the use of keywords minimizes cognitive load and influence on driving performance, and (3) the use of icons increases the attractiveness of the interface.

KW - Automotive user interfaces

KW - Human–computer interaction

KW - Natural language interfaces

UR - http://www.scopus.com/inward/record.url?scp=85063193058&partnerID=8YFLogxK

U2 - 10.1007/s12193-019-00301-2

DO - 10.1007/s12193-019-00301-2

M3 - Article

VL - 13

SP - 71

EP - 88

JO - Journal on Multimodal User Interfaces

T2 - Journal on Multimodal User Interfaces