TY - GEN
T1 - Effects of a virtual model’s pitch and speech rate on affective and cognitive learning
AU - Fountoukidou, Sofia
AU - Matzat, Uwe
AU - Ham, Jaap
AU - Midden, Cees
PY - 2019/1/1
Y1 - 2019/1/1
N2 - Various nonverbal behaviors – often referred to as nonverbal immediacy - of both human and virtual teachers have been shown to play a crucial role in student learning. However, past literature provides limited evidence of the effect of a virtual agent’s vocalization, as a nonverbal immediacy cue, on learning outcomes. Even less is known about the effect of nonverbal immediacy on learning when used in conjunction with virtual behavioral modeling. Earlier research provides evidence that virtual behavioral modeling could be an effective instructional method to facilitate learning in multimedia learning environments. The current work investigated the effects of a virtual model that used stronger vs. weaker vocal nonverbal immediacy on affective learning and cognitive learning (both perceived and objective). The operationalization of the virtual model’s vocal nonverbal immediacy has been realized by manipulating the agent’s vocal parameters of pitch and speech rate. We predicted, that a virtual model with stronger vocal nonverbal immediacy (i.e., higher pitch and faster speech rate) would be more effective in influencing individuals’ learning outcomes, as compared to a virtual model with weaker vocal nonverbal immediacy (i.e., lower pitch and slower speech rate). In accordance with our hypotheses, results revealed that participants who received instructions from a virtual model that used stronger vocal nonverbal immediacy showed greater affective learning, and increased perceptions of learning. Support was also found for an effect on participants’ recall. Results and implications of the study’s findings are discussed.
AB - Various nonverbal behaviors – often referred to as nonverbal immediacy - of both human and virtual teachers have been shown to play a crucial role in student learning. However, past literature provides limited evidence of the effect of a virtual agent’s vocalization, as a nonverbal immediacy cue, on learning outcomes. Even less is known about the effect of nonverbal immediacy on learning when used in conjunction with virtual behavioral modeling. Earlier research provides evidence that virtual behavioral modeling could be an effective instructional method to facilitate learning in multimedia learning environments. The current work investigated the effects of a virtual model that used stronger vs. weaker vocal nonverbal immediacy on affective learning and cognitive learning (both perceived and objective). The operationalization of the virtual model’s vocal nonverbal immediacy has been realized by manipulating the agent’s vocal parameters of pitch and speech rate. We predicted, that a virtual model with stronger vocal nonverbal immediacy (i.e., higher pitch and faster speech rate) would be more effective in influencing individuals’ learning outcomes, as compared to a virtual model with weaker vocal nonverbal immediacy (i.e., lower pitch and slower speech rate). In accordance with our hypotheses, results revealed that participants who received instructions from a virtual model that used stronger vocal nonverbal immediacy showed greater affective learning, and increased perceptions of learning. Support was also found for an effect on participants’ recall. Results and implications of the study’s findings are discussed.
KW - Learning
KW - Nonverbal immediacy
KW - Virtual modeling
KW - Vocalization
UR - http://www.scopus.com/inward/record.url?scp=85064573041&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-17287-9_2
DO - 10.1007/978-3-030-17287-9_2
M3 - Conference contribution
AN - SCOPUS:85064573041
SN - 978-3-030-17286-2
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 16
EP - 27
BT - Persuasive Technology
A2 - Karapanos, Evangelos
A2 - Kyza, Eleni
A2 - Oinas-Kukkonen, Harri
A2 - Karppinen, Pasi
A2 - Win, Khin Than
PB - Springer
CY - Cham
T2 - 14th International Conference on Persuasive Technology, PERSUASIVE 2019
Y2 - 9 April 2019 through 11 April 2019
ER -