AIlingo: Contextual Language Learning with Artificial Intelligence in Real-World Contexts

Tianqin Lu; Sahil Bhatnagar; Nick van Geenen; Yinying Miao; Zitian Zhang; Aaqib Saeed; Jun Hu

doi:10.1145/3758871.3758962

AIlingo: Contextual Language Learning with Artificial Intelligence in Real-World Contexts

Tianqin Lu
, Sahil Bhatnagar
, Nick van Geenen
, Yinying Miao
, Zitian Zhang
, Aaqib Saeed
, Jun Hu

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

3 Downloads (Pure)

Abstract

Mastering foreign languages is essential in the globalized modern world in terms of career development and cross-cultural interactions. Mobile assisted language learning (MALL) provides a convenient and accessible platform, with recent advancements in artificial intelligence (AI) providing opportunities to improve contextualized learning experiences. This study presents AIlingo, an AI-enabled MALL tool designed to provide immersive language learning experiences within real-world contexts of learners. AIlingo uses pre-trained AI models for object detection, image captioning, text generation, and text-to-speech, enabling learners to improve vocabulary and sentence formulation by recognizing everyday objects. The user study evaluates AIlingo through the User Experience Questionnaire (UEQ) and semi-structured interviews, providing insights for further development efforts.

Original language	English
Title of host publication	CHCHI '24
Subtitle of host publication	Proceedings of the Twelfth International Symposium of Chinese CHI
Place of Publication	New York
Publisher	Association for Computing Machinery, Inc.
Pages	765-773
Number of pages	9
ISBN (Electronic)	979-8-4007-1389-7
DOIs	https://doi.org/10.1145/3758871.3758962
Publication status	Published - 29 Oct 2025
Event	12th International Symposium of Chinese CHI, Chinese CHI 2024 - Shenzhen, China Duration: 22 Nov 2024 → 25 Nov 2024

Conference

Conference	12th International Symposium of Chinese CHI, Chinese CHI 2024
Country/Territory	China
City	Shenzhen
Period	22/11/24 → 25/11/24

Bibliographical note

Publisher Copyright:
© 2024 Copyright held by the owner/author(s).

Keywords

Artificial Intelligence
Contextual Learning
Mobile Assisted Language Learning

Access to Document

10.1145/3758871.3758962

pdfFinal published version, 11.2 MBLicence: CC BY

Cite this

@inproceedings{33d84c80e6c6443793923ba73de6869f,

title = "AIlingo: Contextual Language Learning with Artificial Intelligence in Real-World Contexts",

abstract = "Mastering foreign languages is essential in the globalized modern world in terms of career development and cross-cultural interactions. Mobile assisted language learning (MALL) provides a convenient and accessible platform, with recent advancements in artificial intelligence (AI) providing opportunities to improve contextualized learning experiences. This study presents AIlingo, an AI-enabled MALL tool designed to provide immersive language learning experiences within real-world contexts of learners. AIlingo uses pre-trained AI models for object detection, image captioning, text generation, and text-to-speech, enabling learners to improve vocabulary and sentence formulation by recognizing everyday objects. The user study evaluates AIlingo through the User Experience Questionnaire (UEQ) and semi-structured interviews, providing insights for further development efforts.",

keywords = "Artificial Intelligence, Contextual Learning, Mobile Assisted Language Learning",

author = "Tianqin Lu and Sahil Bhatnagar and \{van Geenen\}, Nick and Yinying Miao and Zitian Zhang and Aaqib Saeed and Jun Hu",

note = "Publisher Copyright: {\textcopyright} 2024 Copyright held by the owner/author(s).; 12th International Symposium of Chinese CHI, Chinese CHI 2024 ; Conference date: 22-11-2024 Through 25-11-2024",

year = "2025",

month = oct,

day = "29",

doi = "10.1145/3758871.3758962",

language = "English",

pages = "765--773",

booktitle = "CHCHI '24",

publisher = "Association for Computing Machinery, Inc.",

address = "United States",

}

Lu, T, Bhatnagar, S, van Geenen, N, Miao, Y, Zhang, Z, Saeed, A & Hu, J 2025, AIlingo: Contextual Language Learning with Artificial Intelligence in Real-World Contexts. in CHCHI '24: Proceedings of the Twelfth International Symposium of Chinese CHI. Association for Computing Machinery, Inc., New York, pp. 765-773, 12th International Symposium of Chinese CHI, Chinese CHI 2024, Shenzhen, China, 22/11/24. https://doi.org/10.1145/3758871.3758962

AIlingo: Contextual Language Learning with Artificial Intelligence in Real-World Contexts. / Lu, Tianqin; Bhatnagar, Sahil; van Geenen, Nick et al.
CHCHI '24: Proceedings of the Twelfth International Symposium of Chinese CHI. New York: Association for Computing Machinery, Inc., 2025. p. 765-773.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - AIlingo

T2 - 12th International Symposium of Chinese CHI, Chinese CHI 2024

AU - Lu, Tianqin

AU - Bhatnagar, Sahil

AU - van Geenen, Nick

AU - Miao, Yinying

AU - Zhang, Zitian

AU - Saeed, Aaqib

AU - Hu, Jun

PY - 2025/10/29

Y1 - 2025/10/29

N2 - Mastering foreign languages is essential in the globalized modern world in terms of career development and cross-cultural interactions. Mobile assisted language learning (MALL) provides a convenient and accessible platform, with recent advancements in artificial intelligence (AI) providing opportunities to improve contextualized learning experiences. This study presents AIlingo, an AI-enabled MALL tool designed to provide immersive language learning experiences within real-world contexts of learners. AIlingo uses pre-trained AI models for object detection, image captioning, text generation, and text-to-speech, enabling learners to improve vocabulary and sentence formulation by recognizing everyday objects. The user study evaluates AIlingo through the User Experience Questionnaire (UEQ) and semi-structured interviews, providing insights for further development efforts.

AB - Mastering foreign languages is essential in the globalized modern world in terms of career development and cross-cultural interactions. Mobile assisted language learning (MALL) provides a convenient and accessible platform, with recent advancements in artificial intelligence (AI) providing opportunities to improve contextualized learning experiences. This study presents AIlingo, an AI-enabled MALL tool designed to provide immersive language learning experiences within real-world contexts of learners. AIlingo uses pre-trained AI models for object detection, image captioning, text generation, and text-to-speech, enabling learners to improve vocabulary and sentence formulation by recognizing everyday objects. The user study evaluates AIlingo through the User Experience Questionnaire (UEQ) and semi-structured interviews, providing insights for further development efforts.

KW - Artificial Intelligence

KW - Contextual Learning

KW - Mobile Assisted Language Learning

UR - https://www.scopus.com/pages/publications/105023310295

U2 - 10.1145/3758871.3758962

DO - 10.1145/3758871.3758962

M3 - Conference contribution

AN - SCOPUS:105023310295

SP - 765

EP - 773

BT - CHCHI '24

PB - Association for Computing Machinery, Inc.

CY - New York

Y2 - 22 November 2024 through 25 November 2024

ER -

AIlingo: Contextual Language Learning with Artificial Intelligence in Real-World Contexts

Abstract

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this