Effects of speech-enabled LLM-based chatbots on L2 learning outcomes and affective domains: a multilevel meta-analysis

Citations

WEB OF SCIENCE

0
Citations

SCOPUS

0

초록

Recent developments in natural language processing and automatic speech recognition have significantly advanced chatbot communication using the voice mode, establishing these tools as viable resources for L2 speaking practice. More recently, the L2 chatbot domain has leveraged large language models (LLMs) to enhance contextual understanding and facilitate meaningful dialogues, prompting research into the effects of speech- and LLM-based chatbots on L2 learning outcomes and affective domains. This study presents a synthesis of these findings using a multilevel meta-analysis. Based on a dataset of 19 studies (32 samples, N = 2,643), the results revealed that the overall effect size for L2 learning outcomes was 0.68 (p < 0.001). The overall effect size for affective domains was 0.64 (p < 0.001). Moreover, moderator analyses indicated that a range of learner and intervention characteristics, including learner proficiency, educational level, interaction format, and context of chatbot use, significantly influenced the overall effectiveness.

키워드

speech-enabled chatbot; generative AI; L2 oral communication; multilevel meta-analysis; affective variable; LANGUAGE; BOTS
제목
Effects of speech-enabled LLM-based chatbots on L2 learning outcomes and affective domains: a multilevel meta-analysis
저자
Lee, Eunjin; Lee, Hansol; Lee, Jang Ho
DOI
10.1515/iral-2026-0172
발행일
2026-10
유형
Article; Early Access
저널명
IRAL - International Review of Applied Linguistics in Language Teaching