Employing Automatic Speech Recognition for Quantitative Oral Corrective Feedback in Japanese Second or Foreign Language Education

Kataoka, Yuka and Thamrin, Achmad Husni and Murai, Jun and Kataoka, Kotaro (2020) Employing Automatic Speech Recognition for Quantitative Oral Corrective Feedback in Japanese Second or Foreign Language Education. In: ACM International Conference Proceeding Series, 28 October 2019 - 31 October 2019, 157137.

Full text not available from this repository. (Request a copy)

Abstract

In Second or Foreign Language (SFL) education, a number of studies in applied linguistics have addressed a common issue of how teachers can provide effective feedback to correct learner's erroneous utterances during a classroom hour. Oral Corrective Feedback (OCF) is generally time-consuming and labor-intensive work for teachers. The use of ASR (Automatic Speech Recognition) in SFL education has drawn attention from both teachers and learners to increase the learning effect and efficiency. We designed and integrated Quantitative OCF using Google Cloud Speech-to-Text as a part of the oral assessment using an LMS (Learning Management System) for Japanese SFL courses. The level of learners is a starter's level without any prerequisite knowledge of Japanese language. Preliminary experiments using a total of 214 audio datasets by non-native speakers exhibited that 37.4% of the datasets were recognized properly as Japanese sentences. However, as the remainder of the datasets contains erroneous utterances, characteristics of intonation, or noise, ASR successfully detected word-based errors with high accuracy (82.4%) but low precision (28.1%). Oral assessment employing ASR is highly promising as a complementary system for teachers on partially automating the assessment of audio data from learners with evidence and priority orders as well as significantly reducing teachers' scoring workload and time spent on the most problematic part of the students' speech. While our implementation still requires teachers to double-check, such overhead is small and affordable.

[error in script]
IITH Creators:
IITH CreatorsORCiD
Kataoka, KotaroUNSPECIFIED
Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Automatic speech recognition; Complementary systems; Corrective feedbacks; Foreign language; Labor intensive; Learning effects; Learning management system; Non-native speakers
Subjects: Computer science
Divisions: Department of Computer Science & Engineering
Depositing User: . LibTrainee 2021
Date Deposited: 29 Jul 2021 11:07
Last Modified: 29 Jul 2021 11:07
URI: http://raiith.iith.ac.in/id/eprint/8562
Publisher URL: http://doi.org/10.1145/3369255.3369285
Related URLs:

    Actions (login required)

    View Item View Item
    Statistics for RAIITH ePrint 8562 Statistics for this ePrint Item