Employing automatic speech recognition for quantitative oral corrective feedback in Japanese second or foreign language education

Kataoka, Yuka and Thamrin, Achmad Husni and Kataoka, Kotaro and et al, . (2020) Employing automatic speech recognition for quantitative oral corrective feedback in Japanese second or foreign language education. In: 11th International Conference on Education Technology and Computers, ICETC, 28-31 October 2019, Amsterdam, Netherlands.

Full text not available from this repository. (Request a copy)


In Second or Foreign Language (SFL) education, a number of studies in applied linguistics have addressed a common issue of how teachers can provide effective feedback to correct learner's erroneous utterances during a classroom hour. Oral Corrective Feedback (OCF) is generally time-consuming and labor-intensive work for teachers. The use of ASR (Automatic Speech Recognition) in SFL education has drawn attention from both teachers and learners to increase the learning effect and efficiency. We designed and integrated Quantitative OCF using Google Cloud Speech-to-Text as a part of the oral assessment using an LMS (Learning Management System) for Japanese SFL courses. The level of learners is a starter's level without any prerequisite knowledge of Japanese language. Preliminary experiments using a total of 214 audio datasets by non-native speakers exhibited that 37.4% of the datasets were recognized properly as Japanese sentences. However, as the remainder of the datasets contains erroneous utterances, characteristics of intonation, or noise, ASR successfully detected word-based errors with high accuracy (82.4%) but low precision (28.1%). Oral assessment employing ASR is highly promising as a complementary system for teachers on partially automating the assessment of audio data from learners with evidence and priority orders as well as significantly reducing teachers' scoring workload and time spent on the most problematic part of the students' speech. While our implementation still requires teachers to double-check, such overhead is small and affordable.

[error in script]
IITH Creators:
IITH CreatorsORCiD
Kataoka, KotaroUNSPECIFIED
Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Automatic Speech Recognition, Japanese Second or Foreign Language education, Quantitative Oral Corrective Feedback, Indexed in Scopus
Subjects: Computer science
Divisions: Department of Computer Science & Engineering
Depositing User: Team Library
Date Deposited: 25 Feb 2020 08:25
Last Modified: 25 Feb 2020 08:25
URI: http://raiith.iith.ac.in/id/eprint/7468
Publisher URL: http://doi.org/10.1145/3369255.3369285
Related URLs:

Actions (login required)

View Item View Item
Statistics for RAIITH ePrint 7468 Statistics for this ePrint Item