Kannada Kali: A Smartphone Application for Evaluating Spoken Kannada Words and Detecting Mispronunciations using Self Organizing Maps

Murthy, Savitha and Anand, Ankit and Kumar, Avinash and Cholin, Ajay and Shetty, Ankita and Bhat, Aditya and Venkatesh, Akshay and Kothiwale, Lingaraj and Sitaram, Dinkar and Kumar, Viraj (2018) Kannada Kali: A Smartphone Application for Evaluating Spoken Kannada Words and Detecting Mispronunciations using Self Organizing Maps. In: 2018 IEEE Tenth International Conference On Technology For Education (T4E), DEC 10-13, 2018, Chennai, INDIA, pp. 1-7.

PDF IEEE _Ten_ Int_Con_Tec_Edu_1-7_2018.pdf - Published Version Restricted to Registered users only Download (797kB) | Request a copy

Abstract

Computer Aided Pronunciation Training (CAPT) systems can assist people learning to speak new languages by detecting and correcting mispronunciations. ``Kannada Kali'' is a prototype Android application that leverages learners' increasing access to smartphones to evaluate the pronunciation of Kannada words and provide feedback using a cloud -based framework. A CAPT system typically uses an Automatic Speech Recognition (ASR) sub-system. For sufficient accuracy, ASR systems need to be trained using speech data from both native (L1) and nonnative (L2) speakers. Since the latter type of data is particularly difficult to gather, we follow recent research efforts that seek to minimize the dependency on large speech corpora. We recorded 21 Kannada words (two to five syllables long) pronounced correctly by a Kannada teacher as templates, and 1169 samples of these words spoken by 19 native and non-native Kannada speakers aged 18 to 25 years. These samples were manually rated on a 5-point Likert scale by the Kannada teacher and used to train a neural network classifier for our application. ``Kannada Kali'' provides learners feedback that matches the teacher ratings with an accuracy of 86% on binary classification and 68% on multi-class classification. We also propose a novel approach for detecting mispronunciations using Self Organizing Maps (SOM) and report promising initial results.

Item Type:	Conference Proceedings
Series.:	IEEE International Conference on Technology for Education
Publisher:	IEEE
Additional Information:	IEEE Tenth International Conference on Technology for Education (T4E), Chennai, INDIA, DEC 10-13, 2018
Keywords:	Terms pronunciation evaluation; CAPT; Kannada; mispronunciation detection; SOM
Department/Centre:	Division of Electrical Sciences > Electrical Communication Engineering
Date Deposited:	19 Mar 2019 08:58
Last Modified:	19 Mar 2019 08:58
URI:	http://eprints.iisc.ac.in/id/eprint/61965

Actions (login required)

View Item