Pronunciation Intelligibility Remediation with Pocketsphinx.js

The proposed framework will implement a user interface capable of collecting audio signal from microphone corresponding to a prompted text and perform a comprehensive speech analysis to produce a report of mispronounced segments of speech in the collected audio. Audio collection is performed asynchronously through web workers in browsers or flash actionscript as a fallback. The collected audio is parallely decoded using multiple grammars within pocketsphinx framework and standardized acoustic scores for each decoded unit is compared across grammars to evaluate the pronunciation. These grammars form the core contribution of this project wherein they act as a panel of native and non-native transcriptionists or recognition models predicting the output as intelligible to each of them.