Creating and sharing knowledge for telecommunications

Automatic Annotation of Disfluent Speech in Children's Reading Tasks

Proença , J. ; Celorico, D. ; Lopes, C. ; Candeias, S. ; Perdigão, F.

Automatic Annotation of Disfluent Speech in Children's Reading Tasks, Proc IX Jornadas en Tecnologías del Habla and V Iberian SLTech Workshop IberSPEECH 2016, Lisbon, Portugal, Vol. -, pp. 172 - 181, November, 2016.

Digital Object Identifier:


The automatic evaluation of reading performance of children is an important alternative to any manual or 1-on-1 evaluation by teachers or tutors. To do this, it is necessary to detect several types of reading miscues. This work presents an approach to annotate reading speech while detecting false-starts, repetitions and mispronunciations, three of the most common disfluencies. Using speech data of 6-10 year old children reading sentences and pseudowords, we apply a two-step process: first, an automatic alignment is performed to get the best possible word-level segmentation and detect syllable based false-starts and word repetitions by using a strict FST (Finite State Transducer); then, words are classified as being mispronounced or not through a likelihood measure of pronunciation by using phone posterior probabilities estimated by a neural network. This work advances towards getting the amount and severity of disfluencies to provide a reading ability score computed from several sentence reading tasks.