15th International Congress of Phonetic Sciences (ICPhS-15)
Formerly we proposed a new intonation labeling scheme called X-JToBI. There were two reasons that we needed a new scheme: a) to describe prosodic features more accurately and b) to improve inter-labeler reliability. In this paper, we mainly discuss the verification of improvement of inter-labeler reliability by comparing the results of X-JToBI labeling with that of J_ToBI. An analysis of inter-labeler reliability using Cohen's kappa showed that kappa was higher for X-JToBI in all tone labels including boundary pitch movement, accent, and phrasal tone. Exact matching between the time-stamp of tone labels and the timing of physical events helps improve inter-labeler agreement. We also found that kappa for X-JToBI was higher than for J_ToBI in all of break index labels. However, there was no significant difference when the labels for disfluencies and filled-pauses were excluded. This suggests the effectiveness of newly introduced tone and BI labels for filled-pauses and various disfluencies. The observed rate of overall agreement rose from 75% to 88% overall.
Bibliographic reference. Kikuchi, Hideaki / Maekawa, Kikuo (2003): "Evaluation of the effectiveness of "x-JToBI": a new prosodic labeling scheme for spontaneous Japanese speech", In ICPhS-15, 579-582.