The evaluation metric will be the Levenshtein distance (character level minimum edit distance) from the ground truth. The labels will have the sequence of phonemes, but not the alignment. To handle this CTC Loss will be used during training and a search should be used on the output distribution for prediction. More information is provided in the writeup.
id,label
0,.N pHhEk fYszSiH.