commit 6b9da6725e1f49f997b260b89668b711080eabd7 Author: koguzhan Date: Thu Jun 27 16:59:09 2019 +0200 wer results diff --git a/dev/oguz_2019_uzbek_1_eval.txt b/dev/oguz_2019_uzbek_1_eval.txt new file mode 100644 index 0000000..37b31ab --- /dev/null +++ b/dev/oguz_2019_uzbek_1_eval.txt @@ -0,0 +1,28 @@ +Test file: 'istanbultr.txt' +Reference file 'turistanbul.txt' + +Statistics about input files +------------------------------------------------------- +Number of words in reference: 206 +Number of words in test: 208 +Number of unknown words (marked with a star) in test: 28 +Percentage of unknown words: 13.46 % + +Results when removing unknown-word marks (stars) +------------------------------------------------------- +Edit distance: 78 +Word error rate (WER): 37.86 % +Number of position-independent correct words: 132 +Position-independent word error rate (PER): 36.89 % + +Results when unknown-word marks (stars) are not removed +------------------------------------------------------- +Edit distance: 76 +Word Error Rate (WER): 36.89 % +Number of position-independent correct words: 134 +Position-independent word error rate (PER): 35.92 % + +Statistics about the translation of unknown words +------------------------------------------------------- +Number of unknown words which were free rides: -2 +Percentage of unknown words that were free rides: -7.14 %