- dataset: opusTCv20210807
- model: transformer-big
- source language(s): bel bel_Latn orv_Cyrl rus ukr
- target language(s): deu
- raw source language(s): bel orv rus ukr
- raw target language(s): deu
- model: transformer-big
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- download: opusTCv20210807_transformer-big_2022-03-14.zip
- test set translations: opusTCv20210807_transformer-big_2022-03-14.test.txt
- test set scores: opusTCv20210807_transformer-big_2022-03-14.eval.txt
| testset | BLEU | chr-F | #sent | #words | BP |
|---|---|---|---|---|---|
| newstest2012.rus-deu | 18.9 | 0.48778 | 3003 | 72886 | 0.986 |
| newstest2013.rus-deu | 24.1 | 0.53322 | 3000 | 63737 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-deu | 42.0 | 0.61867 | 551 | 4178 | 0.996 |
| Tatoeba-test-v2021-08-07.bel_Latn-deu | 2.6 | 8.893 | 3 | 21 | 1.000 |
| Tatoeba-test-v2021-08-07.multi-deu | 52.2 | 0.69745 | 10000 | 70441 | 0.986 |
| Tatoeba-test-v2021-08-07.orv-deu | 10.5 | 0.28800 | 28 | 197 | 0.969 |
| Tatoeba-test-v2021-08-07.rus-deu | 50.7 | 0.69066 | 12800 | 98826 | 0.989 |
| Tatoeba-test-v2021-08-07.ukr-deu | 53.4 | 0.69905 | 10319 | 64637 | 0.990 |
- dataset: opusTCv20210807
- model: transformer-big
- source language(s): bel bel_Latn orv_Cyrl rus ukr
- target language(s): deu
- raw source language(s): bel orv rus ukr
- raw target language(s): deu
- model: transformer-big
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- download: opusTCv20210807_transformer-big_2022-03-19.zip
- test set translations: opusTCv20210807_transformer-big_2022-03-19.test.txt
- test set scores: opusTCv20210807_transformer-big_2022-03-19.eval.txt
| testset | BLEU | chr-F | #sent | #words | BP |
|---|---|---|---|---|---|
| newstest2012.rus-deu | 19.8 | 0.49257 | 3003 | 72886 | 0.980 |
| newstest2013.rus-deu | 25.2 | 0.54015 | 3000 | 63737 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-deu | 44.5 | 0.63398 | 551 | 4178 | 0.991 |
| Tatoeba-test-v2021-08-07.bel_Latn-deu | 2.9 | 9.208 | 3 | 21 | 1.000 |
| Tatoeba-test-v2021-08-07.multi-deu | 52.5 | 0.69962 | 10000 | 70441 | 0.986 |
| Tatoeba-test-v2021-08-07.orv-deu | 12.5 | 0.29537 | 28 | 197 | 0.921 |
| Tatoeba-test-v2021-08-07.rus-deu | 51.6 | 0.69669 | 12800 | 98826 | 0.984 |
| Tatoeba-test-v2021-08-07.ukr-deu | 54.6 | 0.70761 | 10319 | 64637 | 0.988 |
- dataset: opusTCv20210807
- model: transformer-big
- source language(s): bel bel_Latn orv_Cyrl rus ukr
- target language(s): deu
- raw source language(s): bel orv rus ukr
- raw target language(s): deu
- model: transformer-big
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- download: opusTCv20210807_transformer-big_2022-03-23.zip
- test set translations: opusTCv20210807_transformer-big_2022-03-23.test.txt
- test set scores: opusTCv20210807_transformer-big_2022-03-23.eval.txt
| testset | BLEU | chr-F | #sent | #words | BP |
|---|---|---|---|---|---|
| newstest2012.rus-deu | 19.8 | 0.49350 | 3003 | 72886 | 0.976 |
| newstest2013.rus-deu | 25.2 | 0.54036 | 3000 | 63737 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-deu | 44.8 | 0.63290 | 551 | 4178 | 0.989 |
| Tatoeba-test-v2021-08-07.bel_Latn-deu | 2.2 | 0.11023 | 3 | 21 | 1.000 |
| Tatoeba-test-v2021-08-07.multi-deu | 52.2 | 0.69723 | 10000 | 70441 | 0.983 |
| Tatoeba-test-v2021-08-07.orv-deu | 7.0 | 0.28830 | 28 | 197 | 0.985 |
| Tatoeba-test-v2021-08-07.rus-deu | 51.4 | 0.69605 | 12800 | 98826 | 0.982 |
| Tatoeba-test-v2021-08-07.ukr-deu | 54.5 | 0.70668 | 10319 | 64637 | 0.984 |