- dataset: opusTCv20210807
- model: transformer-big
- source language(s): bel bel_Latn bos_Cyrl bos_Latn bul ces csb csb_Latn dsb hbs hbs_Cyrl hrv hsb mkd orv_Cyrl pol rue rus slv srp_Cyrl srp_Latn ukr
- target language(s): spa
- raw source language(s): bel bos bul ces csb dsb hbs hrv hsb mkd orv pol rue rus slv srp ukr
- raw target language(s): spa
- model: transformer-big
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- download: opusTCv20210807_transformer-big_2022-09-15.zip
- test set translations: opusTCv20210807_transformer-big_2022-09-15.test.txt
- test set scores: opusTCv20210807_transformer-big_2022-09-15.eval.txt
| testset | BLEU | chr-F | #sent | #words | BP |
|---|---|---|---|---|---|
| newssyscomb2009.ces-spa | 28.6 | 0.55929 | 502 | 12506 | 0.983 |
| news-test2008.ces-spa | 26.2 | 0.53986 | 2051 | 52596 | 0.995 |
| newstest2009.ces-spa | 26.5 | 0.54471 | 2525 | 68114 | 0.989 |
| newstest2010.ces-spa | 30.9 | 0.57412 | 2489 | 65522 | 0.999 |
| newstest2011.ces-spa | 31.0 | 0.56527 | 3003 | 79476 | 0.996 |
| newstest2012.ces-spa | 30.0 | 0.56170 | 3003 | 79006 | 0.995 |
| newstest2012.rus-spa | 28.0 | 0.53999 | 3003 | 79006 | 0.975 |
| newstest2013.ces-spa | 31.1 | 0.56611 | 3000 | 70528 | 0.969 |
| newstest2013.rus-spa | 30.6 | 0.55494 | 3000 | 70528 | 0.973 |
| Tatoeba-test-v2021-08-07.bel_Latn-spa | 7.0 | 0.39934 | 1 | 9 | 0.607 |
| Tatoeba-test-v2021-08-07.bel-spa | 47.1 | 0.66322 | 205 | 1412 | 1.000 |
| Tatoeba-test-v2021-08-07.bos_Latn-spa | 59.0 | 0.72132 | 37 | 170 | 0.994 |
| Tatoeba-test-v2021-08-07.bul-spa | 50.5 | 0.67542 | 286 | 1783 | 0.985 |
| Tatoeba-test-v2021-08-07.ces-spa | 54.0 | 0.70980 | 1807 | 12716 | 0.965 |
| Tatoeba-test-v2021-08-07.csb-spa | 18.7 | 0.37765 | 3 | 19 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-spa | 31.3 | 0.55251 | 21 | 113 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-spa | 56.0 | 0.72323 | 607 | 3766 | 0.971 |
| Tatoeba-test-v2021-08-07.hrv-spa | 56.1 | 0.71113 | 254 | 1702 | 0.952 |
| Tatoeba-test-v2021-08-07.hsb-spa | 43.0 | 0.62054 | 25 | 121 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-spa | 61.1 | 0.74205 | 217 | 1121 | 0.996 |
| Tatoeba-test-v2021-08-07.multi-spa | 50.8 | 0.68551 | 10000 | 66011 | 0.977 |
| Tatoeba-test-v2021-08-07.orv-spa | 20.2 | 0.38787 | 33 | 171 | 1.000 |
| Tatoeba-test-v2021-08-07.pol-spa | 48.0 | 0.66130 | 2544 | 18113 | 0.966 |
| Tatoeba-test-v2021-08-07.rue-spa | 43.0 | 0.54136 | 97 | 469 | 0.906 |
| Tatoeba-test-v2021-08-07.rus-spa | 50.6 | 0.68514 | 10506 | 75241 | 0.970 |
| Tatoeba-test-v2021-08-07.slv-spa | 49.2 | 0.65597 | 130 | 720 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-spa | 57.2 | 0.74377 | 136 | 852 | 0.971 |
| Tatoeba-test-v2021-08-07.srp_Latn-spa | 54.1 | 0.72602 | 180 | 1042 | 0.999 |
| Tatoeba-test-v2021-08-07.ukr-spa | 51.7 | 0.68969 | 10115 | 59282 | 0.984 |