- dataset: opus
- model: transformer
- source language(s): bel bel_Latn bos_Latn bul bul_Latn ces dsb hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
- target language(s): bel bel_Latn bos_Latn bul bul_Latn ces dsb hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- a sentence initial language token is required in the form of
>>id<<(id = valid target language ID) - download: opus-2020-07-21.zip
- test set translations: opus-2020-07-21.test.txt
- test set scores: opus-2020-07-21.eval.txt
| testset | BLEU | chr-F |
|---|---|---|
| Tatoeba-test.bel-bul.bel.bul | 19.3 | 0.567 |
| Tatoeba-test.bel-ces.bel.ces | 37.5 | 0.663 |
| Tatoeba-test.bel-hbs.bel.hbs | 47.0 | 0.679 |
| Tatoeba-test.bel-mkd.bel.mkd | 19.3 | 0.546 |
| Tatoeba-test.bel-pol.bel.pol | 48.4 | 0.689 |
| Tatoeba-test.bel-rus.bel.rus | 57.8 | 0.763 |
| Tatoeba-test.bel-ukr.bel.ukr | 55.5 | 0.748 |
| Tatoeba-test.bul-bel.bul.bel | 100.0 | 1.000 |
| Tatoeba-test.bul-ces.bul.ces | 36.9 | 0.601 |
| Tatoeba-test.bul-hbs.bul.hbs | 53.7 | 0.807 |
| Tatoeba-test.bul-mkd.bul.mkd | 32.5 | 0.750 |
| Tatoeba-test.bul-pol.bul.pol | 42.4 | 0.616 |
| Tatoeba-test.bul-rus.bul.rus | 44.4 | 0.651 |
| Tatoeba-test.bul-ukr.bul.ukr | 50.0 | 0.690 |
| Tatoeba-test.ces-bel.ces.bel | 37.5 | 0.581 |
| Tatoeba-test.ces-bul.ces.bul | 75.8 | 0.859 |
| Tatoeba-test.ces-hbs.ces.hbs | 53.1 | 0.676 |
| Tatoeba-test.ces-hsb.ces.hsb | 8.0 | 0.240 |
| Tatoeba-test.ces-mkd.ces.mkd | 24.6 | 0.569 |
| Tatoeba-test.ces-pol.ces.pol | 42.9 | 0.646 |
| Tatoeba-test.ces-rus.ces.rus | 50.2 | 0.685 |
| Tatoeba-test.ces-slv.ces.slv | 4.8 | 0.243 |
| Tatoeba-test.ces-ukr.ces.ukr | 51.9 | 0.680 |
| Tatoeba-test.dsb-pol.dsb.pol | 3.4 | 0.291 |
| Tatoeba-test.dsb-rus.dsb.rus | 12.7 | 0.123 |
| Tatoeba-test.hbs-bel.hbs.bel | 34.1 | 0.551 |
| Tatoeba-test.hbs-bul.hbs.bul | 100.0 | 1.000 |
| Tatoeba-test.hbs-ces.hbs.ces | 37.2 | 0.605 |
| Tatoeba-test.hbs-mkd.hbs.mkd | 19.3 | 0.535 |
| Tatoeba-test.hbs-pol.hbs.pol | 43.0 | 0.638 |
| Tatoeba-test.hbs-rus.hbs.rus | 52.1 | 0.702 |
| Tatoeba-test.hbs-ukr.hbs.ukr | 50.8 | 0.683 |
| Tatoeba-test.hsb-ces.hsb.ces | 19.7 | 0.368 |
| Tatoeba-test.mkd-bel.mkd.bel | 8.1 | 0.350 |
| Tatoeba-test.mkd-bul.mkd.bul | 60.6 | 0.873 |
| Tatoeba-test.mkd-ces.mkd.ces | 12.1 | 0.385 |
| Tatoeba-test.mkd-hbs.mkd.hbs | 19.3 | 0.577 |
| Tatoeba-test.mkd-pol.mkd.pol | 53.7 | 0.817 |
| Tatoeba-test.mkd-rus.mkd.rus | 67.8 | 0.932 |
| Tatoeba-test.mkd-ukr.mkd.ukr | 42.7 | 0.703 |
| Tatoeba-test.multi.multi | 48.5 | 0.671 |
| Tatoeba-test.orv-pol.orv.pol | 11.3 | 0.353 |
| Tatoeba-test.orv-rus.orv.rus | 7.4 | 0.234 |
| Tatoeba-test.orv-ukr.orv.ukr | 7.6 | 0.229 |
| Tatoeba-test.pol-bel.pol.bel | 28.4 | 0.538 |
| Tatoeba-test.pol-bul.pol.bul | 36.9 | 0.580 |
| Tatoeba-test.pol-ces.pol.ces | 42.9 | 0.620 |
| Tatoeba-test.pol-dsb.pol.dsb | 0.8 | 0.026 |
| Tatoeba-test.pol-hbs.pol.hbs | 42.7 | 0.641 |
| Tatoeba-test.pol-mkd.pol.mkd | 19.3 | 0.558 |
| Tatoeba-test.pol-orv.pol.orv | 0.6 | 0.102 |
| Tatoeba-test.pol-rus.pol.rus | 48.3 | 0.671 |
| Tatoeba-test.pol-slv.pol.slv | 6.4 | 0.251 |
| Tatoeba-test.pol-ukr.pol.ukr | 46.7 | 0.664 |
| Tatoeba-test.rus-bel.rus.bel | 35.5 | 0.585 |
| Tatoeba-test.rus-bul.rus.bul | 43.0 | 0.643 |
| Tatoeba-test.rus-ces.rus.ces | 47.8 | 0.655 |
| Tatoeba-test.rus-dsb.rus.dsb | 2.1 | 0.000 |
| Tatoeba-test.rus-hbs.rus.hbs | 43.8 | 0.647 |
| Tatoeba-test.rus-mkd.rus.mkd | 33.2 | 0.633 |
| Tatoeba-test.rus-orv.rus.orv | 0.2 | 0.096 |
| Tatoeba-test.rus-pol.rus.pol | 44.9 | 0.655 |
| Tatoeba-test.rus-slv.rus.slv | 31.1 | 0.472 |
| Tatoeba-test.rus-ukr.rus.ukr | 57.6 | 0.750 |
| Tatoeba-test.slv-ces.slv.ces | 41.6 | 0.601 |
| Tatoeba-test.slv-pol.slv.pol | 38.7 | 0.591 |
| Tatoeba-test.slv-rus.slv.rus | 46.7 | 0.632 |
| Tatoeba-test.slv-ukr.slv.ukr | 34.9 | 0.539 |
| Tatoeba-test.ukr-bel.ukr.bel | 38.7 | 0.607 |
| Tatoeba-test.ukr-bul.ukr.bul | 55.5 | 0.730 |
| Tatoeba-test.ukr-ces.ukr.ces | 50.7 | 0.678 |
| Tatoeba-test.ukr-hbs.ukr.hbs | 47.1 | 0.664 |
| Tatoeba-test.ukr-mkd.ukr.mkd | 19.3 | 0.535 |
| Tatoeba-test.ukr-orv.ukr.orv | 0.1 | 0.078 |
| Tatoeba-test.ukr-pol.ukr.pol | 49.4 | 0.689 |
| Tatoeba-test.ukr-rus.ukr.rus | 63.5 | 0.788 |
| Tatoeba-test.ukr-slv.ukr.slv | 13.9 | 0.289 |
- dataset: opus
- model: transformer
- source language(s): bel bel_Latn bos_Latn bul bul_Latn ces dsb hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
- target language(s): bel bel_Latn bos_Latn bul bul_Latn ces dsb hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- a sentence initial language token is required in the form of
>>id<<(id = valid target language ID) - download: opus-2020-07-27.zip
- test set translations: opus-2020-07-27.test.txt
- test set scores: opus-2020-07-27.eval.txt
| testset | BLEU | chr-F |
|---|---|---|
| newstest2012-cesrus.ces.rus | 15.9 | 0.437 |
| newstest2012-rusces.rus.ces | 13.6 | 0.403 |
| newstest2013-cesrus.ces.rus | 19.8 | 0.473 |
| newstest2013-rusces.rus.ces | 17.9 | 0.449 |
| Tatoeba-test.bel-bul.bel.bul | 100.0 | 1.000 |
| Tatoeba-test.bel-ces.bel.ces | 33.5 | 0.630 |
| Tatoeba-test.bel-hbs.bel.hbs | 45.4 | 0.644 |
| Tatoeba-test.bel-mkd.bel.mkd | 19.3 | 0.531 |
| Tatoeba-test.bel-pol.bel.pol | 46.9 | 0.681 |
| Tatoeba-test.bel-rus.bel.rus | 58.5 | 0.767 |
| Tatoeba-test.bel-ukr.bel.ukr | 55.1 | 0.743 |
| Tatoeba-test.bul-bel.bul.bel | 10.7 | 0.423 |
| Tatoeba-test.bul-ces.bul.ces | 36.9 | 0.585 |
| Tatoeba-test.bul-hbs.bul.hbs | 53.7 | 0.807 |
| Tatoeba-test.bul-mkd.bul.mkd | 31.9 | 0.715 |
| Tatoeba-test.bul-pol.bul.pol | 38.6 | 0.607 |
| Tatoeba-test.bul-rus.bul.rus | 44.8 | 0.655 |
| Tatoeba-test.bul-ukr.bul.ukr | 49.9 | 0.691 |
| Tatoeba-test.ces-bel.ces.bel | 30.9 | 0.585 |
| Tatoeba-test.ces-bul.ces.bul | 75.8 | 0.859 |
| Tatoeba-test.ces-hbs.ces.hbs | 50.0 | 0.661 |
| Tatoeba-test.ces-hsb.ces.hsb | 7.9 | 0.246 |
| Tatoeba-test.ces-mkd.ces.mkd | 24.6 | 0.569 |
| Tatoeba-test.ces-pol.ces.pol | 44.3 | 0.652 |
| Tatoeba-test.ces-rus.ces.rus | 50.8 | 0.690 |
| Tatoeba-test.ces-slv.ces.slv | 4.9 | 0.240 |
| Tatoeba-test.ces-ukr.ces.ukr | 52.9 | 0.687 |
| Tatoeba-test.dsb-pol.dsb.pol | 16.3 | 0.367 |
| Tatoeba-test.dsb-rus.dsb.rus | 12.7 | 0.245 |
| Tatoeba-test.hbs-bel.hbs.bel | 32.9 | 0.531 |
| Tatoeba-test.hbs-bul.hbs.bul | 100.0 | 1.000 |
| Tatoeba-test.hbs-ces.hbs.ces | 40.3 | 0.626 |
| Tatoeba-test.hbs-mkd.hbs.mkd | 19.3 | 0.535 |
| Tatoeba-test.hbs-pol.hbs.pol | 45.0 | 0.650 |
| Tatoeba-test.hbs-rus.hbs.rus | 53.5 | 0.709 |
| Tatoeba-test.hbs-ukr.hbs.ukr | 50.7 | 0.684 |
| Tatoeba-test.hsb-ces.hsb.ces | 17.9 | 0.366 |
| Tatoeba-test.mkd-bel.mkd.bel | 23.6 | 0.548 |
| Tatoeba-test.mkd-bul.mkd.bul | 54.2 | 0.833 |
| Tatoeba-test.mkd-ces.mkd.ces | 12.1 | 0.371 |
| Tatoeba-test.mkd-hbs.mkd.hbs | 19.3 | 0.577 |
| Tatoeba-test.mkd-pol.mkd.pol | 53.7 | 0.833 |
| Tatoeba-test.mkd-rus.mkd.rus | 34.2 | 0.745 |
| Tatoeba-test.mkd-ukr.mkd.ukr | 42.7 | 0.708 |
| Tatoeba-test.multi.multi | 48.5 | 0.672 |
| Tatoeba-test.orv-pol.orv.pol | 10.1 | 0.355 |
| Tatoeba-test.orv-rus.orv.rus | 10.6 | 0.275 |
| Tatoeba-test.orv-ukr.orv.ukr | 7.5 | 0.230 |
| Tatoeba-test.pol-bel.pol.bel | 29.8 | 0.533 |
| Tatoeba-test.pol-bul.pol.bul | 36.8 | 0.578 |
| Tatoeba-test.pol-ces.pol.ces | 43.6 | 0.626 |
| Tatoeba-test.pol-dsb.pol.dsb | 0.9 | 0.097 |
| Tatoeba-test.pol-hbs.pol.hbs | 42.4 | 0.644 |
| Tatoeba-test.pol-mkd.pol.mkd | 19.3 | 0.535 |
| Tatoeba-test.pol-orv.pol.orv | 0.7 | 0.109 |
| Tatoeba-test.pol-rus.pol.rus | 49.6 | 0.680 |
| Tatoeba-test.pol-slv.pol.slv | 7.3 | 0.262 |
| Tatoeba-test.pol-ukr.pol.ukr | 46.8 | 0.664 |
| Tatoeba-test.rus-bel.rus.bel | 34.4 | 0.577 |
| Tatoeba-test.rus-bul.rus.bul | 45.5 | 0.657 |
| Tatoeba-test.rus-ces.rus.ces | 48.0 | 0.659 |
| Tatoeba-test.rus-dsb.rus.dsb | 10.7 | 0.029 |
| Tatoeba-test.rus-hbs.rus.hbs | 44.6 | 0.655 |
| Tatoeba-test.rus-mkd.rus.mkd | 34.9 | 0.617 |
| Tatoeba-test.rus-orv.rus.orv | 0.1 | 0.073 |
| Tatoeba-test.rus-pol.rus.pol | 45.2 | 0.659 |
| Tatoeba-test.rus-slv.rus.slv | 30.4 | 0.476 |
| Tatoeba-test.rus-ukr.rus.ukr | 57.6 | 0.751 |
| Tatoeba-test.slv-ces.slv.ces | 42.5 | 0.604 |
| Tatoeba-test.slv-pol.slv.pol | 39.6 | 0.601 |
| Tatoeba-test.slv-rus.slv.rus | 47.2 | 0.638 |
| Tatoeba-test.slv-ukr.slv.ukr | 36.4 | 0.549 |
| Tatoeba-test.ukr-bel.ukr.bel | 36.9 | 0.597 |
| Tatoeba-test.ukr-bul.ukr.bul | 56.4 | 0.733 |
| Tatoeba-test.ukr-ces.ukr.ces | 52.1 | 0.686 |
| Tatoeba-test.ukr-hbs.ukr.hbs | 47.1 | 0.670 |
| Tatoeba-test.ukr-mkd.ukr.mkd | 20.8 | 0.548 |
| Tatoeba-test.ukr-orv.ukr.orv | 0.2 | 0.058 |
| Tatoeba-test.ukr-pol.ukr.pol | 50.1 | 0.695 |
| Tatoeba-test.ukr-rus.ukr.rus | 63.9 | 0.790 |
| Tatoeba-test.ukr-slv.ukr.slv | 14.5 | 0.288 |
- dataset: opus
- model: transformer
- source language(s): bel bel_Latn bos_Cyrl bos_Latn bul ces cnr cnr_Latn csb csb_Latn dsb eng hbs hbs_Cyrl hrv hsb mkd orv_Cyrl pol rue rus slv srp_Cyrl srp_Latn ukr
- target language(s): bel bel_Latn bos_Cyrl bos_Latn bul ces cnr cnr_Latn csb csb_Latn dsb eng hbs hbs_Cyrl hrv hsb mkd orv_Cyrl pol rue rus slv srp_Cyrl srp_Latn ukr
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- a sentence initial language token is required in the form of
>>id<<(id = valid target language ID) - download: opus-2020-09-26.zip
- test set translations: opus-2020-09-26.test.txt
- test set scores: opus-2020-09-26.eval.txt
| testset | BLEU | chr-F |
|---|---|---|
| newssyscomb2009-ceseng.ces.eng | 21.7 | 0.507 |
| newssyscomb2009-engces.eng.ces | 16.8 | 0.451 |
| news-test2008-engces.eng.ces | 14.8 | 0.429 |
| newstest2009-ceseng.ces.eng | 21.5 | 0.505 |
| newstest2009-engces.eng.ces | 15.4 | 0.439 |
| newstest2010-ceseng.ces.eng | 21.3 | 0.510 |
| newstest2010-engces.eng.ces | 15.9 | 0.447 |
| newstest2011-ceseng.ces.eng | 22.9 | 0.514 |
| newstest2011-engces.eng.ces | 17.0 | 0.450 |
| newstest2012-ceseng.ces.eng | 22.2 | 0.507 |
| newstest2012-cesrus.ces.rus | 15.8 | 0.438 |
| newstest2012-engces.eng.ces | 15.5 | 0.429 |
| newstest2012-engrus.eng.rus | 23.8 | 0.516 |
| newstest2012-rusces.rus.ces | 13.3 | 0.401 |
| newstest2012-ruseng.rus.eng | 28.3 | 0.554 |
| newstest2013-ceseng.ces.eng | 23.8 | 0.518 |
| newstest2013-cesrus.ces.rus | 19.4 | 0.472 |
| newstest2013-engces.eng.ces | 17.6 | 0.450 |
| newstest2013-engrus.eng.rus | 18.2 | 0.463 |
| newstest2013-rusces.rus.ces | 17.5 | 0.445 |
| newstest2013-ruseng.rus.eng | 22.3 | 0.501 |
| newstest2014-csen-ceseng.ces.eng | 25.3 | 0.540 |
| newstest2014-ruen-ruseng.rus.eng | 25.1 | 0.538 |
| newstest2015-encs-ceseng.ces.eng | 23.2 | 0.507 |
| newstest2015-encs-engces.eng.ces | 17.3 | 0.454 |
| newstest2015-enru-engrus.eng.rus | 20.4 | 0.492 |
| newstest2015-enru-ruseng.rus.eng | 23.5 | 0.513 |
| newstest2016-encs-ceseng.ces.eng | 24.4 | 0.525 |
| newstest2016-encs-engces.eng.ces | 19.3 | 0.468 |
| newstest2016-enru-engrus.eng.rus | 19.1 | 0.480 |
| newstest2016-enru-ruseng.rus.eng | 22.9 | 0.512 |
| newstest2017-encs-ceseng.ces.eng | 21.9 | 0.502 |
| newstest2017-encs-engces.eng.ces | 15.6 | 0.432 |
| newstest2017-enru-engrus.eng.rus | 20.7 | 0.496 |
| newstest2017-enru-ruseng.rus.eng | 25.3 | 0.530 |
| newstest2018-encs-ceseng.ces.eng | 22.8 | 0.509 |
| newstest2018-encs-engces.eng.ces | 15.6 | 0.437 |
| newstest2018-enru-engrus.eng.rus | 17.7 | 0.480 |
| newstest2018-enru-ruseng.rus.eng | 22.0 | 0.505 |
| newstest2019-encs-engces.eng.ces | 17.0 | 0.447 |
| newstest2019-enru-engrus.eng.rus | 19.4 | 0.462 |
| newstest2019-ruen-ruseng.rus.eng | 25.1 | 0.528 |
| Tatoeba-test.bel-bul.bel.bul | 40.9 | 0.759 |
| Tatoeba-test.bel-ces.bel.ces | 39.3 | 0.662 |
| Tatoeba-test.bel-eng.bel.eng | 40.8 | 0.597 |
| Tatoeba-test.bel-hbs.bel.hbs | 55.6 | 0.706 |
| Tatoeba-test.bel-mkd.bel.mkd | 40.9 | 0.737 |
| Tatoeba-test.bel-pol.bel.pol | 48.1 | 0.679 |
| Tatoeba-test.bel-rus.bel.rus | 57.4 | 0.760 |
| Tatoeba-test.bel-ukr.bel.ukr | 55.1 | 0.744 |
| Tatoeba-test.bul-bel.bul.bel | 14.1 | 0.582 |
| Tatoeba-test.bul-ces.bul.ces | 36.9 | 0.687 |
| Tatoeba-test.bul-eng.bul.eng | 49.9 | 0.659 |
| Tatoeba-test.bul-hbs.bul.hbs | 53.7 | 0.807 |
| Tatoeba-test.bul-mkd.bul.mkd | 37.5 | 0.780 |
| Tatoeba-test.bul-pol.bul.pol | 40.7 | 0.609 |
| Tatoeba-test.bul-rus.bul.rus | 42.1 | 0.632 |
| Tatoeba-test.bul-ukr.bul.ukr | 49.2 | 0.683 |
| Tatoeba-test.ces-bel.ces.bel | 36.0 | 0.571 |
| Tatoeba-test.ces-bul.ces.bul | 75.8 | 0.859 |
| Tatoeba-test.ces-eng.ces.eng | 47.2 | 0.645 |
| Tatoeba-test.ces-hbs.ces.hbs | 52.8 | 0.708 |
| Tatoeba-test.ces-hsb.ces.hsb | 8.9 | 0.237 |
| Tatoeba-test.ces-mkd.ces.mkd | 34.4 | 0.681 |
| Tatoeba-test.ces-pol.ces.pol | 44.4 | 0.657 |
| Tatoeba-test.ces-rus.ces.rus | 50.1 | 0.682 |
| Tatoeba-test.ces-slv.ces.slv | 4.8 | 0.244 |
| Tatoeba-test.ces-ukr.ces.ukr | 51.3 | 0.678 |
| Tatoeba-test.csb-eng.csb.eng | 18.1 | 0.378 |
| Tatoeba-test.dsb-eng.dsb.eng | 21.8 | 0.412 |
| Tatoeba-test.dsb-pol.dsb.pol | 19.2 | 0.417 |
| Tatoeba-test.dsb-rus.dsb.rus | 35.4 | 0.714 |
| Tatoeba-test.eng-bel.eng.bel | 20.3 | 0.459 |
| Tatoeba-test.eng-bul.eng.bul | 42.4 | 0.613 |
| Tatoeba-test.eng-ces.eng.ces | 37.2 | 0.577 |
| Tatoeba-test.eng-csb.eng.csb | 3.1 | 0.220 |
| Tatoeba-test.eng-dsb.eng.dsb | 1.4 | 0.154 |
| Tatoeba-test.eng-hbs.eng.hbs | 36.3 | 0.580 |
| Tatoeba-test.eng-hsb.eng.hsb | 6.5 | 0.260 |
| Tatoeba-test.eng-mkd.eng.mkd | 40.0 | 0.599 |
| Tatoeba-test.eng-orv.eng.orv | 0.4 | 0.015 |
| Tatoeba-test.eng-pol.eng.pol | 37.5 | 0.596 |
| Tatoeba-test.eng-rue.eng.rue | 0.6 | 0.017 |
| Tatoeba-test.eng-rus.eng.rus | 38.0 | 0.586 |
| Tatoeba-test.eng-slv.eng.slv | 16.3 | 0.334 |
| Tatoeba-test.eng-ukr.eng.ukr | 35.9 | 0.568 |
| Tatoeba-test.hbs-bel.hbs.bel | 38.4 | 0.578 |
| Tatoeba-test.hbs-bul.hbs.bul | 100.0 | 1.000 |
| Tatoeba-test.hbs-ces.hbs.ces | 45.8 | 0.690 |
| Tatoeba-test.hbs-eng.hbs.eng | 49.9 | 0.659 |
| Tatoeba-test.hbs-mkd.hbs.mkd | 38.0 | 0.718 |
| Tatoeba-test.hbs-pol.hbs.pol | 41.9 | 0.636 |
| Tatoeba-test.hbs-rus.hbs.rus | 52.2 | 0.703 |
| Tatoeba-test.hbs-ukr.hbs.ukr | 50.8 | 0.685 |
| Tatoeba-test.hsb-ces.hsb.ces | 22.4 | 0.401 |
| Tatoeba-test.hsb-eng.hsb.eng | 36.9 | 0.546 |
| Tatoeba-test.mkd-bel.mkd.bel | 9.7 | 0.371 |
| Tatoeba-test.mkd-bul.mkd.bul | 60.6 | 0.864 |
| Tatoeba-test.mkd-ces.mkd.ces | 12.1 | 0.458 |
| Tatoeba-test.mkd-eng.mkd.eng | 48.8 | 0.636 |
| Tatoeba-test.mkd-hbs.mkd.hbs | 10.7 | 0.460 |
| Tatoeba-test.mkd-pol.mkd.pol | 32.5 | 0.718 |
| Tatoeba-test.mkd-rus.mkd.rus | 56.2 | 0.805 |
| Tatoeba-test.mkd-ukr.mkd.ukr | 42.7 | 0.708 |
| Tatoeba-test.multi.multi | 43.8 | 0.617 |
| Tatoeba-test.orv-eng.orv.eng | 10.0 | 0.279 |
| Tatoeba-test.orv-pol.orv.pol | 4.5 | 0.355 |
| Tatoeba-test.orv-rus.orv.rus | 11.8 | 0.295 |
| Tatoeba-test.orv-ukr.orv.ukr | 9.2 | 0.250 |
| Tatoeba-test.pol-bel.pol.bel | 31.6 | 0.565 |
| Tatoeba-test.pol-bul.pol.bul | 35.9 | 0.572 |
| Tatoeba-test.pol-ces.pol.ces | 44.1 | 0.630 |
| Tatoeba-test.pol-dsb.pol.dsb | 2.2 | 0.171 |
| Tatoeba-test.pol-eng.pol.eng | 45.5 | 0.633 |
| Tatoeba-test.pol-hbs.pol.hbs | 43.4 | 0.642 |
| Tatoeba-test.pol-mkd.pol.mkd | 38.0 | 0.718 |
| Tatoeba-test.pol-orv.pol.orv | 2.3 | 0.010 |
| Tatoeba-test.pol-rus.pol.rus | 47.8 | 0.668 |
| Tatoeba-test.pol-slv.pol.slv | 7.7 | 0.259 |
| Tatoeba-test.pol-ukr.pol.ukr | 45.9 | 0.657 |
| Tatoeba-test.rue-eng.rue.eng | 21.0 | 0.423 |
| Tatoeba-test.rus-bel.rus.bel | 37.9 | 0.611 |
| Tatoeba-test.rus-bul.rus.bul | 44.9 | 0.657 |
| Tatoeba-test.rus-ces.rus.ces | 47.4 | 0.653 |
| Tatoeba-test.rus-dsb.rus.dsb | 16.0 | 0.030 |
| Tatoeba-test.rus-eng.rus.eng | 49.4 | 0.654 |
| Tatoeba-test.rus-hbs.rus.hbs | 44.1 | 0.652 |
| Tatoeba-test.rus-mkd.rus.mkd | 31.4 | 0.600 |
| Tatoeba-test.rus-orv.rus.orv | 0.1 | 0.009 |
| Tatoeba-test.rus-pol.rus.pol | 44.4 | 0.651 |
| Tatoeba-test.rus-slv.rus.slv | 30.3 | 0.481 |
| Tatoeba-test.rus-ukr.rus.ukr | 56.2 | 0.741 |
| Tatoeba-test.slv-ces.slv.ces | 41.0 | 0.606 |
| Tatoeba-test.slv-eng.slv.eng | 38.3 | 0.570 |
| Tatoeba-test.slv-pol.slv.pol | 39.3 | 0.605 |
| Tatoeba-test.slv-rus.slv.rus | 45.1 | 0.632 |
| Tatoeba-test.slv-ukr.slv.ukr | 36.6 | 0.551 |
| Tatoeba-test.ukr-bel.ukr.bel | 39.6 | 0.625 |
| Tatoeba-test.ukr-bul.ukr.bul | 56.3 | 0.730 |
| Tatoeba-test.ukr-ces.ukr.ces | 50.5 | 0.675 |
| Tatoeba-test.ukr-eng.ukr.eng | 48.6 | 0.649 |
| Tatoeba-test.ukr-hbs.ukr.hbs | 46.3 | 0.666 |
| Tatoeba-test.ukr-mkd.ukr.mkd | 40.9 | 0.737 |
| Tatoeba-test.ukr-orv.ukr.orv | 0.3 | 0.011 |
| Tatoeba-test.ukr-pol.ukr.pol | 48.5 | 0.689 |
| Tatoeba-test.ukr-rus.ukr.rus | 61.7 | 0.777 |
| Tatoeba-test.ukr-slv.ukr.slv | 14.8 | 0.290 |
- dataset: opus
- model: transformer
- source language(s): bel bel_Latn bos_Cyrl bos_Latn bul ces cnr cnr_Latn csb csb_Latn dsb eng hbs hbs_Cyrl hrv hsb mkd orv_Cyrl pol rue rus slv srp_Cyrl srp_Latn ukr
- target language(s): bel bel_Latn bos_Cyrl bos_Latn bul ces cnr cnr_Latn csb csb_Latn dsb eng hbs hbs_Cyrl hrv hsb mkd orv_Cyrl pol rue rus slv srp_Cyrl srp_Latn ukr
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- a sentence initial language token is required in the form of
>>id<<(id = valid target language ID) - download: opus-2020-10-04.zip
- test set translations: opus-2020-10-04.test.txt
- test set scores: opus-2020-10-04.eval.txt
| testset | BLEU | chr-F |
|---|---|---|
| newssyscomb2009-ceseng.ces.eng | 22.3 | 0.510 |
| newssyscomb2009-engces.eng.ces | 16.5 | 0.448 |
| news-test2008-engces.eng.ces | 14.9 | 0.431 |
| newstest2009-ceseng.ces.eng | 21.8 | 0.507 |
| newstest2009-engces.eng.ces | 15.5 | 0.442 |
| newstest2010-ceseng.ces.eng | 21.8 | 0.513 |
| newstest2010-engces.eng.ces | 16.2 | 0.449 |
| newstest2011-ceseng.ces.eng | 23.1 | 0.515 |
| newstest2011-engces.eng.ces | 17.3 | 0.452 |
| newstest2012-ceseng.ces.eng | 22.3 | 0.509 |
| newstest2012-cesrus.ces.rus | 16.0 | 0.441 |
| newstest2012-engces.eng.ces | 15.6 | 0.430 |
| newstest2012-engrus.eng.rus | 24.2 | 0.520 |
| newstest2012-rusces.rus.ces | 13.5 | 0.403 |
| newstest2012-ruseng.rus.eng | 28.7 | 0.558 |
| newstest2013-ceseng.ces.eng | 24.3 | 0.521 |
| newstest2013-cesrus.ces.rus | 19.7 | 0.474 |
| newstest2013-engces.eng.ces | 18.0 | 0.454 |
| newstest2013-engrus.eng.rus | 18.4 | 0.464 |
| newstest2013-rusces.rus.ces | 17.6 | 0.446 |
| newstest2013-ruseng.rus.eng | 22.8 | 0.503 |
| newstest2014-csen-ceseng.ces.eng | 25.7 | 0.544 |
| newstest2014-ruen-ruseng.rus.eng | 25.3 | 0.539 |
| newstest2015-encs-ceseng.ces.eng | 23.5 | 0.508 |
| newstest2015-encs-engces.eng.ces | 17.3 | 0.456 |
| newstest2015-enru-engrus.eng.rus | 20.8 | 0.493 |
| newstest2015-enru-ruseng.rus.eng | 23.7 | 0.516 |
| newstest2016-encs-ceseng.ces.eng | 24.9 | 0.530 |
| newstest2016-encs-engces.eng.ces | 19.5 | 0.470 |
| newstest2016-enru-engrus.eng.rus | 19.2 | 0.481 |
| newstest2016-enru-ruseng.rus.eng | 22.9 | 0.513 |
| newstest2017-encs-ceseng.ces.eng | 22.1 | 0.503 |
| newstest2017-encs-engces.eng.ces | 15.8 | 0.435 |
| newstest2017-enru-engrus.eng.rus | 20.8 | 0.497 |
| newstest2017-enru-ruseng.rus.eng | 25.7 | 0.532 |
| newstest2018-encs-ceseng.ces.eng | 22.9 | 0.512 |
| newstest2018-encs-engces.eng.ces | 15.7 | 0.441 |
| newstest2018-enru-engrus.eng.rus | 18.2 | 0.483 |
| newstest2018-enru-ruseng.rus.eng | 22.1 | 0.507 |
| newstest2019-encs-engces.eng.ces | 17.0 | 0.449 |
| newstest2019-enru-engrus.eng.rus | 19.7 | 0.464 |
| newstest2019-ruen-ruseng.rus.eng | 25.2 | 0.527 |
| Tatoeba-test.bel-bul.bel.bul | 100.0 | 1.000 |
| Tatoeba-test.bel-ces.bel.ces | 36.4 | 0.656 |
| Tatoeba-test.bel-eng.bel.eng | 40.6 | 0.596 |
| Tatoeba-test.bel-hbs.bel.hbs | 55.9 | 0.710 |
| Tatoeba-test.bel-mkd.bel.mkd | 40.9 | 0.737 |
| Tatoeba-test.bel-pol.bel.pol | 47.3 | 0.683 |
| Tatoeba-test.bel-rus.bel.rus | 58.1 | 0.767 |
| Tatoeba-test.bel-ukr.bel.ukr | 54.8 | 0.744 |
| Tatoeba-test.bul-bel.bul.bel | 14.1 | 0.553 |
| Tatoeba-test.bul-ces.bul.ces | 36.9 | 0.601 |
| Tatoeba-test.bul-eng.bul.eng | 50.0 | 0.661 |
| Tatoeba-test.bul-hbs.bul.hbs | 53.7 | 0.807 |
| Tatoeba-test.bul-mkd.bul.mkd | 37.5 | 0.780 |
| Tatoeba-test.bul-pol.bul.pol | 44.4 | 0.631 |
| Tatoeba-test.bul-rus.bul.rus | 43.1 | 0.647 |
| Tatoeba-test.bul-ukr.bul.ukr | 49.7 | 0.688 |
| Tatoeba-test.ces-bel.ces.bel | 38.5 | 0.576 |
| Tatoeba-test.ces-bul.ces.bul | 75.8 | 0.859 |
| Tatoeba-test.ces-eng.ces.eng | 47.4 | 0.648 |
| Tatoeba-test.ces-hbs.ces.hbs | 57.3 | 0.727 |
| Tatoeba-test.ces-hsb.ces.hsb | 6.1 | 0.240 |
| Tatoeba-test.ces-mkd.ces.mkd | 34.4 | 0.681 |
| Tatoeba-test.ces-pol.ces.pol | 44.4 | 0.657 |
| Tatoeba-test.ces-rus.ces.rus | 50.4 | 0.684 |
| Tatoeba-test.ces-slv.ces.slv | 4.9 | 0.245 |
| Tatoeba-test.ces-ukr.ces.ukr | 51.3 | 0.678 |
| Tatoeba-test.csb-eng.csb.eng | 16.4 | 0.396 |
| Tatoeba-test.dsb-eng.dsb.eng | 22.3 | 0.410 |
| Tatoeba-test.dsb-pol.dsb.pol | 14.9 | 0.432 |
| Tatoeba-test.dsb-rus.dsb.rus | 42.7 | 0.770 |
| Tatoeba-test.eng-bel.eng.bel | 20.3 | 0.461 |
| Tatoeba-test.eng-bul.eng.bul | 42.8 | 0.616 |
| Tatoeba-test.eng-ces.eng.ces | 37.5 | 0.579 |
| Tatoeba-test.eng-csb.eng.csb | 5.1 | 0.217 |
| Tatoeba-test.eng-dsb.eng.dsb | 0.9 | 0.163 |
| Tatoeba-test.eng-hbs.eng.hbs | 36.7 | 0.583 |
| Tatoeba-test.eng-hsb.eng.hsb | 10.5 | 0.284 |
| Tatoeba-test.eng-mkd.eng.mkd | 40.4 | 0.602 |
| Tatoeba-test.eng-orv.eng.orv | 0.3 | 0.011 |
| Tatoeba-test.eng-pol.eng.pol | 37.8 | 0.598 |
| Tatoeba-test.eng-rue.eng.rue | 0.5 | 0.017 |
| Tatoeba-test.eng-rus.eng.rus | 38.4 | 0.589 |
| Tatoeba-test.eng-slv.eng.slv | 15.6 | 0.334 |
| Tatoeba-test.eng-ukr.eng.ukr | 36.0 | 0.571 |
| Tatoeba-test.hbs-bel.hbs.bel | 38.2 | 0.564 |
| Tatoeba-test.hbs-bul.hbs.bul | 100.0 | 1.000 |
| Tatoeba-test.hbs-ces.hbs.ces | 46.4 | 0.693 |
| Tatoeba-test.hbs-eng.hbs.eng | 50.5 | 0.662 |
| Tatoeba-test.hbs-mkd.hbs.mkd | 38.0 | 0.718 |
| Tatoeba-test.hbs-pol.hbs.pol | 42.9 | 0.639 |
| Tatoeba-test.hbs-rus.hbs.rus | 52.4 | 0.704 |
| Tatoeba-test.hbs-ukr.hbs.ukr | 51.1 | 0.689 |
| Tatoeba-test.hsb-ces.hsb.ces | 17.4 | 0.373 |
| Tatoeba-test.hsb-eng.hsb.eng | 34.2 | 0.541 |
| Tatoeba-test.mkd-bel.mkd.bel | 12.7 | 0.479 |
| Tatoeba-test.mkd-bul.mkd.bul | 54.2 | 0.833 |
| Tatoeba-test.mkd-ces.mkd.ces | 12.1 | 0.385 |
| Tatoeba-test.mkd-eng.mkd.eng | 49.1 | 0.640 |
| Tatoeba-test.mkd-hbs.mkd.hbs | 10.7 | 0.460 |
| Tatoeba-test.mkd-pol.mkd.pol | 53.7 | 0.833 |
| Tatoeba-test.mkd-rus.mkd.rus | 26.5 | 0.668 |
| Tatoeba-test.mkd-ukr.mkd.ukr | 42.7 | 0.708 |
| Tatoeba-test.multi.multi | 44.1 | 0.618 |
| Tatoeba-test.orv-eng.orv.eng | 7.9 | 0.259 |
| Tatoeba-test.orv-pol.orv.pol | 11.2 | 0.352 |
| Tatoeba-test.orv-rus.orv.rus | 9.2 | 0.268 |
| Tatoeba-test.orv-ukr.orv.ukr | 6.0 | 0.231 |
| Tatoeba-test.pol-bel.pol.bel | 31.5 | 0.563 |
| Tatoeba-test.pol-bul.pol.bul | 34.8 | 0.568 |
| Tatoeba-test.pol-ces.pol.ces | 42.7 | 0.626 |
| Tatoeba-test.pol-dsb.pol.dsb | 2.2 | 0.168 |
| Tatoeba-test.pol-eng.pol.eng | 45.6 | 0.633 |
| Tatoeba-test.pol-hbs.pol.hbs | 45.0 | 0.651 |
| Tatoeba-test.pol-mkd.pol.mkd | 38.0 | 0.718 |
| Tatoeba-test.pol-orv.pol.orv | 0.7 | 0.007 |
| Tatoeba-test.pol-rus.pol.rus | 48.2 | 0.670 |
| Tatoeba-test.pol-slv.pol.slv | 6.4 | 0.255 |
| Tatoeba-test.pol-ukr.pol.ukr | 46.7 | 0.663 |
| Tatoeba-test.rue-eng.rue.eng | 21.5 | 0.418 |
| Tatoeba-test.rus-bel.rus.bel | 36.6 | 0.603 |
| Tatoeba-test.rus-bul.rus.bul | 44.3 | 0.656 |
| Tatoeba-test.rus-ces.rus.ces | 47.8 | 0.659 |
| Tatoeba-test.rus-dsb.rus.dsb | 16.0 | 0.030 |
| Tatoeba-test.rus-eng.rus.eng | 50.0 | 0.658 |
| Tatoeba-test.rus-hbs.rus.hbs | 44.5 | 0.654 |
| Tatoeba-test.rus-mkd.rus.mkd | 30.1 | 0.593 |
| Tatoeba-test.rus-orv.rus.orv | 0.1 | 0.007 |
| Tatoeba-test.rus-pol.rus.pol | 44.7 | 0.652 |
| Tatoeba-test.rus-slv.rus.slv | 29.6 | 0.478 |
| Tatoeba-test.rus-ukr.rus.ukr | 56.8 | 0.745 |
| Tatoeba-test.slv-ces.slv.ces | 39.6 | 0.594 |
| Tatoeba-test.slv-eng.slv.eng | 38.7 | 0.576 |
| Tatoeba-test.slv-pol.slv.pol | 40.9 | 0.608 |
| Tatoeba-test.slv-rus.slv.rus | 46.5 | 0.645 |
| Tatoeba-test.slv-ukr.slv.ukr | 35.1 | 0.553 |
| Tatoeba-test.ukr-bel.ukr.bel | 40.1 | 0.624 |
| Tatoeba-test.ukr-bul.ukr.bul | 56.6 | 0.732 |
| Tatoeba-test.ukr-ces.ukr.ces | 50.6 | 0.675 |
| Tatoeba-test.ukr-eng.ukr.eng | 49.1 | 0.653 |
| Tatoeba-test.ukr-hbs.ukr.hbs | 47.2 | 0.671 |
| Tatoeba-test.ukr-mkd.ukr.mkd | 19.3 | 0.535 |
| Tatoeba-test.ukr-orv.ukr.orv | 0.2 | 0.010 |
| Tatoeba-test.ukr-pol.ukr.pol | 48.8 | 0.690 |
| Tatoeba-test.ukr-rus.ukr.rus | 62.0 | 0.780 |
| Tatoeba-test.ukr-slv.ukr.slv | 14.6 | 0.291 |
- dataset: opus
- model: transformer
- source language(s): bel bos bul ces cnr csb dsb eng hbs hrv hsb mkd orv pol rue rus slv srp ukr
- target language(s): bel bos bul ces cnr csb dsb eng hbs hrv hsb mkd orv pol rue rus slv srp ukr
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- a sentence initial language token is required in the form of
>>id<<(id = valid target language ID) - valid language labels: >>eng<< >>rus<< >>ukr<< >>ces<< >>pol<< >>mkd<< >>bul<< >>bel<< >>hrv<< >>srp_Cyrl<< >>bos_Latn<< >>srp_Latn<< >>hbs<< >>slv<< >>hsb<< >>cnr_Latn<< >>csb_Latn<< >>bel_Latn<< >>hbs_Cyrl<< >>bos_Cyrl<< >>cnr<< >>csb<<
- download: opus-2021-02-16.zip
- test set translations: opus-2021-02-16.test.txt
- test set scores: opus-2021-02-16.eval.txt
| testset | BLEU | chr-F | #sent | #words | BP |
|---|---|---|---|---|---|
| Tatoeba-test.multi-multi | 43.7 | 0.614 | 10000 | 64261 | 0.967 |
- dataset: opus
- model: transformer
- source language(s): bel bos bul ces dsb hbs hrv hsb mkd orv pol rus slv srp ukr
- target language(s): bel bos bul ces dsb hbs hrv hsb mkd orv pol rus slv srp ukr
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- a sentence initial language token is required in the form of
>>id<<(id = valid target language ID) - valid language labels: >>eng<< >>rus<< >>ukr<< >>ces<< >>pol<< >>mkd<< >>bul<< >>bel<< >>hrv<< >>srp_Cyrl<< >>bos_Latn<< >>srp_Latn<< >>hbs<< >>slv<< >>hsb<< >>cnr_Latn<< >>csb_Latn<< >>bel_Latn<< >>hbs_Cyrl<< >>bos_Cyrl<< >>cnr<< >>csb<<
- download: opus-2021-02-18.zip
- test set translations: opus-2021-02-18.test.txt
- test set scores: opus-2021-02-18.eval.txt
| testset | BLEU | chr-F | #sent | #words | BP |
|---|---|---|---|---|---|
| newssyscomb2009.ces-eng | 22.3 | 0.510 | 502 | 11821 | 0.964 |
| newssyscomb2009.eng-ces | 16.5 | 0.448 | 502 | 10032 | 0.972 |
| news-test2008.eng-ces | 14.9 | 0.431 | 2051 | 42484 | 0.984 |
| newstest2009.ces-eng | 21.8 | 0.507 | 2525 | 65402 | 0.961 |
| newstest2009.eng-ces | 15.5 | 0.442 | 2525 | 55533 | 0.982 |
| newstest2010.ces-eng | 21.8 | 0.513 | 2489 | 61724 | 0.972 |
| newstest2010.eng-ces | 16.2 | 0.449 | 2489 | 52958 | 0.986 |
| newstest2011.ces-eng | 23.1 | 0.515 | 3003 | 74681 | 0.987 |
| newstest2011.eng-ces | 17.3 | 0.452 | 3003 | 65653 | 0.955 |
| newstest2012.ces-eng | 22.3 | 0.509 | 3003 | 72812 | 1.000 |
| newstest2012.ces-rus | 16.0 | 0.441 | 3003 | 64830 | 0.984 |
| newstest2012.eng-ces | 15.6 | 0.430 | 3003 | 65456 | 0.937 |
| newstest2012.eng-rus | 24.2 | 0.520 | 3003 | 64830 | 0.976 |
| newstest2012.rus-ces | 13.5 | 0.403 | 3003 | 65456 | 0.932 |
| newstest2012.rus-eng | 28.7 | 0.558 | 3003 | 72812 | 0.976 |
| newstest2013.ces-eng | 24.3 | 0.521 | 3000 | 64505 | 0.998 |
| newstest2013.ces-rus | 19.7 | 0.474 | 3000 | 58560 | 0.963 |
| newstest2013.eng-ces | 18.0 | 0.454 | 3000 | 57250 | 0.958 |
| newstest2013.eng-rus | 18.4 | 0.464 | 3000 | 58560 | 0.972 |
| newstest2013.rus-ces | 17.6 | 0.446 | 3000 | 57250 | 0.957 |
| newstest2013.rus-eng | 22.8 | 0.503 | 3000 | 64505 | 0.995 |
| newstest2014-csen.ces-eng | 25.7 | 0.544 | 3003 | 68065 | 1.000 |
| newstest2014-ruen.rus-eng | 25.3 | 0.539 | 3003 | 69190 | 0.986 |
| newstest2015-encs.ces-eng | 23.5 | 0.508 | 2656 | 53572 | 0.969 |
| newstest2015-encs.eng-ces | 17.3 | 0.456 | 2656 | 45931 | 1.000 |
| newstest2015-enru.eng-rus | 20.8 | 0.493 | 2818 | 55915 | 1.000 |
| newstest2015-enru.rus-eng | 23.7 | 0.516 | 2818 | 64744 | 0.946 |
| newstest2016-encs.ces-eng | 24.9 | 0.530 | 2999 | 64670 | 0.994 |
| newstest2016-encs.eng-ces | 19.5 | 0.470 | 2999 | 57013 | 0.991 |
| newstest2016-enru.eng-rus | 19.2 | 0.481 | 2998 | 62018 | 0.990 |
| newstest2016-enru.rus-eng | 22.9 | 0.513 | 2998 | 69278 | 0.982 |
| newstest2017-encs.ces-eng | 22.1 | 0.503 | 3005 | 61725 | 0.992 |
| newstest2017-encs.eng-ces | 15.8 | 0.435 | 3005 | 54461 | 0.974 |
| newstest2017-enru.eng-rus | 20.8 | 0.497 | 3001 | 60255 | 0.992 |
| newstest2017-enru.rus-eng | 25.7 | 0.532 | 3001 | 69033 | 0.964 |
| newstest2018-encs.ces-eng | 22.9 | 0.512 | 2983 | 63496 | 0.991 |
| newstest2018-encs.eng-ces | 15.7 | 0.441 | 2983 | 54772 | 1.000 |
| newstest2018-enru.eng-rus | 18.2 | 0.483 | 3000 | 61920 | 1.000 |
| newstest2018-enru.rus-eng | 22.1 | 0.507 | 3000 | 71723 | 0.966 |
| newstest2019-encs.eng-ces | 17.0 | 0.449 | 1997 | 43373 | 0.981 |
| newstest2019-enru.eng-rus | 19.7 | 0.464 | 1997 | 48153 | 0.911 |
| newstest2019-ruen.rus-eng | 25.2 | 0.527 | 2000 | 42875 | 0.959 |
| Tatoeba-test.bel-bul | 100.0 | 1.000 | 1 | 6 | 1.000 |
| Tatoeba-test.bel-ces | 38.7 | 0.666 | 30 | 167 | 0.994 |
| Tatoeba-test.bel-hbs | 55.9 | 0.710 | 38 | 213 | 0.971 |
| Tatoeba-test.bel_Latn-pol | 18.8 | 0.547 | 2 | 15 | 0.931 |
| Tatoeba-test.bel_Latn-rus | 12.6 | 0.379 | 6 | 60 | 1.000 |
| Tatoeba-test.bel_Latn-ukr | 12.4 | 0.316 | 8 | 61 | 0.915 |
| Tatoeba-test.bel-mkd | 40.9 | 0.737 | 1 | 6 | 0.819 |
| Tatoeba-test.bel-pol | 46.9 | 0.680 | 287 | 1704 | 0.985 |
| Tatoeba-test.bel-rus | 57.4 | 0.763 | 2500 | 18815 | 0.994 |
| Tatoeba-test.bel-srp_Cyrl | 52.6 | 0.650 | 22 | 137 | 0.978 |
| Tatoeba-test.bel-srp_Latn | 62.4 | 0.821 | 16 | 76 | 0.960 |
| Tatoeba-test.bel-ukr | 54.5 | 0.743 | 2355 | 15138 | 0.999 |
| Tatoeba-test.bos_Latn-rus | 68.4 | 0.835 | 12 | 47 | 1.000 |
| Tatoeba-test.bul-bel | 14.1 | 0.553 | 1 | 5 | 1.000 |
| Tatoeba-test.bul-ces | 36.9 | 0.601 | 2 | 11 | 1.000 |
| Tatoeba-test.bul-hbs | 53.7 | 0.807 | 1 | 6 | 1.000 |
| Tatoeba-test.bul-mkd | 37.5 | 0.780 | 3 | 17 | 1.000 |
| Tatoeba-test.bul-pol | 44.4 | 0.631 | 75 | 456 | 0.991 |
| Tatoeba-test.bul-rus | 42.7 | 0.641 | 1247 | 7849 | 0.961 |
| Tatoeba-test.bul-ukr | 49.3 | 0.688 | 1020 | 4909 | 1.000 |
| Tatoeba-test.ces-bel | 38.7 | 0.577 | 30 | 177 | 0.983 |
| Tatoeba-test.ces-bul | 75.8 | 0.859 | 2 | 11 | 0.905 |
| Tatoeba-test.ces-hbs | 57.3 | 0.727 | 29 | 156 | 0.974 |
| Tatoeba-test.ces-hrv | 55.2 | 0.710 | 28 | 150 | 0.973 |
| Tatoeba-test.ces-hsb | 6.1 | 0.239 | 84 | 472 | 0.952 |
| Tatoeba-test.ces-mkd | 34.4 | 0.681 | 2 | 11 | 0.905 |
| Tatoeba-test.ces-pol | 44.4 | 0.657 | 561 | 3366 | 0.963 |
| Tatoeba-test.ces-rus | 49.6 | 0.679 | 2500 | 15045 | 0.976 |
| Tatoeba-test.ces-slv | 4.9 | 0.244 | 335 | 1823 | 1.000 |
| Tatoeba-test.ces-srp_Cyrl | 100.0 | 1.000 | 1 | 6 | 1.000 |
| Tatoeba-test.ces-ukr | 50.9 | 0.676 | 1787 | 8854 | 0.997 |
| Tatoeba-test.dsb-pol | 14.9 | 0.432 | 13 | 70 | 0.986 |
| Tatoeba-test.dsb-rus | 42.7 | 0.770 | 1 | 4 | 1.000 |
| Tatoeba-test.hbs-bel | 38.2 | 0.564 | 38 | 199 | 0.954 |
| Tatoeba-test.hbs-bul | 100.0 | 1.000 | 1 | 6 | 1.000 |
| Tatoeba-test.hbs-ces | 46.4 | 0.693 | 29 | 146 | 1.000 |
| Tatoeba-test.hbs-mkd | 38.0 | 0.718 | 1 | 6 | 1.000 |
| Tatoeba-test.hbs-pol | 42.7 | 0.639 | 417 | 2599 | 0.957 |
| Tatoeba-test.hbs-rus | 51.4 | 0.699 | 2500 | 14126 | 0.990 |
| Tatoeba-test.hbs-ukr | 50.6 | 0.687 | 941 | 4926 | 0.989 |
| Tatoeba-test.hrv-ces | 46.0 | 0.682 | 28 | 140 | 1.000 |
| Tatoeba-test.hrv-pol | 39.0 | 0.621 | 271 | 1653 | 0.960 |
| Tatoeba-test.hrv-rus | 49.2 | 0.648 | 124 | 733 | 0.990 |
| Tatoeba-test.hrv-ukr | 45.6 | 0.654 | 389 | 2217 | 0.986 |
| Tatoeba-test.hsb-ces | 17.4 | 0.375 | 84 | 457 | 1.000 |
| Tatoeba-test.mkd-bel | 12.7 | 0.479 | 1 | 5 | 1.000 |
| Tatoeba-test.mkd-bul | 54.2 | 0.833 | 3 | 17 | 1.000 |
| Tatoeba-test.mkd-ces | 12.1 | 0.385 | 2 | 11 | 1.000 |
| Tatoeba-test.mkd-hbs | 10.7 | 0.460 | 1 | 6 | 1.000 |
| Tatoeba-test.mkd-pol | 53.7 | 0.833 | 1 | 6 | 1.000 |
| Tatoeba-test.mkd-rus | 26.5 | 0.668 | 3 | 13 | 1.000 |
| Tatoeba-test.mkd-ukr | 42.7 | 0.708 | 1 | 5 | 1.000 |
| Tatoeba-test.multi-multi | 43.7 | 0.614 | 10000 | 64261 | 0.967 |
| Tatoeba-test.orv-pol | 11.2 | 0.352 | 7 | 36 | 0.851 |
| Tatoeba-test.orv-rus | 9.1 | 0.269 | 171 | 1259 | 1.000 |
| Tatoeba-test.orv-ukr | 6.0 | 0.231 | 973 | 5423 | 1.000 |
| Tatoeba-test.pol-bel | 31.1 | 0.562 | 287 | 1730 | 1.000 |
| Tatoeba-test.pol-bel_Latn | 3.5 | 0.030 | 2 | 16 | 0.635 |
| Tatoeba-test.pol-bul | 34.8 | 0.569 | 75 | 498 | 0.942 |
| Tatoeba-test.pol-ces | 42.7 | 0.626 | 561 | 3348 | 0.986 |
| Tatoeba-test.pol-dsb | 2.2 | 0.168 | 13 | 75 | 0.987 |
| Tatoeba-test.pol-hbs | 45.0 | 0.651 | 417 | 2645 | 0.979 |
| Tatoeba-test.pol-hrv | 45.3 | 0.651 | 271 | 1680 | 0.973 |
| Tatoeba-test.pol-mkd | 38.0 | 0.718 | 1 | 6 | 1.000 |
| Tatoeba-test.pol-orv | 0.7 | 0.007 | 7 | 31 | 1.000 |
| Tatoeba-test.pol-rus | 47.3 | 0.666 | 3543 | 21971 | 0.992 |
| Tatoeba-test.pol-slv | 6.4 | 0.255 | 175 | 961 | 0.995 |
| Tatoeba-test.pol-srp_Cyrl | 47.2 | 0.642 | 92 | 629 | 0.982 |
| Tatoeba-test.pol-srp_Latn | 38.7 | 0.670 | 54 | 336 | 0.997 |
| Tatoeba-test.pol-ukr | 46.4 | 0.662 | 2500 | 13392 | 0.993 |
| Tatoeba-test.rus-bel | 37.0 | 0.601 | 2500 | 18750 | 0.999 |
| Tatoeba-test.rus-bel_Latn | 1.2 | 0.007 | 6 | 64 | 0.867 |
| Tatoeba-test.rus-bos_Latn | 53.0 | 0.791 | 12 | 54 | 0.981 |
| Tatoeba-test.rus-bul | 43.8 | 0.650 | 1247 | 8239 | 0.999 |
| Tatoeba-test.rus-ces | 47.4 | 0.655 | 2500 | 14259 | 0.981 |
| Tatoeba-test.rus-dsb | 16.0 | 0.030 | 1 | 4 | 1.000 |
| Tatoeba-test.rus-hbs | 44.1 | 0.650 | 2500 | 14723 | 0.948 |
| Tatoeba-test.rus-hrv | 45.7 | 0.657 | 124 | 723 | 0.973 |
| Tatoeba-test.rus-mkd | 30.1 | 0.593 | 3 | 15 | 1.000 |
| Tatoeba-test.rus-orv | 0.1 | 0.007 | 171 | 1174 | 1.000 |
| Tatoeba-test.rus-pol | 44.4 | 0.650 | 3543 | 21485 | 0.949 |
| Tatoeba-test.rus-slv | 29.3 | 0.474 | 378 | 2135 | 0.988 |
| Tatoeba-test.rus-srp_Cyrl | 43.4 | 0.634 | 881 | 5400 | 0.940 |
| Tatoeba-test.rus-srp_Latn | 44.4 | 0.660 | 1483 | 8546 | 0.951 |
| Tatoeba-test.rus-ukr | 56.3 | 0.742 | 10000 | 59963 | 0.990 |
| Tatoeba-test.slv-ces | 39.6 | 0.594 | 335 | 1795 | 1.000 |
| Tatoeba-test.slv-pol | 40.9 | 0.608 | 175 | 935 | 0.974 |
| Tatoeba-test.slv-rus | 44.8 | 0.639 | 378 | 2091 | 1.000 |
| Tatoeba-test.slv-ukr | 34.7 | 0.551 | 848 | 3888 | 1.000 |
| Tatoeba-test.srp_Cyrl-bel | 38.9 | 0.530 | 22 | 126 | 0.951 |
| Tatoeba-test.srp_Cyrl-ces | 53.7 | 0.855 | 1 | 6 | 1.000 |
| Tatoeba-test.srp_Cyrl-pol | 45.5 | 0.644 | 92 | 608 | 0.953 |
| Tatoeba-test.srp_Cyrl-rus | 48.5 | 0.684 | 881 | 5075 | 0.995 |
| Tatoeba-test.srp_Cyrl-ukr | 52.3 | 0.689 | 204 | 1051 | 0.995 |
| Tatoeba-test.srp_Latn-bel | 34.1 | 0.632 | 16 | 73 | 0.958 |
| Tatoeba-test.srp_Latn-pol | 55.0 | 0.720 | 54 | 338 | 0.952 |
| Tatoeba-test.srp_Latn-rus | 53.3 | 0.713 | 1483 | 8271 | 0.987 |
| Tatoeba-test.srp_Latn-ukr | 57.1 | 0.736 | 348 | 1658 | 0.990 |
| Tatoeba-test.ukr-bel | 40.2 | 0.624 | 2355 | 15166 | 1.000 |
| Tatoeba-test.ukr-bel_Latn | 1.3 | 0.012 | 8 | 61 | 0.803 |
| Tatoeba-test.ukr-bul | 55.8 | 0.728 | 1020 | 5181 | 0.984 |
| Tatoeba-test.ukr-ces | 50.1 | 0.672 | 1787 | 8549 | 0.999 |
| Tatoeba-test.ukr-hbs | 47.1 | 0.670 | 941 | 5128 | 0.971 |
| Tatoeba-test.ukr-hrv | 47.4 | 0.664 | 389 | 2302 | 0.979 |
| Tatoeba-test.ukr-mkd | 19.3 | 0.535 | 1 | 6 | 1.000 |
| Tatoeba-test.ukr-orv | 0.2 | 0.010 | 973 | 5037 | 1.000 |
| Tatoeba-test.ukr-pol | 48.6 | 0.688 | 2500 | 13090 | 0.957 |
| Tatoeba-test.ukr-rus | 61.4 | 0.777 | 10000 | 60129 | 0.995 |
| Tatoeba-test.ukr-slv | 14.5 | 0.290 | 848 | 3821 | 1.000 |
| Tatoeba-test.ukr-srp_Cyrl | 51.4 | 0.683 | 204 | 1110 | 0.945 |
| Tatoeba-test.ukr-srp_Latn | 43.5 | 0.671 | 348 | 1716 | 0.978 |
| tico19-test.eng-rus | 17.1 | 0.461 | 2100 | 55837 | 0.909 |
- dataset: opusTCv20210807
- model: transformer-big
- source language(s): bel bel_Latn bos_Cyrl bos_Latn bul ces csb csb_Latn dsb hbs hbs_Cyrl hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
- target language(s): bel bel_Latn bos_Cyrl bos_Latn bul ces csb csb_Latn dsb hbs hbs_Cyrl hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
- raw source language(s): bel bos bul ces csb dsb hbs hrv hsb mkd orv pol rus slv srp ukr
- raw target language(s): bel bos bul ces csb dsb hbs hrv hsb mkd orv pol rus slv srp ukr
- model: transformer-big
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- a sentence initial language token is required in the form of
>>id<<(id = valid target language ID) - valid language labels:
- download: opusTCv20210807_transformer-big_2022-08-29.zip
- test set translations: opusTCv20210807_transformer-big_2022-08-29.test.txt
- test set scores: opusTCv20210807_transformer-big_2022-08-29.eval.txt
| testset | BLEU | chr-F | #sent | #words | BP |
|---|---|---|---|---|---|
| Tatoeba-test-v2021-08-07.bel-bul | 100.0 | 10.00000 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-ces | 37.1 | 0.58846 | 31 | 172 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-hbs | 50.1 | 0.64797 | 38 | 213 | 0.971 |
| Tatoeba-test-v2021-08-07.bel_Latn-pol | 23.0 | 0.61272 | 2 | 15 | 0.931 |
| Tatoeba-test-v2021-08-07.bel_Latn-rus | 13.7 | 0.36847 | 6 | 60 | 1.000 |
| Tatoeba-test-v2021-08-07.bel_Latn-ukr | 14.7 | 0.29965 | 8 | 61 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-mkd | 38.0 | 0.71758 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-pol | 44.5 | 0.65156 | 287 | 1704 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-rus | 59.7 | 0.76483 | 2500 | 18815 | 0.995 |
| Tatoeba-test-v2021-08-07.bel-slv | 6.4 | 0.21720 | 12 | 73 | 0.914 |
| Tatoeba-test-v2021-08-07.bel-srp_Cyrl | 47.0 | 0.61546 | 22 | 137 | 0.955 |
| Tatoeba-test-v2021-08-07.bel-srp_Latn | 55.8 | 0.70786 | 16 | 76 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-ukr | 57.5 | 0.75521 | 2355 | 15138 | 1.000 |
| Tatoeba-test-v2021-08-07.bos_Latn-rus | 70.6 | 0.85265 | 12 | 47 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-bel | 42.7 | 0.79315 | 1 | 5 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-bul | 37.2 | 0.57880 | 219 | 1374 | 0.973 |
| Tatoeba-test-v2021-08-07.bul-ces | 36.9 | 0.67135 | 2 | 11 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-dsb | 59.7 | 0.74211 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-hbs | 100.0 | 10.00000 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-hsb | 59.7 | 0.74211 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-mkd | 43.5 | 0.72379 | 5 | 30 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-pol | 53.0 | 0.70586 | 75 | 456 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-rus | 47.0 | 0.68357 | 1247 | 7849 | 0.979 |
| Tatoeba-test-v2021-08-07.bul-slv | 3.7 | 0.20182 | 11 | 60 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-ukr | 50.8 | 0.70162 | 1020 | 4909 | 1.000 |
| Tatoeba-test-v2021-08-07.ces-bel | 29.8 | 0.56728 | 31 | 181 | 0.931 |
| Tatoeba-test-v2021-08-07.ces-bul | 75.8 | 0.85887 | 2 | 11 | 0.905 |
| Tatoeba-test-v2021-08-07.ces-ces | 28.4 | 0.51621 | 152 | 923 | 0.974 |
| Tatoeba-test-v2021-08-07.ces-dsb | 12.8 | 0.35924 | 41 | 126 | 0.984 |
| Tatoeba-test-v2021-08-07.ces-hbs | 56.5 | 0.72129 | 29 | 156 | 0.967 |
| Tatoeba-test-v2021-08-07.ces-hrv | 54.5 | 0.70336 | 28 | 150 | 0.966 |
| Tatoeba-test-v2021-08-07.ces-hsb | 13.5 | 0.37434 | 170 | 772 | 0.944 |
| Tatoeba-test-v2021-08-07.ces-mkd | 36.3 | 0.69230 | 2 | 11 | 0.801 |
| Tatoeba-test-v2021-08-07.ces-pol | 50.2 | 0.69844 | 568 | 3407 | 0.967 |
| Tatoeba-test-v2021-08-07.ces-rus | 53.2 | 0.71279 | 2934 | 17743 | 0.974 |
| Tatoeba-test-v2021-08-07.ces-slv | 5.5 | 0.24397 | 489 | 2514 | 0.989 |
| Tatoeba-test-v2021-08-07.ces-srp_Cyrl | 100.0 | 10.00000 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.ces-ukr | 52.6 | 0.70358 | 1787 | 8854 | 0.992 |
| Tatoeba-test-v2021-08-07.csb-pol | 80.9 | 0.70596 | 1 | 7 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-bul | 28.2 | 0.34869 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-ces | 35.7 | 0.59001 | 41 | 130 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-dsb | 19.0 | 0.16860 | 1 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-hsb | 20.5 | 0.44899 | 331 | 1298 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-pol | 6.2 | 0.41639 | 14 | 74 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-rus | 33.3 | 0.53008 | 24 | 124 | 0.959 |
| Tatoeba-test-v2021-08-07.dsb-slv | 5.2 | 0.25087 | 330 | 1409 | 0.982 |
| Tatoeba-test-v2021-08-07.dsb-ukr | 11.6 | 0.47920 | 3 | 13 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-bel | 43.6 | 0.60971 | 38 | 199 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-bul | 100.0 | 10.00000 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-ces | 54.6 | 0.71626 | 29 | 146 | 0.986 |
| Tatoeba-test-v2021-08-07.hbs-hbs | 95.1 | 0.97441 | 8 | 61 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-hsb | 0.0 | 0.55017 | 1 | 3 | 0.607 |
| Tatoeba-test-v2021-08-07.hbs-mkd | 38.0 | 0.71758 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-pol | 50.9 | 0.68557 | 417 | 2599 | 0.961 |
| Tatoeba-test-v2021-08-07.hbs-rus | 56.6 | 0.73716 | 2500 | 14126 | 0.990 |
| Tatoeba-test-v2021-08-07.hbs-slv | 2.0 | 0.15654 | 37 | 147 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-ukr | 50.9 | 0.69096 | 942 | 4928 | 0.988 |
| Tatoeba-test-v2021-08-07.hrv-ces | 54.6 | 0.70628 | 28 | 140 | 0.986 |
| Tatoeba-test-v2021-08-07.hrv-pol | 48.7 | 0.67330 | 271 | 1653 | 0.960 |
| Tatoeba-test-v2021-08-07.hrv-rus | 53.6 | 0.67829 | 124 | 733 | 0.960 |
| Tatoeba-test-v2021-08-07.hrv-slv | 16.0 | 0.32864 | 1 | 3 | 1.000 |
| Tatoeba-test-v2021-08-07.hrv-srp_Cyrl | 0.0 | 10.00000 | 2 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.hrv-ukr | 47.4 | 0.66212 | 389 | 2217 | 0.975 |
| Tatoeba-test-v2021-08-07.hsb-bul | 32.5 | 0.51071 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-ces | 36.9 | 0.53848 | 170 | 756 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-dsb | 19.0 | 0.43374 | 331 | 1315 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-hbs | 0.0 | 0.35547 | 1 | 4 | 0.717 |
| Tatoeba-test-v2021-08-07.hsb-hsb | 16.0 | 0.33285 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-pol | 100.0 | 10.00000 | 1 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-rus | 27.7 | 0.53179 | 38 | 281 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-slv | 11.9 | 0.24862 | 743 | 3187 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-ukr | 11.5 | 0.39708 | 8 | 126 | 0.891 |
| Tatoeba-test-v2021-08-07.mkd-bel | 42.7 | 0.79315 | 1 | 5 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-bul | 36.0 | 0.62131 | 5 | 31 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-ces | 15.0 | 0.54658 | 2 | 11 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-hbs | 38.0 | 0.75889 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-pol | 53.7 | 0.82249 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-rus | 71.7 | 0.97695 | 3 | 13 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-slv | 1.6 | 0.17841 | 115 | 515 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-ukr | 33.3 | 0.56202 | 5 | 23 | 1.000 |
| Tatoeba-test-v2021-08-07.multi-multi | 54.2 | 0.71108 | 10000 | 58987 | 0.989 |
| Tatoeba-test-v2021-08-07.orv-pol | 11.3 | 0.34818 | 7 | 36 | 0.851 |
| Tatoeba-test-v2021-08-07.orv-rus | 12.4 | 0.28200 | 171 | 1259 | 0.833 |
| Tatoeba-test-v2021-08-07.orv-ukr | 7.5 | 0.25032 | 973 | 5423 | 1.000 |
| Tatoeba-test-v2021-08-07.pol-bel | 33.6 | 0.56659 | 287 | 1730 | 0.995 |
| Tatoeba-test-v2021-08-07.pol-bel_Latn | 3.8 | 0.862 | 2 | 16 | 0.717 |
| Tatoeba-test-v2021-08-07.pol-bul | 43.8 | 0.62537 | 75 | 498 | 0.927 |
| Tatoeba-test-v2021-08-07.pol-ces | 47.7 | 0.65581 | 568 | 3387 | 0.979 |
| Tatoeba-test-v2021-08-07.pol-csb | 13.1 | 0.23164 | 1 | 7 | 1.000 |
| Tatoeba-test-v2021-08-07.pol-dsb | 7.0 | 0.32310 | 14 | 79 | 0.974 |
| Tatoeba-test-v2021-08-07.pol-hbs | 46.5 | 0.67191 | 417 | 2645 | 0.965 |
| Tatoeba-test-v2021-08-07.pol-hrv | 47.6 | 0.66841 | 271 | 1680 | 0.965 |
| Tatoeba-test-v2021-08-07.pol-hsb | 14.1 | 0.48220 | 1 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.pol-mkd | 40.9 | 0.73746 | 1 | 6 | 0.819 |
| Tatoeba-test-v2021-08-07.pol-orv | 2.1 | 1.101 | 7 | 31 | 1.000 |
| Tatoeba-test-v2021-08-07.pol-pol | 31.4 | 0.53553 | 157 | 915 | 0.980 |
| Tatoeba-test-v2021-08-07.pol-rus | 52.2 | 0.71045 | 3543 | 21971 | 0.987 |
| Tatoeba-test-v2021-08-07.pol-slv | 9.2 | 0.27161 | 183 | 1008 | 0.977 |
| Tatoeba-test-v2021-08-07.pol-srp_Cyrl | 45.5 | 0.67156 | 92 | 629 | 0.959 |
| Tatoeba-test-v2021-08-07.pol-srp_Latn | 42.4 | 0.69105 | 54 | 336 | 0.970 |
| Tatoeba-test-v2021-08-07.pol-ukr | 47.6 | 0.67810 | 2519 | 13493 | 0.995 |
| Tatoeba-test-v2021-08-07.rus-bel | 47.9 | 0.65202 | 2500 | 18750 | 0.999 |
| Tatoeba-test-v2021-08-07.rus-bel_Latn | 1.2 | 3.858 | 6 | 64 | 0.849 |
| Tatoeba-test-v2021-08-07.rus-bos_Latn | 51.2 | 0.77824 | 12 | 54 | 1.000 |
| Tatoeba-test-v2021-08-07.rus-bul | 50.9 | 0.70429 | 1247 | 8239 | 0.943 |
| Tatoeba-test-v2021-08-07.rus-ces | 51.5 | 0.68623 | 2934 | 16824 | 0.976 |
| Tatoeba-test-v2021-08-07.rus-dsb | 9.4 | 0.39931 | 24 | 118 | 0.983 |
| Tatoeba-test-v2021-08-07.rus-hbs | 49.2 | 0.68742 | 2500 | 14723 | 0.948 |
| Tatoeba-test-v2021-08-07.rus-hrv | 48.6 | 0.69571 | 124 | 723 | 0.969 |
| Tatoeba-test-v2021-08-07.rus-hsb | 24.1 | 0.43070 | 38 | 273 | 0.896 |
| Tatoeba-test-v2021-08-07.rus-mkd | 39.4 | 0.69825 | 3 | 15 | 0.931 |
| Tatoeba-test-v2021-08-07.rus-orv | 0.1 | 0.866 | 171 | 1174 | 1.000 |
| Tatoeba-test-v2021-08-07.rus-pol | 50.5 | 0.69927 | 3543 | 21485 | 0.962 |
| Tatoeba-test-v2021-08-07.rus-rus | 39.0 | 0.61165 | 2500 | 16799 | 0.976 |
| Tatoeba-test-v2021-08-07.rus-slv | 22.6 | 0.38342 | 657 | 3969 | 0.997 |
| Tatoeba-test-v2021-08-07.rus-srp_Cyrl | 46.2 | 0.65984 | 881 | 5400 | 0.936 |
| Tatoeba-test-v2021-08-07.rus-srp_Latn | 51.1 | 0.70424 | 1483 | 8546 | 0.954 |
| Tatoeba-test-v2021-08-07.rus-ukr | 66.2 | 0.81238 | 10000 | 59963 | 0.997 |
| Tatoeba-test-v2021-08-07.slv-bel | 29.9 | 0.48887 | 12 | 67 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-bul | 25.8 | 0.63513 | 11 | 67 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-ces | 46.7 | 0.64221 | 489 | 2469 | 0.984 |
| Tatoeba-test-v2021-08-07.slv-dsb | 13.8 | 0.35784 | 330 | 1397 | 0.983 |
| Tatoeba-test-v2021-08-07.slv-hbs | 43.2 | 0.57886 | 37 | 160 | 0.968 |
| Tatoeba-test-v2021-08-07.slv-hrv | 100.0 | 10.00000 | 1 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-hsb | 20.3 | 0.38973 | 743 | 3132 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-mkd | 37.8 | 0.55875 | 115 | 586 | 0.958 |
| Tatoeba-test-v2021-08-07.slv-pol | 45.7 | 0.64921 | 183 | 981 | 0.975 |
| Tatoeba-test-v2021-08-07.slv-rus | 45.4 | 0.63551 | 657 | 4028 | 0.980 |
| Tatoeba-test-v2021-08-07.slv-slv | 5.6 | 0.22427 | 9 | 50 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-srp_Cyrl | 41.8 | 0.57275 | 36 | 156 | 0.967 |
| Tatoeba-test-v2021-08-07.slv-ukr | 38.8 | 0.56966 | 915 | 4352 | 0.979 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-bel | 43.2 | 0.60248 | 22 | 126 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-ces | 53.7 | 0.85516 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-hrv | 0.0 | 10.00000 | 2 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-pol | 49.1 | 0.67241 | 92 | 608 | 0.967 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-rus | 53.1 | 0.72564 | 881 | 5075 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-slv | 2.0 | 0.15380 | 36 | 144 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-ukr | 51.2 | 0.68463 | 205 | 1053 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Latn-bel | 44.1 | 0.62389 | 16 | 73 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Latn-pol | 64.9 | 0.77553 | 54 | 338 | 0.955 |
| Tatoeba-test-v2021-08-07.srp_Latn-rus | 58.9 | 0.74947 | 1483 | 8271 | 0.985 |
| Tatoeba-test-v2021-08-07.srp_Latn-srp_Cyrl | 95.0 | 0.97222 | 4 | 53 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Latn-ukr | 55.6 | 0.73899 | 348 | 1658 | 0.991 |
| Tatoeba-test-v2021-08-07.ukr-bel | 50.4 | 0.69159 | 2355 | 15166 | 0.998 |
| Tatoeba-test-v2021-08-07.ukr-bel_Latn | 2.4 | 1.323 | 8 | 61 | 1.000 |
| Tatoeba-test-v2021-08-07.ukr-bul | 58.7 | 0.76053 | 1020 | 5181 | 0.985 |
| Tatoeba-test-v2021-08-07.ukr-ces | 54.0 | 0.69672 | 1787 | 8549 | 0.995 |
| Tatoeba-test-v2021-08-07.ukr-dsb | 5.9 | 0.11108 | 3 | 14 | 0.846 |
| Tatoeba-test-v2021-08-07.ukr-hbs | 50.9 | 0.69561 | 942 | 5130 | 0.976 |
| Tatoeba-test-v2021-08-07.ukr-hrv | 49.5 | 0.68206 | 389 | 2302 | 0.982 |
| Tatoeba-test-v2021-08-07.ukr-hsb | 7.1 | 0.25271 | 8 | 128 | 1.000 |
| Tatoeba-test-v2021-08-07.ukr-mkd | 28.0 | 0.68068 | 5 | 22 | 1.000 |
| Tatoeba-test-v2021-08-07.ukr-orv | 0.2 | 0.910 | 973 | 5037 | 1.000 |
| Tatoeba-test-v2021-08-07.ukr-pol | 53.6 | 0.71931 | 2519 | 13193 | 0.968 |
| Tatoeba-test-v2021-08-07.ukr-rus | 67.0 | 0.81676 | 10000 | 60129 | 0.995 |
| Tatoeba-test-v2021-08-07.ukr-slv | 15.1 | 0.28893 | 915 | 4265 | 1.000 |
| Tatoeba-test-v2021-08-07.ukr-srp_Cyrl | 53.6 | 0.70773 | 205 | 1112 | 0.961 |
| Tatoeba-test-v2021-08-07.ukr-srp_Latn | 51.2 | 0.70891 | 348 | 1716 | 0.978 |
| Tatoeba-test-v2021-08-07.ukr-ukr | 36.9 | 0.60879 | 824 | 4198 | 1.000 |
- dataset: opusTCv20210807
- model: transformer-big
- source language(s): bel bel_Latn bos_Cyrl bos_Latn bul ces csb csb_Latn dsb hbs hbs_Cyrl hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
- target language(s): bel bel_Latn bos_Cyrl bos_Latn bul ces csb csb_Latn dsb hbs hbs_Cyrl hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
- raw source language(s): bel bos bul ces csb dsb hbs hrv hsb mkd orv pol rus slv srp ukr
- raw target language(s): bel bos bul ces csb dsb hbs hrv hsb mkd orv pol rus slv srp ukr
- model: transformer-big
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- a sentence initial language token is required in the form of
>>id<<(id = valid target language ID) - valid language labels:
- download: opusTCv20210807_transformer-big_2022-09-15.zip
- test set translations: opusTCv20210807_transformer-big_2022-09-15.test.txt
- test set scores: opusTCv20210807_transformer-big_2022-09-15.eval.txt
| testset | BLEU | chr-F | #sent | #words | BP |
|---|---|---|---|---|---|
| Tatoeba-test-v2021-08-07.bel-bul | 100.0 | 10.00000 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-ces | 43.6 | 0.65071 | 31 | 172 | 0.982 |
| Tatoeba-test-v2021-08-07.bel-hbs | 51.0 | 0.65679 | 38 | 213 | 0.976 |
| Tatoeba-test-v2021-08-07.bel_Latn-pol | 31.1 | 0.70219 | 2 | 15 | 1.000 |
| Tatoeba-test-v2021-08-07.bel_Latn-rus | 13.4 | 0.36938 | 6 | 60 | 1.000 |
| Tatoeba-test-v2021-08-07.bel_Latn-ukr | 10.5 | 0.31278 | 8 | 61 | 0.983 |
| Tatoeba-test-v2021-08-07.bel-mkd | 38.0 | 0.71758 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.bel-pol | 47.6 | 0.65710 | 287 | 1704 | 0.990 |
| Tatoeba-test-v2021-08-07.bel-rus | 60.4 | 0.77019 | 2500 | 18815 | 0.995 |
| Tatoeba-test-v2021-08-07.bel-slv | 6.4 | 0.22097 | 12 | 73 | 0.944 |
| Tatoeba-test-v2021-08-07.bel-srp_Cyrl | 49.0 | 0.62968 | 22 | 137 | 0.985 |
| Tatoeba-test-v2021-08-07.bel-srp_Latn | 58.0 | 0.76746 | 16 | 76 | 0.987 |
| Tatoeba-test-v2021-08-07.bel-ukr | 57.6 | 0.75640 | 2355 | 15138 | 0.999 |
| Tatoeba-test-v2021-08-07.bos_Latn-rus | 70.6 | 0.84901 | 12 | 47 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-bel | 42.7 | 0.79315 | 1 | 5 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-bul | 38.2 | 0.58546 | 219 | 1374 | 0.973 |
| Tatoeba-test-v2021-08-07.bul-ces | 65.8 | 0.76296 | 2 | 11 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-dsb | 44.2 | 0.52696 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-hbs | 100.0 | 10.00000 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-hsb | 59.7 | 0.74211 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-mkd | 43.5 | 0.71680 | 5 | 30 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-pol | 54.3 | 0.70241 | 75 | 456 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-rus | 47.2 | 0.68657 | 1247 | 7849 | 0.977 |
| Tatoeba-test-v2021-08-07.bul-slv | 3.6 | 0.20673 | 11 | 60 | 1.000 |
| Tatoeba-test-v2021-08-07.bul-ukr | 50.7 | 0.70376 | 1020 | 4909 | 1.000 |
| Tatoeba-test-v2021-08-07.ces-bel | 28.4 | 0.55002 | 31 | 181 | 0.937 |
| Tatoeba-test-v2021-08-07.ces-bul | 75.8 | 0.85887 | 2 | 11 | 0.905 |
| Tatoeba-test-v2021-08-07.ces-ces | 28.6 | 0.52236 | 152 | 923 | 0.971 |
| Tatoeba-test-v2021-08-07.ces-dsb | 13.1 | 0.33279 | 41 | 126 | 1.000 |
| Tatoeba-test-v2021-08-07.ces-hbs | 58.4 | 0.70312 | 29 | 156 | 0.961 |
| Tatoeba-test-v2021-08-07.ces-hrv | 56.5 | 0.68392 | 28 | 150 | 0.959 |
| Tatoeba-test-v2021-08-07.ces-hsb | 12.7 | 0.35914 | 170 | 772 | 0.926 |
| Tatoeba-test-v2021-08-07.ces-mkd | 34.4 | 0.68112 | 2 | 11 | 0.905 |
| Tatoeba-test-v2021-08-07.ces-pol | 49.5 | 0.69593 | 568 | 3407 | 0.970 |
| Tatoeba-test-v2021-08-07.ces-rus | 53.9 | 0.71564 | 2934 | 17743 | 0.972 |
| Tatoeba-test-v2021-08-07.ces-slv | 5.1 | 0.24172 | 489 | 2514 | 0.990 |
| Tatoeba-test-v2021-08-07.ces-srp_Cyrl | 100.0 | 10.00000 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.ces-ukr | 52.5 | 0.70271 | 1787 | 8854 | 0.991 |
| Tatoeba-test-v2021-08-07.csb-pol | 80.9 | 0.70596 | 1 | 7 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-bul | 28.2 | 0.34861 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-ces | 52.8 | 0.62900 | 41 | 130 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-dsb | 19.0 | 0.16860 | 1 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-hsb | 21.6 | 0.42884 | 331 | 1298 | 1.000 |
| Tatoeba-test-v2021-08-07.dsb-pol | 11.8 | 0.43901 | 14 | 74 | 0.973 |
| Tatoeba-test-v2021-08-07.dsb-rus | 37.8 | 0.57827 | 24 | 124 | 0.992 |
| Tatoeba-test-v2021-08-07.dsb-slv | 5.0 | 0.25202 | 330 | 1409 | 0.996 |
| Tatoeba-test-v2021-08-07.dsb-ukr | 10.5 | 0.34146 | 3 | 13 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-bel | 41.2 | 0.57069 | 38 | 199 | 0.995 |
| Tatoeba-test-v2021-08-07.hbs-bul | 100.0 | 10.00000 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-ces | 51.9 | 0.70777 | 29 | 146 | 0.986 |
| Tatoeba-test-v2021-08-07.hbs-hbs | 95.1 | 0.98094 | 8 | 61 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-hsb | 0.0 | 0.26505 | 1 | 3 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-mkd | 38.0 | 0.71758 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-pol | 50.6 | 0.68587 | 417 | 2599 | 0.962 |
| Tatoeba-test-v2021-08-07.hbs-rus | 56.9 | 0.73891 | 2500 | 14126 | 0.990 |
| Tatoeba-test-v2021-08-07.hbs-slv | 2.0 | 0.15244 | 37 | 147 | 1.000 |
| Tatoeba-test-v2021-08-07.hbs-ukr | 52.4 | 0.70098 | 942 | 4928 | 0.992 |
| Tatoeba-test-v2021-08-07.hrv-ces | 51.8 | 0.69716 | 28 | 140 | 0.986 |
| Tatoeba-test-v2021-08-07.hrv-pol | 48.8 | 0.67450 | 271 | 1653 | 0.957 |
| Tatoeba-test-v2021-08-07.hrv-rus | 54.0 | 0.68201 | 124 | 733 | 0.964 |
| Tatoeba-test-v2021-08-07.hrv-slv | 16.0 | 0.32864 | 1 | 3 | 1.000 |
| Tatoeba-test-v2021-08-07.hrv-srp_Cyrl | 0.0 | 10.00000 | 2 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.hrv-ukr | 49.8 | 0.68268 | 389 | 2217 | 0.986 |
| Tatoeba-test-v2021-08-07.hsb-bul | 32.5 | 0.52540 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-ces | 39.4 | 0.54834 | 170 | 756 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-dsb | 18.4 | 0.42495 | 331 | 1315 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-hbs | 0.0 | 0.27738 | 1 | 4 | 0.717 |
| Tatoeba-test-v2021-08-07.hsb-hsb | 16.0 | 0.33285 | 2 | 9 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-pol | 22.6 | 0.54842 | 1 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-rus | 21.8 | 0.50549 | 38 | 281 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-slv | 12.4 | 0.25343 | 743 | 3187 | 1.000 |
| Tatoeba-test-v2021-08-07.hsb-ukr | 5.8 | 0.34671 | 8 | 126 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-bel | 12.7 | 0.42172 | 1 | 5 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-bul | 36.0 | 0.62544 | 5 | 31 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-ces | 26.1 | 0.62427 | 2 | 11 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-hbs | 38.0 | 0.75889 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-pol | 53.7 | 0.82249 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-rus | 71.7 | 0.90611 | 3 | 13 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-slv | 1.5 | 0.17791 | 115 | 515 | 1.000 |
| Tatoeba-test-v2021-08-07.mkd-ukr | 33.3 | 0.56202 | 5 | 23 | 1.000 |
| Tatoeba-test-v2021-08-07.multi-multi | 55.3 | 0.71834 | 10000 | 58987 | 0.986 |
| Tatoeba-test-v2021-08-07.orv-pol | 10.5 | 0.37273 | 7 | 36 | 0.882 |
| Tatoeba-test-v2021-08-07.orv-rus | 11.7 | 0.28516 | 171 | 1259 | 0.850 |
| Tatoeba-test-v2021-08-07.orv-ukr | 8.5 | 0.25308 | 973 | 5423 | 1.000 |
| Tatoeba-test-v2021-08-07.pol-bel | 32.2 | 0.56201 | 287 | 1730 | 0.987 |
| Tatoeba-test-v2021-08-07.pol-bel_Latn | 3.8 | 0.862 | 2 | 16 | 0.717 |
| Tatoeba-test-v2021-08-07.pol-bul | 44.6 | 0.63108 | 75 | 498 | 0.936 |
| Tatoeba-test-v2021-08-07.pol-ces | 48.1 | 0.66225 | 568 | 3387 | 0.982 |
| Tatoeba-test-v2021-08-07.pol-csb | 13.1 | 0.24949 | 1 | 7 | 1.000 |
| Tatoeba-test-v2021-08-07.pol-dsb | 14.4 | 0.34267 | 14 | 79 | 0.865 |
| Tatoeba-test-v2021-08-07.pol-hbs | 47.9 | 0.68430 | 417 | 2645 | 0.970 |
| Tatoeba-test-v2021-08-07.pol-hrv | 48.9 | 0.68219 | 271 | 1680 | 0.969 |
| Tatoeba-test-v2021-08-07.pol-hsb | 14.1 | 0.48220 | 1 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.pol-mkd | 40.9 | 0.73746 | 1 | 6 | 0.819 |
| Tatoeba-test-v2021-08-07.pol-orv | 1.9 | 0.858 | 7 | 31 | 1.000 |
| Tatoeba-test-v2021-08-07.pol-pol | 33.9 | 0.54930 | 157 | 915 | 0.970 |
| Tatoeba-test-v2021-08-07.pol-rus | 52.4 | 0.71116 | 3543 | 21971 | 0.986 |
| Tatoeba-test-v2021-08-07.pol-slv | 9.7 | 0.27447 | 183 | 1008 | 0.982 |
| Tatoeba-test-v2021-08-07.pol-srp_Cyrl | 45.4 | 0.66946 | 92 | 629 | 0.964 |
| Tatoeba-test-v2021-08-07.pol-srp_Latn | 47.7 | 0.72327 | 54 | 336 | 0.985 |
| Tatoeba-test-v2021-08-07.pol-ukr | 48.9 | 0.68521 | 2519 | 13493 | 0.996 |
| Tatoeba-test-v2021-08-07.rus-bel | 48.2 | 0.65340 | 2500 | 18750 | 0.999 |
| Tatoeba-test-v2021-08-07.rus-bel_Latn | 1.2 | 4.351 | 6 | 64 | 0.849 |
| Tatoeba-test-v2021-08-07.rus-bos_Latn | 52.0 | 0.78630 | 12 | 54 | 1.000 |
| Tatoeba-test-v2021-08-07.rus-bul | 51.1 | 0.70562 | 1247 | 8239 | 0.945 |
| Tatoeba-test-v2021-08-07.rus-ces | 52.2 | 0.69079 | 2934 | 16824 | 0.975 |
| Tatoeba-test-v2021-08-07.rus-dsb | 9.3 | 0.41978 | 24 | 118 | 0.974 |
| Tatoeba-test-v2021-08-07.rus-hbs | 48.6 | 0.68671 | 2500 | 14723 | 0.949 |
| Tatoeba-test-v2021-08-07.rus-hrv | 48.5 | 0.69575 | 124 | 723 | 0.966 |
| Tatoeba-test-v2021-08-07.rus-hsb | 33.5 | 0.43965 | 38 | 273 | 0.867 |
| Tatoeba-test-v2021-08-07.rus-mkd | 48.9 | 0.82007 | 3 | 15 | 0.857 |
| Tatoeba-test-v2021-08-07.rus-orv | 0.1 | 0.855 | 171 | 1174 | 1.000 |
| Tatoeba-test-v2021-08-07.rus-pol | 51.1 | 0.70183 | 3543 | 21485 | 0.961 |
| Tatoeba-test-v2021-08-07.rus-rus | 40.2 | 0.62501 | 2500 | 16799 | 0.979 |
| Tatoeba-test-v2021-08-07.rus-slv | 22.3 | 0.38246 | 657 | 3969 | 0.992 |
| Tatoeba-test-v2021-08-07.rus-srp_Cyrl | 46.3 | 0.66245 | 881 | 5400 | 0.942 |
| Tatoeba-test-v2021-08-07.rus-srp_Latn | 50.1 | 0.70162 | 1483 | 8546 | 0.952 |
| Tatoeba-test-v2021-08-07.rus-ukr | 66.2 | 0.81232 | 10000 | 59963 | 0.997 |
| Tatoeba-test-v2021-08-07.slv-bel | 24.7 | 0.46936 | 12 | 67 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-bul | 31.0 | 0.63570 | 11 | 67 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-ces | 48.9 | 0.65832 | 489 | 2469 | 0.983 |
| Tatoeba-test-v2021-08-07.slv-dsb | 13.6 | 0.34802 | 330 | 1397 | 0.958 |
| Tatoeba-test-v2021-08-07.slv-hbs | 46.5 | 0.60530 | 37 | 160 | 0.994 |
| Tatoeba-test-v2021-08-07.slv-hrv | 100.0 | 10.00000 | 1 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-hsb | 18.9 | 0.35811 | 743 | 3132 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-mkd | 41.0 | 0.58580 | 115 | 586 | 0.938 |
| Tatoeba-test-v2021-08-07.slv-pol | 46.6 | 0.65745 | 183 | 981 | 0.976 |
| Tatoeba-test-v2021-08-07.slv-rus | 46.8 | 0.64692 | 657 | 4028 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-slv | 5.1 | 0.22327 | 9 | 50 | 1.000 |
| Tatoeba-test-v2021-08-07.slv-srp_Cyrl | 45.2 | 0.59957 | 36 | 156 | 0.994 |
| Tatoeba-test-v2021-08-07.slv-ukr | 35.9 | 0.56599 | 915 | 4352 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-bel | 43.7 | 0.57124 | 22 | 126 | 0.976 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-ces | 53.7 | 0.85516 | 1 | 6 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-hrv | 0.0 | 10.00000 | 2 | 4 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-pol | 49.1 | 0.67015 | 92 | 608 | 0.975 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-rus | 54.0 | 0.73102 | 881 | 5075 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-slv | 2.0 | 0.14963 | 36 | 144 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Cyrl-ukr | 52.9 | 0.68849 | 205 | 1053 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Latn-bel | 34.4 | 0.56953 | 16 | 73 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Latn-pol | 62.1 | 0.77494 | 54 | 338 | 0.961 |
| Tatoeba-test-v2021-08-07.srp_Latn-rus | 58.8 | 0.74836 | 1483 | 8271 | 0.985 |
| Tatoeba-test-v2021-08-07.srp_Latn-srp_Cyrl | 95.0 | 0.97935 | 4 | 53 | 1.000 |
| Tatoeba-test-v2021-08-07.srp_Latn-ukr | 55.8 | 0.73637 | 348 | 1658 | 0.995 |
| Tatoeba-test-v2021-08-07.ukr-bel | 49.7 | 0.69525 | 2355 | 15166 | 1.000 |
| Tatoeba-test-v2021-08-07.ukr-bel_Latn | 2.3 | 4.619 | 8 | 61 | 0.915 |
| Tatoeba-test-v2021-08-07.ukr-bul | 59.4 | 0.76649 | 1020 | 5181 | 0.989 |
| Tatoeba-test-v2021-08-07.ukr-ces | 55.7 | 0.71057 | 1787 | 8549 | 0.995 |
| Tatoeba-test-v2021-08-07.ukr-dsb | 5.9 | 0.16044 | 3 | 14 | 0.846 |
| Tatoeba-test-v2021-08-07.ukr-hbs | 51.6 | 0.70343 | 942 | 5130 | 0.977 |
| Tatoeba-test-v2021-08-07.ukr-hrv | 50.7 | 0.69167 | 389 | 2302 | 0.984 |
| Tatoeba-test-v2021-08-07.ukr-hsb | 34.6 | 0.43100 | 8 | 128 | 0.666 |
| Tatoeba-test-v2021-08-07.ukr-mkd | 28.0 | 0.68068 | 5 | 22 | 1.000 |
| Tatoeba-test-v2021-08-07.ukr-orv | 0.2 | 0.900 | 973 | 5037 | 1.000 |
| Tatoeba-test-v2021-08-07.ukr-pol | 55.7 | 0.73376 | 2519 | 13193 | 0.969 |
| Tatoeba-test-v2021-08-07.ukr-rus | 71.3 | 0.84292 | 10000 | 60129 | 0.998 |
| Tatoeba-test-v2021-08-07.ukr-slv | 14.9 | 0.28913 | 915 | 4265 | 1.000 |
| Tatoeba-test-v2021-08-07.ukr-srp_Cyrl | 54.2 | 0.71235 | 205 | 1112 | 0.963 |
| Tatoeba-test-v2021-08-07.ukr-srp_Latn | 51.0 | 0.71546 | 348 | 1716 | 0.976 |
| Tatoeba-test-v2021-08-07.ukr-ukr | 38.1 | 0.61718 | 824 | 4198 | 1.000 |