Development Results:
| Model Name | amh | hau | ibo | kin | lug | luo | pcm | swa | wol | yor | Avg. |
|---|---|---|---|---|---|---|---|---|---|---|---|
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-1/best-model.pt | 24.8 | 48.9 | 58.2 | 37.1 | 54.8 | 13.8 | 43.3 | 53.8 | 15.7 | 39.5 | 39 |
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-2/best-model.pt | 27.5 | 48.3 | 58.2 | 40 | 55.3 | 13 | 38.1 | 52.4 | 16.5 | 50.1 | 39.8 |
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-3/best-model.pt | 25.5 | 48.2 | 57.4 | 52 | 56 | 17.9 | 38.2 | 52 | 20.6 | 51.1 | 42 |
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-4/best-model.pt | 22.1 | 50.1 | 55.8 | 34.8 | 51.5 | 13 | 40.2 | 52.1 | 17.2 | 47.8 | 39.1 |
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-5/best-model.pt | 24.4 | 48.2 | 55.3 | 34.8 | 57.5 | 9.2 | 42 | 53.6 | 19.7 | 44.4 | 38.7 |
| Language Avg. | 24.9 | 48.7 | 57 | 39.7 | 55 | 13.4 | 40.4 | 52.8 | 17.9 | 46.6 | 39.6 |
Test Results:
| Model Name | amh | hau | ibo | kin | lug | luo | pcm | swa | wol | yor | Avg. |
|---|---|---|---|---|---|---|---|---|---|---|---|
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-1/best-model.pt | 25.8 | 46.6 | 54 | 31.8 | 55.4 | 16.2 | 42.9 | 52 | 24.1 | 41.7 | 39 |
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-2/best-model.pt | 26.8 | 45.2 | 56.6 | 31.5 | 55.9 | 16.3 | 39.1 | 50.7 | 25.6 | 50 | 39.8 |
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-3/best-model.pt | 26.3 | 44 | 58 | 46.3 | 56.9 | 19.3 | 39.6 | 50.1 | 29.3 | 50.4 | 42 |
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-4/best-model.pt | 21.6 | 47 | 53.7 | 29.1 | 55.3 | 17.1 | 41.8 | 51.5 | 25.3 | 48.4 | 39.1 |
| wikiann-en-fine-tuned-stefan-it/xlm-v-base-bs32-wsFalse-e10-lr2e-05-layers-1-crfFalse-5/best-model.pt | 25.8 | 45.7 | 55.5 | 27.5 | 57 | 13.5 | 40.1 | 49.6 | 27.3 | 45.4 | 38.7 |
| Language Avg. | 25.3 | 45.7 | 55.6 | 33.2 | 56.1 | 16.5 | 40.7 | 50.8 | 26.3 | 47.2 | 39.7 |