Word embeddings extrinsic evaluation on POS
Epochs: 10
Metric: F1-weighted
embeddings are frozen: True
Бурятский
| method | dim | 2 | 5 | 10 |
|---|---|---|---|---|
| pmi | 0 | 28.6 | 28.6 | 29.1 |
| svd | 50 | 20.5 | 21.6 | 21.0 |
| svd | 100 | 22.3 | 23.0 | 23.9 |
| svd | 500 | 27.0 | 24.9 | 26.7 |
| glove | 50 | 14.6 | 13.5 | 15.8 |
| glove | 100 | 16.3 | 15.9 | 15.8 |
| glove | 500 | 18.6 | 19.5 | 21.3 |
| sg | 50 | 15.0 | 13.4 | 12.2 |
| sg | 100 | 16.2 | 16.3 | 15.1 |
| sg | 500 | 18.8 | 19.6 | 20.5 |
| cbow | 50 | 15.6 | 15.7 | 15.9 |
| cbow | 100 | 16.6 | 16.2 | 16.9 |
| cbow | 500 | 17.3 | 17.1 | 17.7 |
| ft | 50 | 15.7 | 14.7 | 14.3 |
| ft | 100 | 17.6 | 17.6 | 16.2 |
| ft | 500 | 21.3 | 23.1 | 24.5 |
| maj_bs | 50 | 14.5 | 14.5 | 14.5 |
| maj_bs | 100 | 14.5 | 14.5 | 14.5 |
| maj_bs | 500 | 14.5 | 14.5 | 14.5 |
Эрзянский
| method | dim | 2 | 5 | 10 |
|---|---|---|---|---|
| pmi | 0 | 30.6 | 30.7 | 31.0 |
| svd | 50 | 23.7 | 24.1 | 24.3 |
| svd | 100 | 25.3 | 25.7 | 25.9 |
| svd | 500 | 29.2 | 29.2 | 29.1 |
| glove | 50 | 20.3 | 19.9 | 21.0 |
| glove | 100 | 20.8 | 20.9 | 21.5 |
| glove | 500 | 22.8 | 23.0 | 25.1 |
| sg | 50 | 20.0 | 20.1 | 20.3 |
| sg | 100 | 21.3 | 22.0 | 22.0 |
| sg | 500 | 23.2 | 23.7 | 24.3 |
| cbow | 50 | 19.0 | 18.9 | 19.7 |
| cbow | 100 | 19.4 | 19.6 | 20.3 |
| cbow | 500 | 20.4 | 20.7 | 21.2 |
| ft | 50 | 23.4 | 22.7 | 20.0 |
| ft | 100 | 24.7 | 25.0 | 26.0 |
| ft | 500 | 26.7 | 28.6 | 29.9 |
| maj_bs | 50 | 9.8 | 9.8 | 9.8 |
| maj_bs | 100 | 9.8 | 9.8 | 9.8 |
| maj_bs | 500 | 9.8 | 9.8 | 9.8 |
Коми
| method | dim | 2 | 5 | 10 |
|---|---|---|---|---|
| pmi | 0 | 21.6 | 20.4 | 19.4 |
| svd | 50 | 15.9 | 16.7 | 16.6 |
| svd | 100 | 17.1 | 17.2 | 17.4 |
| svd | 500 | 19.1 | 19.0 | 18.9 |
| glove | 50 | 13.2 | 13.4 | 13.4 |
| glove | 100 | 14.1 | 14.6 | 13.6 |
| glove | 500 | 16.2 | 16.5 | 17.3 |
| sg | 50 | 12.8 | 12.4 | 11.5 |
| sg | 100 | 14.1 | 13.8 | 13.7 |
| sg | 500 | 15.4 | 15.6 | 15.8 |
| cbow | 50 | 13.2 | 13.3 | 13.6 |
| cbow | 100 | 13.3 | 13.6 | 14.4 |
| cbow | 500 | 14.5 | 14.7 | 15.4 |
| ft | 50 | 10.7 | 9.8 | 9.2 |
| ft | 100 | 10.7 | 9.8 | 9.2 |
| ft | 500 | 15.5 | 16.4 | 16.7 |
| maj_bs | 50 | 10.1 | 10.1 | 10.1 |
| maj_bs | 100 | 10.1 | 10.1 | 10.1 |
| maj_bs | 500 | 10.1 | 10.1 | 10.1 |