Skip to content

Commit

Permalink
added superglue dev set results to readme
Browse files Browse the repository at this point in the history
Summary: Pull Request resolved: fairinternal/fairseq-py#815

Differential Revision: D16733633

fbshipit-source-id: 0a5029e41b6dbb9fb28e9703ad057d939d489d90
  • Loading branch information
Naman Goyal authored and facebook-github-bot committed Aug 9, 2019
1 parent 6398aa9 commit 3563e59
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions examples/roberta/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,13 @@ Model | MNLI | QNLI | QQP | RTE | SST-2 | MRPC | CoLA | STS-B
`roberta.large` | 90.2 | 94.7 | 92.2 | 86.6 | 96.4 | 90.9 | 68.0 | 92.4
`roberta.large.mnli` | 90.2 | - | - | - | - | - | - | -


##### Results on SuperGLUE tasks (dev set, single model, single-task finetuning)

Model | BoolQ | CB | COPA | MultiRC | RTE | WiC | WSC
---|---|---|---|---|---|---|---
`roberta.large` | 86.9 | 98.2 | 94.0 | 85.7 | 89.5 | 75.6 | 91.3

##### Results on SQuAD (dev set)

Model | SQuAD 1.1 EM/F1 | SQuAD 2.0 EM/F1
Expand Down

0 comments on commit 3563e59

Please sign in to comment.