Skip to content

Commit fc77f99

Browse files
author
rowanz
committed
fix ckpt loading
1 parent 13f87ce commit fc77f99

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

data/groverdenoise/lm/configs/medium.json

+1-1
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66
"hidden_act": "gelu",
77
"initializer_range": 0.02,
88
"intermediate_size": 4096,
9-
"max_position_embeddings": 1024,
9+
"max_position_embeddings": 2048,
1010
"num_attention_heads": 16,
1111
"num_hidden_layers": 24,
1212
"max_batch_size_per_core": 3

0 commit comments

Comments
 (0)