Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Longbench评测使用模型以及参数设置问题 #112

Open
Xiaoqi-Zhou916 opened this issue Feb 17, 2025 · 0 comments
Open

Longbench评测使用模型以及参数设置问题 #112

Xiaoqi-Zhou916 opened this issue Feb 17, 2025 · 0 comments

Comments

@Xiaoqi-Zhou916
Copy link

Xiaoqi-Zhou916 commented Feb 17, 2025 •
edited
Loading

1.Longbench评测只支持LongBench/config/model2path.json中的模型吗
2.如果跑其他模型，LongBench/config/model2maxlen.json文件中模型对应的max_length要怎么设置
3.LongBench/config/dataset2maxlen.json和LongBench/config/dataset2prompt.json中只设置了Longbench数据集的prompt和max_gen，Longbench-e的数据集子集不需要设置吗
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Xiaoqi-Zhou916