Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Baichuan2 models #280

Open
bernardx opened this issue Sep 9, 2023 · 1 comment
Open

Support for Baichuan2 models #280

bernardx opened this issue Sep 9, 2023 · 1 comment

Comments

@bernardx
Copy link

bernardx commented Sep 9, 2023

Baichuan2 is a new model tha has better overall results compared to the llama. https://huggingface.co/baichuan-inc/Baichuan2-13B-Chat
It works with AutoGPTQ, but I encountered some error with exllama.

3997267f0ea6fc9c7992296e90da7bf5

@wut0n9
Copy link

wut0n9 commented Oct 12, 2023

@bernardx 解决了吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants