Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

4.0.0 : Sometimes, Alpaca skip tokens and writes gibberish. #512

Open
SuperUserNameMan opened this issue Feb 1, 2025 · 0 comments
Open
Labels
bug Something isn't working

Comments

@SuperUserNameMan
Copy link

Describe the bug

Sometimes, Alpaca 4.0.0 skips tokens and writes gibberish.

It could happen with any model ran locally by CPU, as well as ran using external instance of ollama from a server with GPU.

See first sentences in screenshot below :

Expected behavior

Don't skip any token.

Screenshots

Image

Debugging information

Couldn't find '/home/XXXXX/.ollama/id_ed25519'. Generating new private key.
Your new public key is: 

ssh-ed25519 XXXXXXXXXXXXXXXXXXXXx (confidential ?)

Error: listen tcp 127.0.0.1:11435: bind: address already in use

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant