New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Slow chat with more then 40k tokens #180

Closed

Meteord opened this issue Nov 22, 2024 · 1 comment · Fixed by #304

Labels

bug

Contributor

Meteord commented Nov 22, 2024

Describe the bug
40/50000 tokens in the chat, the chat hangs or there are several seconds of latency

Meteord added the bug label

github-actions bot commented Jan 22, 2025

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this issue will be closed.

github-actions bot added the Stale label

pilitz removed the Stale label

pilitz linked a pull request

that will close this issue

180 slow chat with more then 40k tokens #304

Merged

pilitz mentioned this issue

180 slow chat with more then 40k tokens #304

Merged

pilitz closed this as completed in #304

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment