Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add truncation warning #169

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Add truncation warning #169

wants to merge 1 commit into from

Conversation

vadi2
Copy link

@vadi2 vadi2 commented Jul 20, 2023

Add truncation warning, as it can be kind of rough to find this through trial and error or by noticing the context numbers.

@turboderp
Copy link
Owner

I don't think this is the right approach. Truncation is now a regular part of how the context window is adjusted, so it would spam hundreds of lines in the console. I've been meaning to add a feature to the UI that will visually indicate how much of the history is being used as context, but I haven't gotten around to it, and the front-end code probably needs to be cleaned up a bunch first.

@vadi2
Copy link
Author

vadi2 commented Jul 20, 2023

That approach would work just as well. Some kind of a return notification on the API would be nice too!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants