-
Notifications
You must be signed in to change notification settings - Fork 285
Add simple ollama chat example #336
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Hi @64bit, I've updated my PR with your feedback, though the Docker setup has some caveats I didn't have elegant solutions for.
What do you think? |
Thanks for update, I just tried it and looks good! I think Your entrypoint stuff to download model looks good to me. So user has to do two steps:
|
@64bit Sounds good! I updated my branch with your feedback to run the Rust code natively and rebased / cleaned up the commit history off latest upstream main. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looking good, thank your for your contributions!
Fixes #191.
I used the code examples from #173 as a starting point and tried to simplify them to match the existing chat example.