Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

can it create a project from scratch? #45

Open
zenitogr opened this issue Jul 31, 2024 · 6 comments
Open

can it create a project from scratch? #45

zenitogr opened this issue Jul 31, 2024 · 6 comments
Labels
documentation Improvements or additions to documentation

Comments

@zenitogr
Copy link

using the npm package codewhisper in an empty folder it just terminates after displaying file and folder selection.

I havent set a AI API maybe thats the reason?

image

@zenitogr
Copy link
Author

set an Env variable in powershel with $Env:GROQ_API_KEY="my groq key"

and run again, it seems that it doesnt work with an empty folder:
image

@gmickel
Copy link
Owner

gmickel commented Jul 31, 2024

Thanks for the question @zenitogr !

CodeWhisper's main use-case is definitely implementing features, creating reviews, generating documentation, etc. on pre-existing projects.
However you can easily workaround this by creating a boilerplate project before starting a codewhisper task.

For example if you wanted to build a Nextjs project, just create it first npx create-next-app@latest then do a quick git init and commit. Then you can start using CodeWhisper to add features.

@zenitogr
Copy link
Author

ok how possible is it to allow it to work on a fresh empty folder? maybe a special command that it is all about initiating a project?

@gmickel
Copy link
Owner

gmickel commented Jul 31, 2024

If I were to add that functionality, I would probably use a second command that doesn't follow the codebase -> plan -> code generation route. I'll look into it.

Quick side note: I see you were trying to run it using the Groq API. You might have some success with it, but in my tests the rate-limits are currently far too low (if you're only a free user like I am :) for large feature implementations using CodeWhisper.

@zenitogr
Copy link
Author

can I use ollama? I got a 4070 and 32 GB ram! what model should I use with ollama? can i use LM-Studio?

@gmickel
Copy link
Owner

gmickel commented Jul 31, 2024

Realistically, for complex implementation tasks you'll want to be using the Anthropic, OpenAI or LLama 3.1 405b models. The latter isn't yet available on Groq, but I'm looking into adding another provider for it.

But you can use Ollama. Check the quick start section or usage for examples. The prompts CodeWhisper uses are currently tuned for these very large models and I'm still the process of testing whether I can get smaller models to work using simpler prompts.

I want to test it with deepseek-coder-v2, mistral-nemo, mistral-large, etc.

I will update this and the README when I've finished evaluating.

@gmickel gmickel assigned gmickel and unassigned gmickel Jul 31, 2024
@gmickel gmickel added the documentation Improvements or additions to documentation label Jul 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

2 participants