Error connecting workflow to prompt - Network error trying to host locally on vultr using the docker template

[TheMindExpansionNetwork]

Hello you all love this tool trying to get it hosted locally on this machine I got it all situated with the docker compose up -d and it seems to be running working

I put in the IP address of my vultr server then http://0.0.0.0:8080 took away for security but using the local IP address I get to this

Not sure what I am missing

[wintonzheng]

@TheMindExpansionNetwork Could you open the network tab of your browser and share more of what the network error is?

[devtony10]

error snippet from docker logs below:

litellm.exceptions.BadRequestError: litellm.BadRequestError: AzureException BadRequestError - Unrecognized request argument supplied: max_completion_tokens

It's the same problem I have but with azure, this is the API version I'm using:
model name: gpt-4
model version: turbo-2024-04-09

docker-compose.yml:

• ENABLE_AZURE=true
• LLM_KEY=AZURE_OPENAI
• AZURE_DEPLOYMENT=gpt-4
• AZURE_API_KEY=xxxx
• AZURE_API_BASE=https://xxxx.openai.azure.com/
• AZURE_API_VERSION=2024-08-01-preview

Apparently, for older api versions, max_completion_tokens is not recognized. Please can you make a patch