Add more verbose description of your Bot here
- uv - https://docs.astral.sh/uv/getting-started/installation/
- docker (for building container) - https://docs.docker.com/engine/
Create a python venv and install the necessary packages for the bot to run.
uv venv
source .venv/bin/activate
uv sync --all-extras --dev
You can run your bot locally with
flask run
# or
granian run
You can also create a Docker image out of this bot. For this, you first need to build the image with the build_container.sh
You can specify which model the image should be built with the MODEL environment variable. If you omit it, the image will be built with the default model.
MODEL=model_name ./build_container.sh
then you can run it with:
docker run -p 5500:8000 <image-name>:<tag>
If you encounter errors, make sure that port 5500 is not in use by another application.
Once the bot is running, you can send test data to it on which it runs its inference method:
curl -X POST http://127.0.0.1:5500 -H "Content-Type: application/json" -d '{"key": "some data"}'
EUROPEAN UNION PUBLIC LICENCE v. 1.2