inboard on k8s

[br3ndonland]

FastAPI has some docs on deploying with Docker. The docs suggest that, if running on Kubernetes ("k8s"), you should build your own configuration instead of using a base image (like inboard):

If you have a cluster of machines with Kubernetes, Docker Swarm Mode, Nomad, or another similar complex system to manage distributed containers on multiple machines, then you will probably want to handle replication at the cluster level instead of using a process manager (like Gunicorn with workers) in each container.

One of those distributed container management systems like Kubernetes normally has some integrated way of handling replication of containers while still supporting load balancing for the incoming requests. All at the cluster level.

In those cases, you would probably want to build a Docker image from scratch as explained above, installing your dependencies, and running a single Uvicorn process instead of running something like Gunicorn with Uvicorn workers.

It is not necessary to build your own configuration from scratch as the FastAPI docs suggest. The effect of "running a single Uvicorn process instead of running something like Gunicorn with Uvicorn workers" can easily be accomplished with inboard. Just set the inboard environment variable PROCESS_MANAGER=uvicorn in your Dockerfile. This tells inboard to run a single Uvicorn process without Gunicorn.

It would be great to hear feedback from users running inboard on k8s. Feel free to comment here with any feedback or questions.