ailocal/openai-proxy: Route select OpenAI API endpoints to local services (e.g. Whisper, Ollama, Kororo).

[mbailey]

Released today (22 Jan 2025)

openai-proxy

Portable HTTP proxy for routing select OpenAI API paths to alternative endpoints.

Use unmodified tools (like Aider) with self-hosted services such as:

• Whisper.cpp: Voice transcription
• Ollama: Large Language Models
• Kokoro-FastAPI: Text to Speech

The OpenAI SDK's allow you to direct traffic to an alternate provider:

```shell
export OPENAI_BASE_URL=http://localhost:2020/v1
```

This project provides a simple way to route different services to different places.

Feel free to try it out with Whisper running on my M4 Mac Mini: https://api.ailocal.org

Uses HAProxy, the Reliable, High Performance TCP/HTTP Load Balancer.