A REST API for vLLM, production ready

Gabarit : kickstart your data science project from scratch

The results of the benchmarks obtained using benchmark_llm_serving (https://github.com/France-Travail/benchmark_llm_serving)

⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other building blocks

Supercharge Your LLM Application Evaluations 🚀

Sensitive input Generalization Output

Private Input Masked Output - PIMO is a tool for data masking (anonymization, pseudonymization, ...).