litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and l

What is litellm?

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/berriailitellm.svg)](https://yunodb.com/tools/berriailitellm?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/berriailitellm?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/berriailitellm.svg" alt="Featured on YunoDB" height="20"></a>