litellm
Unified gateway and SDK for 100+ LLMs with cost tracking and observability.
ai-gatewayanthropicazure-openaibedrock
LiteLLM is an open-source AI Gateway and Python SDK that provides a single, unified interface to call over 100 different LLM APIs (like OpenAI, Anthropic, and Bedrock) using the OpenAI format. It solves the problem of API fragmentation and complexity by offering consistent calling patterns, built-in load balancing, cost tracking, and logging across all providers. It's designed for developers and organizations building AI applications who need reliability, observability, and flexibility without being locked into a single vendor.
