LiteLLM

Open-source AI Gateway for 100+ LLMs

LLM ToolsOpen sourceOpen sourceAPI available
Visit tool

litellm.ai

About LiteLLM

LiteLLM is an open-source AI Gateway that provides a unified interface to call 100+ LLM providers using the OpenAI format.

Description summarised by AI from the sources listed below.

Key features

  • Unified API for 100+ LLMs
  • Unified API
  • Drop-in OpenAI compatibility
  • Production-ready gateway with virtual keys, spend tracking, guardrails, load balancing, and an admin dashboard
  • Production-ready gateway
  • 8ms P95 latency

Use cases

  • Managing LLM calls across providers
  • Unified interface for 100+ LLMs

Pricing

Pricing model: Open source. Detailed plans are not recorded; check the official website for current prices.

Pricing summarised by AI from the sources listed below.