Back to Explore

BerriAI/litellm

GitHub
100 updates · last 90 days1 watchersOpen source

Last release:

LiteLLM is a GitHub-hosted project for working with and routing language model requests (as suggested by the project name). It’s useful for developers who want a single integration point to use LLMs through LiteLLM.

Project status

  • Actively maintained (yes): GitHub activity is current (last upstream push on 2026-07-30), and the update stream shows frequent development and staging builds (rc and dev versions), indicating ongoing work rather than dormancy.
  • Update cadence (high, near-weekly): Multiple updates land within days, including v1.94.0 (2026-07-28), v1.95.0-dev.2 (2026-07-24), v1.95.0-dev.1 (2026-07-22), and v1.94.0-rc.3 and rc.2 (2026-07-22 and 2026-07-20), with rc/dev iterations continuing into the present.

AI summary generated

AI-generated from public sources. May be inaccurate. Report

Recent updates

  • v1.95.0

    v1.95.0 introduces a mix of MCP and Rust gateway enhancements (including new routing for Anthropic messages and OpenAI Responses WebSocket parity), along with spend tracking and multiple UI improvements. The release notes also include several targeted fixes across auth, proxy behavior, caching, and model routing, plus one explicitly labeled security fix.

    SecurityFeatures
  • v1.94.1

    The release notes for v1.94.1 only document a backport/chore release and Docker image signing verification instructions. The code diff, however, includes several functional changes, including new compression savings tracking, changes to tool-call extraction helpers, additional Bedrock batch tag handling, header validation adjustments for Fireworks, and database schema additions for spend rollups and savings reporting.

    BreakingFeatures
  • v1.93.1

    v1.93.1 release notes contain only release hygiene (a backport of multiple PRs to stable/1.93.x) plus documentation on verifying LiteLLM Docker image signatures with cosign. No functional changes, behavioral changes, or migration guidance are described.

  • v1.96.0-rc.1

    v1.96.0-rc.1 is a release candidate that focuses on MCP (entitlements, tool dispatch), proxy improvements (management endpoints, retry behavior), and several UI enhancements around Auto-Router/classifier context windows and budgets pages. It also includes one explicitly documented breaking change related to how mock-testing request params are gated. The code diff, however, shows additional Helm and developer workflow changes that are not mentioned in the release notes.

    BreakingFeatures
  • v1.95.0-rc.3

    v1.95.0-rc.3 focuses on operational and product fixes around the LiteLLM dashboard/proxy, MCP, guardrails, and responses streaming. The release notes also include guidance for verifying LiteLLM Docker image signatures with cosign and multiple CI/typing housekeeping changes.

    BreakingFeatures
  • v1.96.0-dev.2

    v1.96.0-dev.2 includes a mix of proxy, pricing, guardrails, caching, logging, and provider-specific fixes, plus one explicitly marked breaking change around the MCP keyless gateway OAuth flow. The diff also shows several operational and internal-architecture changes (database, Rust crate exports, Helm chart behavior) that are not described in the release notes.

    BreakingFeatures
  • v1.95.0-rc.2

    v1.95.0-rc.2 is a large cross-cutting release touching proxy control-plane routing, spend log filtering, MCP DCR bridge plumbing, router behavior, and many UI component reorganizations. The release notes also highlight security and correctness fixes such as masking credentials in guardrail responses, plus several model metadata/pricing additions.

    SecurityFeatures
  • v1.96.0-dev.1

    v1.96.0-dev.1 includes a large set of fixes and incremental feature work across Prometheus/OTel observability, proxy/router behavior, and the UI. A notable code change is a Rust refactor that moves the Anthropic Messages callable implementation from litellm-ai-gateway into litellm-core, plus Helm work to pin bundled Postgres and Redis images for standalone deployments.

    BreakingFeatures
  • v1.95.0-rc.1

    v1.95.0-rc.1 is a release candidate that adds verification guidance for LiteLLM Docker image signatures using cosign, along with a large set of UI refactors/migrations (notably to shadcn and updated routing/components). The documented changes also include guardrails, proxy/gateway bug fixes, MCP/OAuth-related tweaks, and several cost and logging correctness fixes.

    BreakingFeatures
  • v1.94.0

    v1.94.0 focuses on UI improvements (router complexity tooling, DataTable migrations), proxy/runtime fixes (model namespace handling, OAuth/SSO behavior, MCP response handling), and guardrail and logging correctness. The release notes also include a documented breaking change around enforcing user budgets on team keys with a UI opt-out, plus Docker image signing verification guidance.

    BreakingSecurityFeatures
  • v1.95.0-dev.2

    v1.95.0-dev.2 adds a new guardrails mode for per-session incremental scanning (only_scan_new_messages) and fixes Bedrock Nova Sonic realtime behavior to emit OpenAI-style session.created on connect and session.updated on session.update. The release also includes multiple proxy, SCIM, and UI changes, plus CI and e2e test suite reorganization, and documents cosign-based Docker image signature verification.

    BreakingFeatures
  • v1.95.0-dev.1

    v1.95.0-dev.1 adds several new Rust gateway capabilities, including native Anthropic /messages routing and OpenAI Responses API WebSockets support, plus performance work such as bedrock audio transcription via the Rust core. The release notes also document spend tracking updates for prompt compression and a supply-chain hardening step for verifying published Docker images with cosign. Overall, the diff shows schema changes for spend aggregates and SSO identity assertions, alongside new ai-gateway modules to support these capabilities.

    SecurityFeatures
  • v1.94.0-rc.3

    v1.94.0-rc.3 primarily backports changes from prior PRs to the rc/1.94.0 branch and bumps litellm-proxy-extras to 0.4.79.post1. It also rebuilds the Next.js UI bundle so the Cost Optimization page ships.

    BreakingFeatures
  • v1.94.0-rc.2

    Release v1.94.0-rc.2 is documented as a simple backport chore (#33929) plus guidance on verifying LiteLLM Docker image signatures with cosign. The actual diff, however, includes substantial build, Docker, Enterprise integration, and Helm chart changes that are not covered by the release notes.

  • v1.93.0

    LiteLLM v1.93.0 focuses on fixes across MCP, streaming behavior, proxy routing, UI state, caching, and observability. Release notes also document a breaking MCP change around how oauth2_flow is sourced from DB/config, plus a Docker base image digest bump and an enterprise/internal version bump. Release includes instructions for verifying Docker image signatures with cosign.

    BreakingSecurityFeatures
  • v1.92.1

    Release v1.92.1 is primarily a backport release that claims no user-visible changes beyond including several PRs into the stable/1.92.x line. The provided release notes do not enumerate functional or API changes.

  • v1.91.4

    Release v1.91.4 primarily documents how to verify LiteLLM Docker image signatures with cosign, and otherwise states the release was produced via a backport/cherry-pick. The code diff for this version range includes multiple substantive build, CI, Docker, and backend changes that are not described in the release notes.

    BreakingSecurityFeatures
  • v1.90.6

    Release v1.90.6 is presented as a backport of a prior change (#33853) on the stable/1.90.x branch. The release notes also document how LiteLLM Docker images are signed and how to verify the signature using cosign.

    Breaking
  • v1.94.0-rc.1

    v1.94.0-rc.1 is primarily a bug-fix and integration release across LiteLLM routing, proxying, provider billing, and the admin UI, with multiple targeted test updates. It also introduces Rust-side support for routing Azure Anthropic /messages when enabled (rust:true), alongside some infra changes for Prisma behavior in Docker.

    Features
  • v1.94.0-dev.3

    v1.94.0-dev.3 includes a mix of CLI, UI, MCP, streaming, logging, and infrastructure changes, plus workflow and Docker packaging tweaks. It also documents updates around Langfuse OTEL behavior, streaming usage/cost handling, and operational Helm chart improvements like per-component PodDisruptionBudgets and topology spread constraints.

    Features