Back to Explore

BerriAI/litellm

GitHub
96 updates · last 90 days1 watchersOpen source

Last release:

LiteLLM is a GitHub-hosted project for working with and routing language model requests (as suggested by the project name). It’s useful for developers who want a single integration point to use LLMs through LiteLLM.

Project status

  • Actively maintained (yes): GitHub activity is current (last upstream push on 2026-07-30), and the update stream shows frequent development and staging builds (rc and dev versions), indicating ongoing work rather than dormancy.
  • Update cadence (high, near-weekly): Multiple updates land within days, including v1.94.0 (2026-07-28), v1.95.0-dev.2 (2026-07-24), v1.95.0-dev.1 (2026-07-22), and v1.94.0-rc.3 and rc.2 (2026-07-22 and 2026-07-20), with rc/dev iterations continuing into the present.

AI summary generated

AI-generated from public sources. May be inaccurate. Report

Recent updates

  • v1.95.0-rc.1

    v1.95.0-rc.1 is a release candidate that adds verification guidance for LiteLLM Docker image signatures using cosign, along with a large set of UI refactors/migrations (notably to shadcn and updated routing/components). The documented changes also include guardrails, proxy/gateway bug fixes, MCP/OAuth-related tweaks, and several cost and logging correctness fixes.

    BreakingFeatures
  • v1.94.0

    v1.94.0 focuses on UI improvements (router complexity tooling, DataTable migrations), proxy/runtime fixes (model namespace handling, OAuth/SSO behavior, MCP response handling), and guardrail and logging correctness. The release notes also include a documented breaking change around enforcing user budgets on team keys with a UI opt-out, plus Docker image signing verification guidance.

    BreakingSecurityFeatures
  • v1.95.0-dev.2

    v1.95.0-dev.2 adds a new guardrails mode for per-session incremental scanning (only_scan_new_messages) and fixes Bedrock Nova Sonic realtime behavior to emit OpenAI-style session.created on connect and session.updated on session.update. The release also includes multiple proxy, SCIM, and UI changes, plus CI and e2e test suite reorganization, and documents cosign-based Docker image signature verification.

    BreakingFeatures
  • v1.95.0-dev.1

    v1.95.0-dev.1 adds several new Rust gateway capabilities, including native Anthropic /messages routing and OpenAI Responses API WebSockets support, plus performance work such as bedrock audio transcription via the Rust core. The release notes also document spend tracking updates for prompt compression and a supply-chain hardening step for verifying published Docker images with cosign. Overall, the diff shows schema changes for spend aggregates and SSO identity assertions, alongside new ai-gateway modules to support these capabilities.

    SecurityFeatures
  • v1.94.0-rc.3

    v1.94.0-rc.3 primarily backports changes from prior PRs to the rc/1.94.0 branch and bumps litellm-proxy-extras to 0.4.79.post1. It also rebuilds the Next.js UI bundle so the Cost Optimization page ships.

    BreakingFeatures
  • v1.94.0-rc.2

    Release v1.94.0-rc.2 is documented as a simple backport chore (#33929) plus guidance on verifying LiteLLM Docker image signatures with cosign. The actual diff, however, includes substantial build, Docker, Enterprise integration, and Helm chart changes that are not covered by the release notes.

  • v1.93.0

    LiteLLM v1.93.0 focuses on fixes across MCP, streaming behavior, proxy routing, UI state, caching, and observability. Release notes also document a breaking MCP change around how oauth2_flow is sourced from DB/config, plus a Docker base image digest bump and an enterprise/internal version bump. Release includes instructions for verifying Docker image signatures with cosign.

    BreakingSecurityFeatures
  • v1.92.1

    Release v1.92.1 is primarily a backport release that claims no user-visible changes beyond including several PRs into the stable/1.92.x line. The provided release notes do not enumerate functional or API changes.

  • v1.91.4

    Release v1.91.4 primarily documents how to verify LiteLLM Docker image signatures with cosign, and otherwise states the release was produced via a backport/cherry-pick. The code diff for this version range includes multiple substantive build, CI, Docker, and backend changes that are not described in the release notes.

    BreakingSecurityFeatures
  • v1.90.6

    Release v1.90.6 is presented as a backport of a prior change (#33853) on the stable/1.90.x branch. The release notes also document how LiteLLM Docker images are signed and how to verify the signature using cosign.

    Breaking
  • v1.94.0-rc.1

    v1.94.0-rc.1 is primarily a bug-fix and integration release across LiteLLM routing, proxying, provider billing, and the admin UI, with multiple targeted test updates. It also introduces Rust-side support for routing Azure Anthropic /messages when enabled (rust:true), alongside some infra changes for Prisma behavior in Docker.

    Features
  • v1.94.0-dev.3

    v1.94.0-dev.3 includes a mix of CLI, UI, MCP, streaming, logging, and infrastructure changes, plus workflow and Docker packaging tweaks. It also documents updates around Langfuse OTEL behavior, streaming usage/cost handling, and operational Helm chart improvements like per-component PodDisruptionBudgets and topology spread constraints.

    Features
  • v1.90.5

    v1.90.5 release notes contain only a backport chore note (backport #33592 to stable/1.90.x and cut 1.90.5). The code diff for this release shows a much broader set of functional changes across file upload handling, batch file parsing/token counting, Bedrock tool and caching capability logic, and Gemini Realtime session.update behavior, none of which are described in the release notes.

    BreakingFeatures
  • v1.93.0-rc.2

    Release notes for v1.93.0-rc.2 only describe a chore backport, with no mention of functional changes. The actual diff shows targeted updates in AWS/Berdock handling (OIDC/WIF session policy and credential forwarding) plus internal refactoring of Litellm parameter key sets.

  • v1.94.0-dev.2

    v1.94.0-dev.2 primarily bundles a set of proxy, adapter, guardrails, UI, and logging fixes, plus enterprise metering work and related tests. The release notes list many user-facing behavior changes, but the code diff also reveals additional enterprise schema and internal routing-related modifications that are not covered. Overall, there are a few changes that could break internal integrations due to renamed constructor parameters and a database schema expansion.

    Features
  • v1.94.0-dev.1

    v1.94.0-dev.1 includes a mix of UI improvements (auto-router, tables/data rendering, connection testing) plus backend changes around batches cost tracking, guardrails behavior, and observability (Prometheus metrics). The release notes are extensive, but the provided code diff also shows a few API or internal integration shifts that are not explicitly called out for downstream developers.

    BreakingFeatures
  • v1.90.4

    Release v1.90.4 release notes only describe a backport chore to the stable/1.90.x branch and provide Docker image signature verification instructions using cosign. No functional changes or migration guidance are documented beyond that.

    BreakingFeatures
  • v1.92.0

    v1.92.0 includes a large batch of fixes across the proxy, streaming, caching, provider-specific request formatting, observability, and UI features such as Interactions API support in the playground. It also documents how LiteLLM Docker images are signed with cosign and provides commands to verify the v1.92.0 image signature.

    BreakingSecurityFeatures
  • v1.93.0-rc.1

    v1.93.0-rc.1 includes a large set of fixes across MCP, streaming behavior, provider header forwarding, SSE error handling, and multiple UI/UX updates. It also contains at least one explicitly-marked breaking change related to MCP OAuth configuration, where oauth2_flow handling is tightened to be read verbatim from DB/config. The provided code diff (partial) mainly shows CI/workflow and deployment/packaging-related changes, plus a small backend allowlist update.

    BreakingSecurityFeatures
  • v1.91.3

    v1.91.3 is presented in the release notes primarily as a backport, plus guidance about verifying LiteLLM Docker image signatures with cosign. The included release notes do not document any functional runtime changes. The actual diff shows multiple new OpenTelemetry logging/event behaviors and several guardrails content-handling behavior changes.

    SecurityFeatures