xet-core is xet client technology used by huggingface_hub for uploading and downloading files to the HF Hub using xet storage. It provides chunk-based deduplication, efficient storage and retrieval with local disk caching, and Python bindings, including the hf-xet package, plus a Git LFS compatible git-xet CLI tool.
Project status
- Actively maintained: the most recent upstream push was on 2026-07-17, with a corresponding update (v1.5.2) on 2026-07-16, indicating ongoing development rather than a dormant state.
- Apparent update cadence: updates have landed fairly regularly, roughly every 4 to 6 weeks (v1.5.0 on 2026-05-06, v1.5.1 on 2026-06-08, v1.5.2 on 2026-07-16).
AI summary generated
Recent updates
v1.5.2
Release v1.5.2 is described as a fix for a bug in HTTP request retry configuration that could cause hangs when a request was retried more than twice. However, the actual diff for this release includes multiple unrelated changes across Python bindings, Rust dependencies, wasm build tooling, and CI behavior that are not mentioned in the release notes.
Featuresv1.5.1
v1.5.1 improves hf-xet Python progress reporting by ensuring a final progress snapshot is emitted even if uploads/downloads complete between poll intervals, preventing UIs from getting stuck below 100%. It also addresses shutdown-time panics by changing how the background progress thread interacts with the Python interpreter during teardown.
Features1.5.0
hf-xet v1.5.0 introduces a session based, object oriented Python API centered around XetSession and its child objects (upload commit, download group, streaming download). The legacy module level functions (upload_files, download_files, hash_files) are kept under hf_xet/src/legacy and remain importable, but they now emit DeprecationWarning.
Featuresv1.4.3
This release introduces a hotfix for file corruption by ensuring the local output file is truncated appropriately during full-file downloads. A new boolean flag controls whether the output file is truncated to the reconstructed length.
v1.4.2
Despite the extensive release note content, the actual code diff between v1.4.1 and v1.4.2 shows only a version bump. No functional logic changes are present in the provided diff.
v1.4.1
hf-xet v1.4.1 focuses on upload and download performance improvements, plus fixes for stalls and incorrect error propagation during large file transfers. The release notes also mention an upload optimization around SHA-256 computation and new session/task APIs.
BreakingSecurityFeaturesv1.3.2
v1.3.2 is a download performance and stability release focused on faster multi-file downloads and reducing progress callback overhead. It also includes a wasm dependency bump and changes intended to address intermittent Windows test failures.
v1.3.1
This release adds Windows 11 ARM64 build support to the CI and Windows installer build workflow. It also bumps the hf-xet crate version from 1.3.0 to 1.3.1.
Featuresv1.3.0
v1.3.0 introduces adaptive concurrency control for uploads and downloads and improves progress reporting. The implementation refactors progress reporting to use byte-based callbacks and replaces the prior upload tracking mechanism, along with some HTTP client header handling changes.
Featuresgit-xet-v0.2.1
git-xet v0.2.1 focuses on installation workflow improvements for Homebrew, a macOS CI dependency tweak (removing openssl@3), and enabling adaptive concurrency. However, the code diff shows a much larger internal refactor inside cas_client, including changes to the public client interface and HTTP/retry plumbing that are not mentioned in the release notes.
BreakingFeatures