Skip to content

test and docs for xet dedup based file sharing. - #14835

Merged
sayakpaul merged 3 commits into
mainfrom
enable-xet-dedup
Sep 23, 2026
Merged

sayakpaul merged 3 commits into
mainfrom
enable-xet-dedup

Conversation

@sayakpaul

Copy link
Copy Markdown
Member

See #14802. It also has numbers on the disk space savings one can have from this feature.

We don't need any changes in the core codebase to benefit from this feature. So, this PR just adds a test (and docs) for a scenario that is the most beneficial for modular diffusers.

@github-actions github-actions Bot added documentation Improvements or additions to documentation tests size/M PR with diff < 200 LOC labels Sep 22, 2026
@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@Wauplin Wauplin left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for documenting and testing it officially! 馃

@sayakpaul
sayakpaul requested a review from DN6 September 22, 2026 08:29
@sayakpaul
sayakpaul merged commit 0121a91 into main Sep 23, 2026
18 of 20 checks passed
@sayakpaul
sayakpaul deleted the enable-xet-dedup branch September 23, 2026 04:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation size/M PR with diff < 200 LOC tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Revisit modular diffusers weight-duplication workaround now that huggingface_hub has a shared blobs cache

3 participants