[v2.4.0] Copy files into Buckets with `HfFileSystem`, outdated CLI extension hints
huggingface_hub v2.4.0 adds support for copying files into Buckets using HfFileSystem across bucket-to-bucket and repository workflows.
23 releases · 0 this month
huggingface_hub v2.4.0 adds support for copying files into Buckets using HfFileSystem across bucket-to-bucket and repository workflows.
The HfFileSystem now supports live_follow=True, which automatically refreshes cached directory listings by receiving file change notifications from the Hub.
A small release this week, mostly bug fixes and quality-of-life improvements. hf jobs stats now returns right away instead of streaming forever, concurrent downloads reliably use hf_xet, and HfFileSystem caching is more predictable. Two behavior changes are listed under Breaking changes.
📊 Jobs: retries, rescheduling, and port exposure Hugging Face Jobs get a batch of quality-of-life improvements this release. Jobs can now retry automatically on failure with the new attempts parameter, and you can start a fresh Job from an existing Job's saved spec (including secrets and hardware settings) with rerun_job / hf jobs rerun.
The job page has a new Resources panel next to the logs. While your job runs, it shows live CPU, RAM, GPU and VRAM usage, updated every couple of seconds.
Organizations can now subscribe to Hugging Face with their Google Cloud account. Usage for Inference Providers, Inference Endpoints, Spaces, Jobs, storage, and Team or Enterprise seats will appear on their Google Cloud invoice.
📂 [Cache] Shared blob store: deduplicate Xet files across repos The cache now deduplicates Xet files across repos. A Xet file downloaded through hf_xet is stored once at <CACHE_DIR>/blobs/<prefix>/<xet_hash> and every repo that needs it gets a relative symlink instead of a download: no bytes are transferred and no extra space is used, even across different...
🏷️ Custom labels for Sandboxes Dedicated sandboxes now accept custom labels, attached to the underlying Job. This is useful for cost attribution, bookkeeping, or finding and reconnecting to the sandboxes created by a given controller run. Labels use the same -l / --label KEY=VALUE syntax as hf jobs run .
Organizations can now control feature access per resource group rather than across the whole organization. This allows restricting features like Inference Endpoints to admins while leaving Jobs open to everyone.
Users can now filter Jobs by label on both user and organization jobs pages. Most-used labels appear as clickable chips with job counts, and a free-form key=value input allows filtering by any label.
Sandboxes give an assistant secure execution environments attached to buckets and repositories for dataset analysis, model training, and Space creation.
Users see egress usage in the dashboard and organizations get a per-user egress breakdown. It currently covers only traffic routed through the Hugging Face CDN.
The new Space creation page has an option to build with an AI agent: copy the generated command into your agent to build and iterate on a Space for a model, paper, or local folder.
Fine-grained tokens can be created from presets (Read-Only, Inference, Write, CI/CD, Full Access), and preset URLs link straight to a pre-configured token.
A Hardware filter on the Models page shows models that fit a specific GPU, CPU, or Apple Silicon chip, set from Hardware settings and shareable via URL.
Users can share feedback on the Hub, including bug reports and feature suggestions, directly with the Hugging Face team from the user menu.
Models, datasets, Spaces and Inference Providers.
Other Hugging Face products: Diffusers, Transformers
| Release-notes page | Site | Feed |
|---|---|---|
| Datasets releases github.com | github.com | RSS |
| Diffusers releases github.com | github.com | RSS |
| Hub changelog huggingface.co | huggingface.co | None |
| huggingface_hub releases github.com | github.com | RSS |
| PEFT releases github.com | github.com | RSS |
| smolagents releases github.com | github.com | RSS |
| TGI releases github.com | github.com | RSS |
| TRL releases github.com | github.com | RSS |