Ray-2.60.0
Ray 2.60.0 released shuffle v2 as default for joins and aggregations, updated Parquet task sizing from row-group metadata, added rolling update surge controls in Ray Serve, and patched security vulnerabilities.
15 releases · 2 this month
Ray 2.60.0 released shuffle v2 as default for joins and aggregations, updated Parquet task sizing from row-group metadata, added rolling update surge controls in Ray Serve, and patched security vulnerabilities.
Highlights > * Ray Data LLM & Ray Serve LLM are GA/Stable: the LLM APIs graduate to general availability this release (\#65194), alongside an upgrade to vLLM 0.27.0 (\#65351).
Highlights Ray Serve LLM: In this release we've completed KV cache and token aware request routing, which was previewed in 2.57. Tokenization now happens in-process on the LLMRouter ingress replica, the routing decision is made there, tokens are transmitted out-of-band so the engine does not re-tokenize, KV lifecycle events are broadcast to every ingress...
Highlights Ray Data: In this Ray release, we've enabled DataSourceV2 by default ( #64821 ), so read_parquet and friends use the new scan/listing infrastructure with row-group-aware chunking and predicate splitting. Hash Shuffle V2 eliminates the aggregator actor pool.
Highlights Ray Data Stability: In this Ray release, we've added a variety of stability improvements, including running multiple datasets in a cluster, adding automatic batch size selection to CPU-based map-batches, and default logical memory configuration to prevent OOMs.
Ray Data 🎉 New Features Add DataSourceV2 API with scanner/reader framework, file listing, and file partitioning ( #61220 , #61615 , #61997 ) Support GPU shuffle with rapidsmpf 26.2 ( #61371 , #62062 ) Add Kafka datasink, migrate to confluent-kafka , support datetime offsets ( #60307 , #61284 , #60909 ) Add Turbopuffer datasink ( #58910 ) Add 2-phase commit...
Ray Data 🎉 New Features Add checkpointing support to Ray Data ( #59409 ) Compute Expressions: list operations ( #59346 ), fixed-size arrays ( #58741 ), string padding ( #59552 ), logarithmic ( #59549 ), trigonometric ( #59712 ), arithmetic ( #59678 ), and rounding ( #59295 ) Add sql_params support to read_sql ( #60030 ) Add AsList aggregation ( #59920 )...
Highlights Ray plans to drop support for Pydantic V1 starting version 2.56.0. Please see this RFC for details. Ray Data now has support for bounded reading from Kafka and improved Iceberg support. Ray Data 🎉 New Features Autoscaling : New utilization-based cluster autoscaler for Ray Data workloads ( #59353 , #59362 , #59366 ).
The open-source framework for scaling AI and Python.
| Release-notes page | Site | Feed |
|---|---|---|
| Anyscale CLI and SDK release notes docs.anyscale.com | docs.anyscale.com | None |
| Anyscale platform release notes docs.anyscale.com | docs.anyscale.com | None |
| Anyscale platform release notes docs.anyscale.com | docs.anyscale.com | None |
| Anyscale platform release notes docs.anyscale.com | docs.anyscale.com | None |
| Anyscale platform release notes docs.anyscale.com | docs.anyscale.com | None |
| Anyscale platform release notes docs.anyscale.com | docs.anyscale.com | None |
| Anyscale platform release notes docs.anyscale.com | docs.anyscale.com | None |
| Anyscale release notes and support lifecycle docs.anyscale.com | docs.anyscale.com | None |