10 releases · 3 products · 5 GA · 3 Preview
Dataflow job builder now supports external Iceberg REST Catalogs as a source. You can now ingest data from external Apache Iceberg REST catalogs (IRC) directly into Lakehouse tables using Dataflow's job builder UI without writing code. For more information, see Import data from external Iceberg catalogs to Lakehouse using Dataflow .
Cloud Run ephemeral disk, which allows you to mount a volume that persists only for the duration of your service , job , or worker pool instance, is in Preview .
You can stream messages from Pub/Sub directly to a Bigtable table using Bigtable subscriptions . This feature lets you write streaming messages to Bigtable without needing a separate subscriber such as Dataflow. This feature is available in Preview .
Support for NVIDIA RTX PRO 6000 Blackwell GPU is in General Availability . For more information, see GPU support for services , jobs , and worker pools .
When you use min_ram or cpu_count resource hints for pipeline steps that don't require accelerators, Auto VM Selection (Instance Flexibility) is enabled automatically. With Auto VM Selection, workers are provisioned from a curated list of machine types that meet your RAM and CPU requirements.
Pub/Sub now offers the AI Inference Single Method Transform (SMT). This SMT lets you get inferences on Pub/Sub messages from Vertex AI models. The model's inferences are added to each message, making them available for downstream processing along with the original message data. The change is being rolled out in a phased manner over the rest of the week.
Releasesby Glyph