Foundry transforms upgraded to Apache Spark 4.0.1

UpdateSep 22, 2026VerifiedAdded Sep 22, 2026

The Apache Spark version used in Foundry transforms is being upgraded from 3.5.5 to 4.0.1 for all enrollments. No action is required.

Summaries of vendors' own notes. Product names and logos belong to their owners; logos via logo.dev.

More Foundry and AIP releases

Date	Release	Type
Sep 21	Carbon supports Insight analysis and modern object search Update	Update
Sep 17	Changes tab for reviewing resources in branching proposals Update	Update
Sep 15	Claude Opus 5 via AWS Bedrock on IL2 and IL4 enrollments Update	Update
Sep 15	Iceberg tables and Iceberg REST catalog are generally available GA	GA
Sep 15	Product groups in Foundry DevOps Update	Update
Sep 10	Z.ai and Moonshot AI models in AIP through Fireworks Update	Update
Sep 10	Gemini 3.8 Flash available in AIP Update	Update
Sep 10	GPT-5.6 series on IL2, IL4, and IL5 enrollments Update	Update

Date	Company	Release	Product	Type
Sep 22	Databricks	Shopify connector (Beta) Databricks LakeflowBeta	Lakeflow	Beta
Sep 22	Databricks	Lakebase backup schedule API (Beta) Databricks LakebaseBeta	Lakebase	Beta
Sep 22	AWS	OpenAI GPT-6 Sol and GPT-6 Luna are now generally available on Amazon Bedrock AWS Amazon BedrockGA	Amazon Bedrock	GA
Sep 22	Anthropic	Claude Opus 5.5 launches with a 1M token context window and 128k output Anthropic Claude PlatformGA	Claude Platform	GA
Sep 22	Anthropic	Fast mode research preview available for Claude Opus 5.5 on the Claude API Anthropic Claude PlatformPreview	Claude Platform	Preview
Sep 22	Anthropic	Claude API beta lets tools be defined inside mid-conversation system messages Anthropic Claude PlatformBeta	Claude Platform	Beta