Releasesby GlyphPromptfoo 0.121.20
0.121.20 (2026-07-30) Features providers: add Claude Opus 5 support ( #10210 ) ( ff84f13 ) providers: add current Azure, Claude, and Gemini models ( #10128 ) ( 5c216a1 ) providers: add Kimi K3 support to Moonshot provider ( #10132 ) ( a1168b6 ) websocket: support URL templating ( #10171 ) ( a9aaced ) Bug Fixes assertions: default conversation-relevance...
Also shipped Jul 31, 2026Promptfoo in July 2026 →
Web terminal on serverless GPU compute (AI Runtime) is in Public Preview
The web terminal in notebooks connected to serverless GPU compute (AI Runtime) is now in Public Preview . Use it to run shell commands, monitor GPU usage with nvidia-smi , install libraries, and manage files directly on the compute. This requires serverless GPU environment version 5 or above. See Run shell commands in Databricks web terminal .
Packaged clean rooms are now generally available
Packaged clean rooms are now generally available. In a packaged clean room, a provider supplies notebooks, JARs, and data that a consumer runs against their own data without seeing the provider's code or data assets. See Packaged clean rooms .
OpenAI connector (Beta)
The OpenAI connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the OpenAI Organization Admin API to ingest organization administration data, such as users, projects, API keys, usage, costs, and audit logs, from OpenAI into Databricks.
[In preview] Public Preview: Azure SQL updates for late-July
In late-July 2026, the following update and enhancement was made to Azure SQL: Regex-based dynamic data masking (DDM) extends the built-in DDM feature with pattern‑based masking to hide sensitive data like emails, phone numbers, and identifiers, centrally
Upcoming August 2026 model deprecations in GitHub Copilot
We will deprecate the following models across all GitHub Copilot experiences (including Copilot Chat, inline edits, ask and agent modes, and code completions), on September 1st, 2026: Model Deprecation date Suggested alternative Gemini 3.1 Pro 9-1-2026 Gemini 3.6 Flash Claude Opus 4.5 9-1-2026 Claude Opus 4.7, Claude Opus 4.8, or Claude Opus 5 Claude Opus...
Gemini 2.5 Pro and Gemini 3 Flash deprecated
As of today, July 31, 2026, we have deprecated the following models across all GitHub Copilot experiences (including Copilot Chat, inline edits, ask and agent modes, and code completions).
More from PromptfooEvery Promptfoo release →
Promptfoo 0.122.0
0.122.0 (2026-08-04) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes deps: keep the Shai-Hulud compromised versions unreachable ( #10301 ) ( db2a066 ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: pin socket.io-parser above the packet-decoder DoS ( #10279 ) ( d0f2a83 ) deps: repair Biome and...
Promptfoo 0.121.19
0.121.19 (2026-07-14) Features providers: add Bedrock GPT-5.6 frontier support ( #10081 ) ( a97c8eb ) providers: add Meta Model API (Muse Spark) provider ( #10041 ) ( e6f06da ) providers: add Open Interpreter provider ( #10079 ) ( c4d9028 ) providers: add xAI Grok 4.5 support ( #10032 ) ( 83cedf0 ) providers: honor CLAUDE_CONFIG_DIR for Claude Code creds (...
Promptfoo 0.121.18
0.121.18 (2026-07-07) Features add Node.js 20 support cutoff campaign ( #9862 ) ( d4d35da ) add per-test repeat option ( #9781 ) ( 3e1f02b ) app: surface websocket subprotocols ( #9947 ) ( 88c7445 ) config: add YAML source location to prompt reference errors ( #9940 ) ( 5f13e76 ) providers: add Bedrock support for Grok 4.3, GLM, MiniMax, Kimi, Nemotron...
Promptfoo 0.122.1
0.122.1 (2026-08-26) Features eval: distinguish scan footprint from incurred token usage ( #10497 ) ( 8df8ef0 ) providers: add Gemini 3.7 Flash and Flash-Lite ( #10389 ) ( bc6b189 ) redteam: account for multi-turn attacker and grading tokens ( #10407 ) ( 33cc8bc ) redteam: report generation, target, attacker, and grading tokens ( #10408 ) ( 0891e4e )...
Promptfoo 0.122.2
0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )
Promptfoo 0.123.0
0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...
Promptfoo 0.121.17
0.121.17 (2026-06-16) Bug Fixes docker: bump pinned Python to 3.14 to match the Alpine base image ( #9769 ) ( 24fc5be ) docker: unpin Python minor by default so Alpine drift can't break the build ( #9771 ) ( c69ef40 ) matchers: drop stranded list markers in RAGAS context-relevance segmentation ( #9767 ) ( b06eb88 ) sanitizer: stop over-redacting benign url...
Promptfoo 0.123.1
0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...