Releasesby GlyphPromptfoo 0.121.18
0.121.18 (2026-07-07) Features add Node.js 20 support cutoff campaign ( #9862 ) ( d4d35da ) add per-test repeat option ( #9781 ) ( 3e1f02b ) app: surface websocket subprotocols ( #9947 ) ( 88c7445 ) config: add YAML source location to prompt reference errors ( #9940 ) ( 5f13e76 ) providers: add Bedrock support for Grok 4.3, GLM, MiniMax, Kimi, Nemotron...
Also shipped Jul 8, 2026Promptfoo in July 2026 →
Object metadata column is now in Public Preview
The _object_metadata column is now in Public Preview. The _object_metadata column is a hidden metadata column that exposes object-level properties for objects in cloud storage, including MIME type, ETag, user-defined key-value metadata, system-defined metadata, and object tags. It is available starting from Databricks Runtime 18.1.
Genie products now use pay-as-you-go pricing
Starting July 8, 2026 at 00:00 UTC, Genie products, including Genie Agents , Genie Code , and Genie One , are billed following a pay-as-you-go pricing model that includes 150 Databricks units (DBUs) of free large language model (LLM) usage every month, equivalent to about $10.50 in the US East region.
Google Gemini 2.5 Flash and Pro are scheduled for retirement
Google Gemini 2.5 Flash and Gemini 2.5 Pro will be retired on October 2, 2026. The recommended replacement models are Gemini 3.1 Pro or Gemini 3.5 Flash. See Deprecated and retired models for migration guidance.
Anthropic Claude Sonnet 4 is scheduled for retirement
Anthropic Claude Sonnet 4 will be retired on October 9, 2026. Claude Sonnet 4.6 is the recommended replacement. See Deprecated and retired models for migration guidance.
Restrict access to AI Functions with Unity Catalog permissions (Public Preview)
You can now use Unity Catalog permissions to restrict which task-specific AI Functions your organization can access, independent of foundation model access. Contact your account team to enable this feature. See AI Functions Unity Catalog permissions .
Genie Agents now uses pay-as-you-go pricing
Starting July 8, 2026 at 00:00 UTC, Genie Agents is billed following a pay-as-you-go pricing model that includes 150 DBUs of free large language model (LLM) usage every month, equivalent to about $10.50 in the US East region. Usage beyond the free amount is billed in DBUs, reflecting the underlying LLM models and agents that power each Genie Agents session.
More from PromptfooEvery Promptfoo release →
Promptfoo 0.121.19
0.121.19 (2026-07-14) Features providers: add Bedrock GPT-5.6 frontier support ( #10081 ) ( a97c8eb ) providers: add Meta Model API (Muse Spark) provider ( #10041 ) ( e6f06da ) providers: add Open Interpreter provider ( #10079 ) ( c4d9028 ) providers: add xAI Grok 4.5 support ( #10032 ) ( 83cedf0 ) providers: honor CLAUDE_CONFIG_DIR for Claude Code creds (...
Promptfoo 0.121.17
0.121.17 (2026-06-16) Bug Fixes docker: bump pinned Python to 3.14 to match the Alpine base image ( #9769 ) ( 24fc5be ) docker: unpin Python minor by default so Alpine drift can't break the build ( #9771 ) ( c69ef40 ) matchers: drop stranded list markers in RAGAS context-relevance segmentation ( #9767 ) ( b06eb88 ) sanitizer: stop over-redacting benign url...
Promptfoo 0.121.20
0.121.20 (2026-07-30) Features providers: add Claude Opus 5 support ( #10210 ) ( ff84f13 ) providers: add current Azure, Claude, and Gemini models ( #10128 ) ( 5c216a1 ) providers: add Kimi K3 support to Moonshot provider ( #10132 ) ( a1168b6 ) websocket: support URL templating ( #10171 ) ( a9aaced ) Bug Fixes assertions: default conversation-relevance...
Promptfoo 0.122.0
0.122.0 (2026-08-04) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes deps: keep the Shai-Hulud compromised versions unreachable ( #10301 ) ( db2a066 ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: pin socket.io-parser above the packet-decoder DoS ( #10279 ) ( d0f2a83 ) deps: repair Biome and...
Promptfoo 0.122.1
0.122.1 (2026-08-26) Features eval: distinguish scan footprint from incurred token usage ( #10497 ) ( 8df8ef0 ) providers: add Gemini 3.7 Flash and Flash-Lite ( #10389 ) ( bc6b189 ) redteam: account for multi-turn attacker and grading tokens ( #10407 ) ( 33cc8bc ) redteam: report generation, target, attacker, and grading tokens ( #10408 ) ( 0891e4e )...
Promptfoo 0.122.2
0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )
Promptfoo 0.123.0
0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...
Promptfoo 0.123.1
0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...