Releasesby IbisPromptfoo 0.124.1
Update2 days agoUnverifiedAdded Oct 10, 2026
0.124.1 (2026-10-08) Features assertions: record cost without a threshold (037f1f6) providers: add OpenAI Decisions support (2dbf3ec) providers: expose catalog text-token pricing (3ecce2e) Bug Fixes assertions: preserve async expression grading (1df3eb8) assertions: preserve keyword-property grading (a2da804) assertions: preserve regex operands after yield...
Topics: Governance, Security, Pricing, Observability, Developer tools
More Promptfoo releases
Every Promptfoo releasePromptfoo code-scan-action: 0.2.2
0.2.2 (2026-10-08) Bug Fixes code-scan: mint OIDC after CLI installation (9a404c8)
Promptfoo 0.124.0
0.124.0 (2026-10-06) ⚠ BREAKING CHANGES providers: remove hosted ChatKit provider providers: make WatsonX SDKs opt-in deps: make Langfuse SDK opt-in deps: make Slack SDK opt-in providers: make OpenAI Agents an explicit install providers: make Codex Security SDK opt-in providers: make browser SDKs explicit installs deps: make local Transformers opt-in...
Promptfoo code-scan-action: 0.2.1
0.2.1 (2026-10-06) Bug Fixes deps: update type definitions (8174e60)
Promptfoo 0.123.1
0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...
Promptfoo 0.123.0
0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...
Promptfoo 0.122.2
0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )
Promptfoo code-scan-action: 0.2.0
0.2.0 (2026-08-28) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes code-scan: harden action supply chain ( #9991 ) ( 17e90eb ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: update type definitions ( #9832 ) ( f545c51 ) Miscellaneous Chores drop Node.js 20 support ( #10260 ) ( 26b725b )
Promptfoo 0.122.1
0.122.1 (2026-08-26) Features eval: distinguish scan footprint from incurred token usage ( #10497 ) ( 8df8ef0 ) providers: add Gemini 3.7 Flash and Flash-Lite ( #10389 ) ( bc6b189 ) redteam: account for multi-turn attacker and grading tokens ( #10407 ) ( 33cc8bc ) redteam: report generation, target, attacker, and grading tokens ( #10408 ) ( 0891e4e )...
Also shipped on Oct 8, 2026
Promptfoo in October 2026The Compliance API chat endpoints now also return chats from the unified Claude experience, in beta for
The Compliance API chat endpoints now also return chats from the unified Claude experience, in beta for Claude Enterprise organizations, with your existing Compliance Access Key. See Retrieve and delete chats, files, and projects.
Cloud SQL for MySQL supports blue-green deployments ( Preview )
Cloud SQL for MySQL supports blue-green deployments ( Preview ). Blue-green deployments let you update databases, such as performing major version upgrades from MySQL 8.0 to 8.4 and staging hardware or configuration modifications, while minimizing downtime.
Updates to Intelligent Workloads and Standard Workloads
Create and define Intelligent Workloads Intelligent Workloads is now generally available (GA), designed for teams that want to proactively monitor business-impacting transactions and associated KPIs. You can now leverage bulk creation to build multiple workloads at once.
Performance Risks Inbox is now generally available
Performance Risks Inbox is GA Performance Risks Inbox is now generally available (GA). It finds the performance anti-patterns that quietly slow your application down, such as N+1 queries and inefficient database calls, and groups them in one place so your team can fix them before they become incidents.
CLI v0.9.0 | CLI, Beta
CLI v0.9.0 Manage cloud tasks with cr code , including interactive messages, side questions, plans, and delivery. Complete shell commands and read richer review JSON . Verify signed Linux releases and recover more reliably from login and update failures. Run cr update . See cloud tasks and upgrade details .
The Discover page and domains are now GA
The Discover page and domains are now generally available. Discover is a curated browsing experience that helps users find assets across Databricks without requiring deep knowledge of catalog hierarchies.