Promptfoo 0.123.1
0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...
Also shipped Sep 18, 2026Promptfoo in September 2026 →
Databricks Apps telemetry is now generally available
Configuring telemetry for your Databricks apps is now generally available. Databricks Apps telemetry collects traces, logs, and metrics and persists them to Unity Catalog tables using the OpenTelemetry (OTel) protocol.
Lakebase Search is generally available
Lakebase Search is now generally available. It brings scalable vector and keyword search to Lakebase projects through two Postgres extensions, so you can run semantic and exact-term search in a single database without a separate search stack: lakebase_vector adds the lakebase_ann index type for approximate nearest-neighbor vector search.
Apache Iceberg™ tables: Partition evolution (General availability)
With this release, we're pleased to announce the general availability of partition evolution for Snowflake-managed Iceberg tables. You can now change a table's partition specification after you create the table by adding, dropping, or replacing partition fields, without rewriting existing data.
xAI's Grok 4.6 is generally available
Grok 4.6 is now generally available (GA) and available for production use on the global endpoint and the US multi-region endpoint.
Gemini Enterprise: Support for new actions (Public Preview)
Support for new actions is available in Public Preview for the following data stores: Microsoft OneDrive : Copy folder, move file, move folder, rename file, rename folder, share file or folder, and update file properties. Microsoft Outlook : Create calendar, RSVP to event, and update calendar.
Agent Platform SDK for Python version 2.0.1 is available
Version 2.0.1 of the Agent Platform SDK for Python ( google-cloud-agentplatform ) is now available. This release migrates generative AI modules to the Google Gen AI SDK, decouples the agent surface from google-cloud-aiplatform into a dedicated package, and introduces restructured namespaces.
More from PromptfooEvery Promptfoo release →
Promptfoo 0.123.0
0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...
Promptfoo 0.124.0
0.124.0 (2026-10-06) ⚠ BREAKING CHANGES providers: remove hosted ChatKit provider providers: make WatsonX SDKs opt-in deps: make Langfuse SDK opt-in deps: make Slack SDK opt-in providers: make OpenAI Agents an explicit install providers: make Codex Security SDK opt-in providers: make browser SDKs explicit installs deps: make local Transformers opt-in...
Promptfoo 0.124.1
0.124.1 (2026-10-08) Features assertions: record cost without a threshold (037f1f6) providers: add OpenAI Decisions support (2dbf3ec) providers: expose catalog text-token pricing (3ecce2e) Bug Fixes assertions: preserve async expression grading (1df3eb8) assertions: preserve keyword-property grading (a2da804) assertions: preserve regex operands after yield...
Promptfoo 0.122.2
0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )
Promptfoo 0.122.1
0.122.1 (2026-08-26) Features eval: distinguish scan footprint from incurred token usage ( #10497 ) ( 8df8ef0 ) providers: add Gemini 3.7 Flash and Flash-Lite ( #10389 ) ( bc6b189 ) redteam: account for multi-turn attacker and grading tokens ( #10407 ) ( 33cc8bc ) redteam: report generation, target, attacker, and grading tokens ( #10408 ) ( 0891e4e )...
Promptfoo 0.125.0
This release adds support for rouge-l and rouge-s assertions, trace span filtering, and Gemini media models. It also introduces a safe mode to disable inline JavaScript execution during evaluations.
Promptfoo 0.125.1
Promptfoo 0.125.1 includes a bug fix to restore the Discord invite link.
Promptfoo 0.122.0
0.122.0 (2026-08-04) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes deps: keep the Shai-Hulud compromised versions unreachable ( #10301 ) ( db2a066 ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: pin socket.io-parser above the packet-decoder DoS ( #10279 ) ( d0f2a83 ) deps: repair Biome and...