Data and AI releases

548 this month · 176 companies

Promptfoo 0.121.19

UpdateNot yet verified

0.121.19 (2026-07-14) Features providers: add Bedrock GPT-5.6 frontier support ( #10081 ) ( a97c8eb ) providers: add Meta Model API (Muse Spark) provider ( #10041 ) ( e6f06da ) providers: add Open Interpreter provider ( #10079 ) ( c4d9028 ) providers: add xAI Grok 4.5 support ( #10032 ) ( 83cedf0 ) providers: honor CLAUDE_CONFIG_DIR for Claude Code creds (...

LLMsObservabilityDeveloper toolsCoding agents

Read on github.com

Also shipped Jul 14, 2026Promptfoo in July 2026 →

CREATE OR ALTER is generally available for 24 object types

CREATE OR ALTER is now generally available for 24 object types. CREATE OR ALTER creates an object if it doesn’t exist, or modifies an existing object to match the statement definition. It’s especially useful in declarative deployment workflows and CI/CD pipelines where the same script must be safe to re-run.

GA
Source ↗

Catalog integration for Snowflake Postgres (General availability)

Catalog integrations for Snowflake Postgres are now generally available. A Snowflake Postgres catalog integration lets Snowflake automatically discover tables managed by a Snowflake Postgres instance and access them as read-only Apache Iceberg™ tables, using vended credentials so you don’t need to configure an external volume or manage storage credentials...

GA
Source ↗

More from PromptfooEvery Promptfoo release →

Promptfoo 0.121.18

0.121.18 (2026-07-07) Features add Node.js 20 support cutoff campaign ( #9862 ) ( d4d35da ) add per-test repeat option ( #9781 ) ( 3e1f02b ) app: surface websocket subprotocols ( #9947 ) ( 88c7445 ) config: add YAML source location to prompt reference errors ( #9940 ) ( 5f13e76 ) providers: add Bedrock support for Grok 4.3, GLM, MiniMax, Kimi, Nemotron...

Update
Source ↗

Promptfoo 0.121.20

0.121.20 (2026-07-30) Features providers: add Claude Opus 5 support ( #10210 ) ( ff84f13 ) providers: add current Azure, Claude, and Gemini models ( #10128 ) ( 5c216a1 ) providers: add Kimi K3 support to Moonshot provider ( #10132 ) ( a1168b6 ) websocket: support URL templating ( #10171 ) ( a9aaced ) Bug Fixes assertions: default conversation-relevance...

Update
Source ↗

Promptfoo 0.122.0

0.122.0 (2026-08-04) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes deps: keep the Shai-Hulud compromised versions unreachable ( #10301 ) ( db2a066 ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: pin socket.io-parser above the packet-decoder DoS ( #10279 ) ( d0f2a83 ) deps: repair Biome and...

Update
Source ↗

Promptfoo 0.121.17

0.121.17 (2026-06-16) Bug Fixes docker: bump pinned Python to 3.14 to match the Alpine base image ( #9769 ) ( 24fc5be ) docker: unpin Python minor by default so Alpine drift can't break the build ( #9771 ) ( c69ef40 ) matchers: drop stranded list markers in RAGAS context-relevance segmentation ( #9767 ) ( b06eb88 ) sanitizer: stop over-redacting benign url...

Update
Source ↗

Promptfoo 0.122.1

0.122.1 (2026-08-26) Features eval: distinguish scan footprint from incurred token usage ( #10497 ) ( 8df8ef0 ) providers: add Gemini 3.7 Flash and Flash-Lite ( #10389 ) ( bc6b189 ) redteam: account for multi-turn attacker and grading tokens ( #10407 ) ( 33cc8bc ) redteam: report generation, target, attacker, and grading tokens ( #10408 ) ( 0891e4e )...

Update
Source ↗

Promptfoo 0.122.2

0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )

Update
Source ↗

Promptfoo 0.123.0

0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...

Update
Source ↗

Promptfoo 0.123.1

0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...

Update
Source ↗