Data and AI releases

548 this month · 176 companies

Promptfoo 0.122.1

UpdateNot yet verified

0.122.1 (2026-08-26) Features eval: distinguish scan footprint from incurred token usage ( #10497 ) ( 8df8ef0 ) providers: add Gemini 3.7 Flash and Flash-Lite ( #10389 ) ( bc6b189 ) redteam: account for multi-turn attacker and grading tokens ( #10407 ) ( 33cc8bc ) redteam: report generation, target, attacker, and grading tokens ( #10408 ) ( 0891e4e )...

AI agentsLLMsSQLObservabilityDeveloper tools

Read on github.com

Also shipped Aug 26, 2026Promptfoo in August 2026 →

Organization user types (General availability)

With this release, you can specify whether an organization user represents a person or a service. Set the TYPE property to SERVICE for a service or application that interacts with Snowflake without human interaction. If you don't specify a type, the organization user is a PERSON user, which matches the previous behavior.

GA
Source ↗

Semantic Studio (Preview)

Semantic Studio is now available in public preview for all accounts. Semantic Studio is the authoring environment for semantic views in Workspaces, combining conversational authoring with CoCo, direct YAML editing, and deployment to the live Snowflake object in a single surface.

Preview
Source ↗

More from PromptfooEvery Promptfoo release →

Promptfoo 0.122.2

0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )

Update
Source ↗

Promptfoo 0.123.0

0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...

Update
Source ↗

Promptfoo 0.122.0

0.122.0 (2026-08-04) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes deps: keep the Shai-Hulud compromised versions unreachable ( #10301 ) ( db2a066 ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: pin socket.io-parser above the packet-decoder DoS ( #10279 ) ( d0f2a83 ) deps: repair Biome and...

Update
Source ↗

Promptfoo 0.123.1

0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...

Update
Source ↗

Promptfoo 0.121.20

0.121.20 (2026-07-30) Features providers: add Claude Opus 5 support ( #10210 ) ( ff84f13 ) providers: add current Azure, Claude, and Gemini models ( #10128 ) ( 5c216a1 ) providers: add Kimi K3 support to Moonshot provider ( #10132 ) ( a1168b6 ) websocket: support URL templating ( #10171 ) ( a9aaced ) Bug Fixes assertions: default conversation-relevance...

Update
Source ↗

Promptfoo 0.124.0

0.124.0 (2026-10-06) ⚠ BREAKING CHANGES providers: remove hosted ChatKit provider providers: make WatsonX SDKs opt-in deps: make Langfuse SDK opt-in deps: make Slack SDK opt-in providers: make OpenAI Agents an explicit install providers: make Codex Security SDK opt-in providers: make browser SDKs explicit installs deps: make local Transformers opt-in...

Update
Source ↗

Promptfoo 0.124.1

0.124.1 (2026-10-08) Features assertions: record cost without a threshold (037f1f6) providers: add OpenAI Decisions support (2dbf3ec) providers: expose catalog text-token pricing (3ecce2e) Bug Fixes assertions: preserve async expression grading (1df3eb8) assertions: preserve keyword-property grading (a2da804) assertions: preserve regex operands after yield...

Update
Source ↗

Promptfoo 0.121.19

0.121.19 (2026-07-14) Features providers: add Bedrock GPT-5.6 frontier support ( #10081 ) ( a97c8eb ) providers: add Meta Model API (Muse Spark) provider ( #10041 ) ( e6f06da ) providers: add Open Interpreter provider ( #10079 ) ( c4d9028 ) providers: add xAI Grok 4.5 support ( #10032 ) ( 83cedf0 ) providers: honor CLAUDE_CONFIG_DIR for Claude Code creds (...

Update
Source ↗