Data and AI releases

548 this month · 176 companies

Promptfoo 0.122.2

UpdateNot yet verified

0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )

SecurityDeveloper toolsCoding agents

Read on github.com

Also shipped Aug 28, 2026Promptfoo in August 2026 →

Monitor and cap external provider costs

Unity Gateway can now track and cap spend on external model providers, such as Amazon Bedrock and Azure AI Foundry, not just Databricks-provided models. If your organization already has capacity commitments directly with a provider, Unity Gateway becomes the single point to track that usage and enforce spend limits across teams and use cases.

Beta
Source ↗

Unity Catalog Skills (Beta)

You can now publish, govern, and share agent skills with Unity Catalog. A skill is a first-class Unity Catalog securable ( catalog.schema.skill ) that follows the SKILL.md specification , so you register it once and control who can discover, use, and update it with the same permissions, tags, and audit that protect your tables.

Beta
Source ↗

More from PromptfooEvery Promptfoo release →

Promptfoo 0.122.1

0.122.1 (2026-08-26) Features eval: distinguish scan footprint from incurred token usage ( #10497 ) ( 8df8ef0 ) providers: add Gemini 3.7 Flash and Flash-Lite ( #10389 ) ( bc6b189 ) redteam: account for multi-turn attacker and grading tokens ( #10407 ) ( 33cc8bc ) redteam: report generation, target, attacker, and grading tokens ( #10408 ) ( 0891e4e )...

Update
Source ↗

Promptfoo 0.123.0

0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...

Update
Source ↗

Promptfoo 0.123.1

0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...

Update
Source ↗

Promptfoo 0.122.0

0.122.0 (2026-08-04) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes deps: keep the Shai-Hulud compromised versions unreachable ( #10301 ) ( db2a066 ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: pin socket.io-parser above the packet-decoder DoS ( #10279 ) ( d0f2a83 ) deps: repair Biome and...

Update
Source ↗

Promptfoo 0.121.20

0.121.20 (2026-07-30) Features providers: add Claude Opus 5 support ( #10210 ) ( ff84f13 ) providers: add current Azure, Claude, and Gemini models ( #10128 ) ( 5c216a1 ) providers: add Kimi K3 support to Moonshot provider ( #10132 ) ( a1168b6 ) websocket: support URL templating ( #10171 ) ( a9aaced ) Bug Fixes assertions: default conversation-relevance...

Update
Source ↗

Promptfoo 0.124.0

0.124.0 (2026-10-06) ⚠ BREAKING CHANGES providers: remove hosted ChatKit provider providers: make WatsonX SDKs opt-in deps: make Langfuse SDK opt-in deps: make Slack SDK opt-in providers: make OpenAI Agents an explicit install providers: make Codex Security SDK opt-in providers: make browser SDKs explicit installs deps: make local Transformers opt-in...

Update
Source ↗

Promptfoo 0.124.1

0.124.1 (2026-10-08) Features assertions: record cost without a threshold (037f1f6) providers: add OpenAI Decisions support (2dbf3ec) providers: expose catalog text-token pricing (3ecce2e) Bug Fixes assertions: preserve async expression grading (1df3eb8) assertions: preserve keyword-property grading (a2da804) assertions: preserve regex operands after yield...

Update
Source ↗

Promptfoo 0.121.19

0.121.19 (2026-07-14) Features providers: add Bedrock GPT-5.6 frontier support ( #10081 ) ( a97c8eb ) providers: add Meta Model API (Muse Spark) provider ( #10041 ) ( e6f06da ) providers: add Open Interpreter provider ( #10079 ) ( c4d9028 ) providers: add xAI Grok 4.5 support ( #10032 ) ( 83cedf0 ) providers: honor CLAUDE_CONFIG_DIR for Claude Code creds (...

Update
Source ↗