Data and AI releases

548 this month · 176 companies

Promptfoo 0.123.1

UpdateNot yet verified

0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...

AI agentsLLMsMCPVector searchDeveloper tools

Read on github.com

Also shipped Sep 18, 2026Promptfoo in September 2026 →

Lakebase Search is generally available

Lakebase Search is now generally available. It brings scalable vector and keyword search to Lakebase projects through two Postgres extensions, so you can run semantic and exact-term search in a single database without a separate search stack: lakebase_vector adds the lakebase_ann index type for approximate nearest-neighbor vector search.

GA
Source ↗

More from PromptfooEvery Promptfoo release →

Promptfoo 0.123.0

0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...

Update
Source ↗

Promptfoo 0.124.0

0.124.0 (2026-10-06) ⚠ BREAKING CHANGES providers: remove hosted ChatKit provider providers: make WatsonX SDKs opt-in deps: make Langfuse SDK opt-in deps: make Slack SDK opt-in providers: make OpenAI Agents an explicit install providers: make Codex Security SDK opt-in providers: make browser SDKs explicit installs deps: make local Transformers opt-in...

Update
Source ↗

Promptfoo 0.124.1

0.124.1 (2026-10-08) Features assertions: record cost without a threshold (037f1f6) providers: add OpenAI Decisions support (2dbf3ec) providers: expose catalog text-token pricing (3ecce2e) Bug Fixes assertions: preserve async expression grading (1df3eb8) assertions: preserve keyword-property grading (a2da804) assertions: preserve regex operands after yield...

Update
Source ↗

Promptfoo 0.122.2

0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )

Update
Source ↗

Promptfoo 0.122.1

0.122.1 (2026-08-26) Features eval: distinguish scan footprint from incurred token usage ( #10497 ) ( 8df8ef0 ) providers: add Gemini 3.7 Flash and Flash-Lite ( #10389 ) ( bc6b189 ) redteam: account for multi-turn attacker and grading tokens ( #10407 ) ( 33cc8bc ) redteam: report generation, target, attacker, and grading tokens ( #10408 ) ( 0891e4e )...

Update
Source ↗

Promptfoo 0.125.0

This release adds support for rouge-l and rouge-s assertions, trace span filtering, and Gemini media models. It also introduces a safe mode to disable inline JavaScript execution during evaluations.

Update
Source ↗

Promptfoo 0.122.0

0.122.0 (2026-08-04) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes deps: keep the Shai-Hulud compromised versions unreachable ( #10301 ) ( db2a066 ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: pin socket.io-parser above the packet-decoder DoS ( #10279 ) ( d0f2a83 ) deps: repair Biome and...

Update
Source ↗