Promptfoo 0.125.0
This release adds support for rouge-l and rouge-s assertions, trace span filtering, and Gemini media models. It also introduces a safe mode to disable inline JavaScript execution during evaluations.
13 releases · 0 this month
This release adds support for rouge-l and rouge-s assertions, trace span filtering, and Gemini media models. It also introduces a safe mode to disable inline JavaScript execution during evaluations.
0.124.0 (2026-10-06) ⚠ BREAKING CHANGES providers: remove hosted ChatKit provider providers: make WatsonX SDKs opt-in deps: make Langfuse SDK opt-in deps: make Slack SDK opt-in providers: make OpenAI Agents an explicit install providers: make Codex Security SDK opt-in providers: make browser SDKs explicit installs deps: make local Transformers opt-in...
0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...
0.122.0 (2026-08-04) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes deps: keep the Shai-Hulud compromised versions unreachable ( #10301 ) ( db2a066 ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: pin socket.io-parser above the packet-decoder DoS ( #10279 ) ( d0f2a83 ) deps: repair Biome and...
Evals and red teaming for LLM apps.
| Release-notes page | Site | Feed |
|---|---|---|
| Release Notes promptfoo.dev | promptfoo.dev | None |
| Release Notes promptfoo.dev | promptfoo.dev | None |