Releasesby IbisPromptfoo 0.124.0
Update4 days agoUnverifiedAdded Oct 10, 2026
0.124.0 (2026-10-06) ⚠ BREAKING CHANGES providers: remove hosted ChatKit provider providers: make WatsonX SDKs opt-in deps: make Langfuse SDK opt-in deps: make Slack SDK opt-in providers: make OpenAI Agents an explicit install providers: make Codex Security SDK opt-in providers: make browser SDKs explicit installs deps: make local Transformers opt-in...
Topics: AI agents, LLMs, Vector search, Security, Developer tools
More Promptfoo releases
Every Promptfoo releasePromptfoo code-scan-action: 0.2.1
0.2.1 (2026-10-06) Bug Fixes deps: update type definitions (8174e60)
Promptfoo 0.124.1
0.124.1 (2026-10-08) Features assertions: record cost without a threshold (037f1f6) providers: add OpenAI Decisions support (2dbf3ec) providers: expose catalog text-token pricing (3ecce2e) Bug Fixes assertions: preserve async expression grading (1df3eb8) assertions: preserve keyword-property grading (a2da804) assertions: preserve regex operands after yield...
Promptfoo code-scan-action: 0.2.2
0.2.2 (2026-10-08) Bug Fixes code-scan: mint OIDC after CLI installation (9a404c8)
Promptfoo 0.123.1
0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...
Promptfoo 0.123.0
0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...
Promptfoo 0.122.2
0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )
Promptfoo code-scan-action: 0.2.0
0.2.0 (2026-08-28) ⚠ BREAKING CHANGES drop Node.js 20 support ( #10260 ) Bug Fixes code-scan: harden action supply chain ( #9991 ) ( 17e90eb ) deps: patch undici in code-scan-action and guard both lockfiles ( #10278 ) ( 15bf41f ) deps: update type definitions ( #9832 ) ( f545c51 ) Miscellaneous Chores drop Node.js 20 support ( #10260 ) ( 26b725b )
Promptfoo 0.122.1
0.122.1 (2026-08-26) Features eval: distinguish scan footprint from incurred token usage ( #10497 ) ( 8df8ef0 ) providers: add Gemini 3.7 Flash and Flash-Lite ( #10389 ) ( bc6b189 ) redteam: account for multi-turn attacker and grading tokens ( #10407 ) ( 33cc8bc ) redteam: report generation, target, attacker, and grading tokens ( #10408 ) ( 0891e4e )...
Also shipped on Oct 6, 2026
Promptfoo in October 2026WAF Release - 2026-10-06
This release introduces a new detection to mitigate a heap-based buffer overflow vulnerability in F5 BIG-IP, and enhances existing command injection protections by incorporating tested beta logic into the baseline rule. Key Findings CVE-2026-94127: A heap-based buffer overflow vulnerability in F5 BIG-IP.
Metric view window measures are generally available
Window measures in metric views are now generally available. Window measures define rolling window, cumulative, or semiadditive aggregations, such as moving averages, period-over-period changes, and running totals. See Window measures .
Conversational analytics in BigQuery now supports the AI.CAUSAL_EFFECT function to quantify the impact of...
Conversational analytics in BigQuery now supports the AI.CAUSAL_EFFECT function to quantify the impact of specific interventions on time series data. This feature is in Preview .
Gemini Enterprise: Control access to Antigravity features
Administrators can control whether users in their organization have access to the following Google Antigravity features: Boost : Uses a tiered multi-agent hierarchy to solve complex algorithmic challenges and deep debugging tasks with the /boost command. This feature is generally available (GA) in Antigravity.
Gemini Nano Banana 2.1
Gemini Nano Banana 2.1 ( gemini-nano-banana-2.1 ) is available in General Availability (GA) . Gemini Nano Banana 2.1 is optimized for high-speed multimodal image generation and editing, offering improved visual quality, prompt adherence, and text rendering across 1K , 2K , and 4K output resolutions.
Genie Code CLI is in Beta
Genie Code CLI is a coding agent that runs in your terminal, tuned for data and AI work on Databricks. It works with your local files and uses the Databricks CLI to discover data, answer questions, and build and deploy assets such as pipelines, models, and apps. Model access is provided and governed through Unity Gateway. See Genie Code CLI .