Releasesby GlyphPromptfoo 0.125.0
This release adds support for rouge-l and rouge-s assertions, trace span filtering, and Gemini media models. It also introduces a safe mode to disable inline JavaScript execution during evaluations.
Also shipped Oct 23, 2026Promptfoo in October 2026 →
Retrieve Cortex Search (Public Preview)
The CORTEX_SEARCH_RETRIEVE table function is now in public preview, allowing users to execute low-latency search queries directly from SQL for RAG and chatbot applications.
DataFrame caching on serverless compute is now in Public Preview
Databricks now supports DataFrame caching on serverless compute via df.cache() or df.persist(), allowing users to reuse results within a session.
Box Audit Logs managed ingestion connector (Beta)
The Box Audit Logs connector for Lakeflow Connect is now available in beta, enabling the ingestion of enterprise audit events into Databricks.
Manage Test Engine workflows with Terraform and the REST API
Users can now manage Test Engine workflows using the buildkite_test_suite_workflow Terraform resource or the REST API, enabling code-based configuration of monitors and actions.
Flagship - Target Flagship feature flags with structured evaluation context
Flagship now supports nested objects and arrays in evaluation context, allowing developers to target feature flags based on complex user profiles and tags.
Responses API for the Cortex REST API (Preview)
The new Responses API in the Cortex REST API provides OpenAI-compatible endpoints for accessing models.
More from PromptfooEvery Promptfoo release →
Promptfoo 0.125.1
Promptfoo 0.125.1 includes a bug fix to restore the Discord invite link.
Promptfoo 0.124.1
0.124.1 (2026-10-08) Features assertions: record cost without a threshold (037f1f6) providers: add OpenAI Decisions support (2dbf3ec) providers: expose catalog text-token pricing (3ecce2e) Bug Fixes assertions: preserve async expression grading (1df3eb8) assertions: preserve keyword-property grading (a2da804) assertions: preserve regex operands after yield...
Promptfoo code-scan-action: 0.2.2
0.2.2 (2026-10-08) Bug Fixes code-scan: mint OIDC after CLI installation (9a404c8)
Promptfoo 0.124.0
0.124.0 (2026-10-06) ⚠ BREAKING CHANGES providers: remove hosted ChatKit provider providers: make WatsonX SDKs opt-in deps: make Langfuse SDK opt-in deps: make Slack SDK opt-in providers: make OpenAI Agents an explicit install providers: make Codex Security SDK opt-in providers: make browser SDKs explicit installs deps: make local Transformers opt-in...
Promptfoo code-scan-action: 0.2.1
0.2.1 (2026-10-06) Bug Fixes deps: update type definitions (8174e60)
Promptfoo 0.123.1
0.123.1 (2026-09-18) Features bedrock: refresh auth across HTTP adapters ( #10123 ) ( 9d3f063 ) providers: add Gemini 3.8 and Vertex Live ( #10956 ) ( 1417f22 ) providers: add GPT-Live voice sessions ( #10891 ) ( 316a334 ) providers: add OpenAI Agents API ( #10892 ) ( ad3bee3 ) providers: add portable HTTP config schemas ( #10968 ) ( fcd0604 ) providers...
Promptfoo 0.123.0
0.123.0 (2026-09-10) ⚠ BREAKING CHANGES providers: default GPT-5.6+ to Responses ( #10803 ) Features assertions: grade native audio with llm-rubric ( #10814 ) ( 39c4fb5 ) providers: add Claude Fable and Mythos 5.1 ( #10601 ) ( ac6ba5b ) providers: add GPT-6 Astra support ( #10625 ) ( cd4c68b ) providers: add grok-4.6, grok-imagine-image-2.0, and...
Promptfoo 0.122.2
0.122.2 (2026-08-28) Features auth: support configurable Cloud auth header name ( #10375 ) ( 997cb56 ) providers: add Codex Security SDK provider ( #10467 ) ( df8a5ab )