Feldera Release notes and new features

feldera 0.380.0

Feldera 0.380.0 introduces incremental constant operators for SQL and enables serving prebuilt pipeline binaries from the compiler.

feldera 0.379.0

The feldera 0.379.0 release includes improvements to SQL binary substring calculations, support for late row reporting in the ERROR view, and a redesigned web console with an olive theme.

feldera 0.378.0

Feldera 0.378.0 adds support for JSON output with index properties and improves Iceberg deletion vector reading. It also includes various connector and pipeline manager fixes.

feldera 0.377.0

feldera 0.376.0

Feldera released version 0.376.0 with connector table UI refinements, Delta adapter nested field mapping support, Kafka output improvements, and Python SDK fixes.

feldera 0.375.0

- docs: bump joi and follow-redirects in docs lockfile get rid of needless string allocations [sqllib] Fix POSITION and REPLACE with an empty needle [SQL] Escape SQL identifiers in generated Rust string literals [SQL] Backport two Calcite fixes

feldera 0.374.0

This release adds support for STARTSWITH and ENDSWITH string functions, implements NULLIF for mixed-type arguments, and updates date and interval arithmetic to follow the SQL standard. It also includes improvements to the profiler and NATS connector.

feldera 0.373.0

Feldera v0.373.0 updates Kafka connector error handling during broker outages, adds pipeline events to the profiler, and updates SQL dataflow analysis.

feldera 0.372.0

Feldera 0.372.0 includes connector improvements, SQL library fixes, and an upgrade to SvelteKit 3 for the web console.

feldera 0.371.0

Feldera 0.371.0 adds a COALESCE operation to the SQL IR, implements connector stats in the profiler, and adds support for mTLS client certificates.

feldera 0.370.0

Feldera 0.370.0 includes updates to the SQL engine, Postgres CDC connector, and pipeline manager, along with various performance and stability improvements.

feldera 0.369.0

Feldera 0.369.0 includes various fixes for SQL computations, pipeline management, and output connectors.

feldera 0.368.0

This release adds a merge mode for delta output connectors, makes the embedded Postgres port configurable, and compiles Rust UDFs to native shared libraries.

feldera 0.367.0

- [pipeline-manager] expose the user creation time in /config/session [adapters] Reject JSON update format redis for input. Drop the YAML copy of the pipeline configuration [adapters] Read the operation of raw Avro input from cdc_field [web-console] Combine the storage status with the clear storage button [dbsp] Keep an old subcircuit live during a...

feldera 0.366.0

- Bump rustls and docs dependencies to patched versions Bump http-cache-semantics from 4.2.0 to 4.3.0 in /docs.feldera.com in the npm_and_yarn group across 1 directory [SQL] Constant-fold CAST(expr AS DATE) Bump zip to 9.0.1 and quinn-proto/quinn-udp to patched releases [dbsp] Lazy input upsert operator.

feldera 0.365.0

- [pipeline-manager] Add resources.volume_attributes_class [adapters] Add nats_output connector for publishing to NATS JetStream Wire the Unity Catalog deletion-vector test into CI via OIDC federation

feldera 0.364.0

- [SQL] Speed-up SQL compiler [connectors] Pass only the query string and not the full HTTP request to format parsers [adapters] Kafka: Fix a partitions list that is not in ascending order [connectors] Add connector_metadata query parameter to the http input connector [profiler] Glow around a selected or hovered expanded region [DBSP] Fix the implementation...

feldera 0.363.0

- [profiler] Size an expanded region for its name and its counter [profiler] Draw the diagram from the palette-driven stylesheet [adapters] Bound Parquet row groups in the Delta writer [profiler] Aggregate PR: node text, selection mark, minimap, pressable chips, theme and browser tests [pipeline-manager] Return rustc diagnostics as structured messages...

feldera 0.362.0

- [pipeline-manager] Manage deployments from deployment_config [SQL] Reject CREATE INDEX on a view with an emit_final annotation [dbsp] Make a spine's levels merge ten batches at a time [SQL] Build a best-effort parser for Rust regular expressions and use it to warn of unsupported constructs add documentation for data that is sent to Feldera

feldera 0.361.0

- [SQL] Rewrite RIGHT JOINs as LEFT JOINs using Calcite [SQL] Several fixes related to ARRAY_AGG [ci] Run the Iceberg follow tests [adapters] Delta: gate two fork patches, and pin the bad-date issue [adapters] Yield after each JobQueue job.

feldera 0.360.0

- [tests] Delta: assert the DV survivors' values, not just their count [dbsp] Use LZ4 as the default storage compression. [dbsp] Remove mimalloc dependency [adapters] Let the Postgres CDC connector run as a non-superuser [dbsp] Write checkpoints in the background.

feldera 0.359.0

- docs: fix dead Debezium documentation links fix(s2): make pause retry test deterministic [adapters] Delta: store the ordered-snapshot resume point raw Add rust-toolchain.toml [dbsp] Properly spill batches to disk on ShardedAccumulator receive path

feldera 0.358.0

- [SQL] NULL values can never be late; do not insert them in the emit_final Window operator, since they would leak memory [SQL] Fix GC for ArgMinSome (ARG_MIN with nullable argument); comprehensive MIN/MAX/ARG_MIN/ARG_MAX GC tests connector: Bump the delta-rs fork for the nested-container field-id fix [web-console] Add an "Open support bundle" button to the...

feldera 0.357.0

- [adapters] Take over a checkpoint bucket at startup with take_bucket_ownership [SQL] Do not merge two GC operators if their control inputs are not 'equivalent' [SQL] Fix implementation of WATERLINE for LEFT JOIN [SQL] Fix incorrect WATERLINE computation for ASOF JOIN key (currently unreachable) [SQL] Fix HOP/TUMBLE implementation to handle dates before...

feldera 0.356.0

- [profiler] Add the diagram palettes, stylesheet and corner chips [web-console] Fix demos not loading on authenticated instances Support serving Feldera from a URL subpath [connectors] iceberg: pin the fork revision that fixes the scan read stall [SQL] emit_final is bounded [web-console] Make the whole use-case/tutorial card clickable [SQL] Share...

feldera 0.355.0

- dbsp: let an accumulator merge its batches less eagerly Never acknowledge a Postgres CDC write the circuit does not hold in full Kafka output headers dbsp: remove a_backlogged_spine_waits_for_its_mergers

feldera 0.354.0

- [web-console] Remember support bundles the user opened, in IndexedDB [dbsp] Add a detailed breakdown of wait times to the circuit profile [SQL] A field of a nullable ROW is always nullable [dbsp] Compare and hash archived values.

feldera 0.353.0

- [DOCS] Add missing options in documentation storage: skip Instant::now() on cache-hit fast path

feldera 0.352.0

- [connectors] Fix completion frontier jump Web console table header hover arrows [storage] Add LZ4 and Zstd compression for layer files Storage checkpoint fsync [python] Wait for the seed insert before opening a transaction [SQL] Reject programs with connectors attached to LOCAL VIEWs stale health status should be unhealthy [SQL] Waterline computation for...

feldera 0.351.0

- [SQL] Keep track whether streams hold deltas or full collections Fda custom header Fix postgres cdc checkpointing ci: address pipeline-manager by service name in the web-console e2e job [docs][web-console] Bump vulnerable deps [dbsp] Keep an empty batch in memory under a zero step threshold [profiler] The bundle viewer should not need a running pipeline...

feldera 0.350.0

- [adapters] delta: project unused columns out of every CDC read rust: upgrade to 1.96.1 [connectors] Route Delta input object stores per connector [python] Wait out an expired bearer instead of failing the caller [profiler] Single click on a region displays region information [profiler] Make metrics tables collapsible Add disk_total_bytes and...

feldera 0.349.0

- [SQL] Remove support for the WATERMARK keyword Fix vscode inotify watch exhaustion [adapters] delta: keep column case when adding partition columns [adapters] delta: Avoid errors and OOM parsing Parquet files [adapters] pg-input: report query errors to the controller [SQL] Do not build TopK operators that carry duplicate columns

feldera 0.348.0

- [SQL] Emit warnings for programs that perform floating point equality comparisons Delta input connector change data feed (CDF) support. [SQL] Do not materialize indexes if the indexed view is not materialized [adapters] nats: don't abandon an in-flight replay for control commands add tests (some still failing) for postgres CDC connector Fix issue 7031...

feldera 0.347.0

- [dbsp] Fix several bugs in GC logic for top-k and asof operators. [connectors] Backport a fix to a data corruption bug in delta-rs [SQL] Unused field removal for TopK operators Fix profiler calls toLowerCase on a field that is null [SQL] Accept topics without error for kafka input connectors. [SQL] Surface unbounded state analysis results as warnings

feldera 0.346.0

- [profiler] Highlight the current metric for the current node adapters: support GCP Managed Service for Apache Kafka OAUTHBEARER auth [adapters] Implement remaining NATS auth methods and TLS options Validate authentication claims and tenant selectors [python] Fix test_suspend_enterprise max_rss_bytes expectation Reach the CI object store through Workload...

feldera 0.345.0

- docs: upgrade browserslist, fast-uri, postcss-selector-parser, and qs [SQL] Add missing .clone() call in expression simplification pass [SQL] The maximum number of iterations executed before convergence should depend also on the size of the largest nested component [adapters] delta: fix follow and CDC reads of partitioned tables [profiler] Display profile...

feldera 0.344.0

- [python] Improve synchronization for test_model_scoring [connectors] Teach the Delta input and output connectors to read/write Parquet variant columns. [DOC][SQL] Cleanup and document the list of reserved keywords [SQL] An operator that does not produce the same output stream type as the input type cannot be an identity function

feldera 0.343.0

- Fix empty steps during connector transaction [python] Improve error report on failure in jsonbench test. Modular Bloom filter [dbsp] Sample more keys to partition output batches evenly. Fix dead image link in README docs: fix dead PostgreSQL license link

feldera 0.342.0

- [python] close the model-scoring test's race on re-predictions [adapters] Bound the size of Parquet files written by the Delta connector [docs] Add usage and docs for delta output threads [profiler] Remove the unused hierarchical table Add new oauth_provider option to kafka input [dbsp] Estimate join input key counts by sampling [adapters] Check that a...

feldera 0.341.0

- Optimize profile collection to use compression and streaming at all steps [config] Move bloom_false_positive_rate from dev_tweaks to storage [profiler] Display fanout information for the current node [fda] Use PipelineFieldSelector::Status where appropriate [manager] Support for executing Gen-2 pipelines.

feldera 0.340.0

- [connectors] Pausable output connectors [SQL] Do not crash in code generation for CONNECTOR_METADATA when visiting an expression DAG [fda] Replace --auth-token-command with --oidc-token-file [web-console] Fix metrics graphs incorrectly drops excessive data points too early [py] wait for a paused output connector to go quiet Install librdkafka in the...

feldera 0.339.0

- [adapters] bump delta-rs to fix the deletion-vector scan deadlock [ci] Bump oidc-auth-action to v3.0.1 ci: migrate build-fda-native cache to feldera-gcs-cache [SQL] Share window integrals [SQL] Use correct types in outer joins [profiler] Use appropriate aggregation semantics in compound nodes [DOCS] Add Model use case to sidebar [profiler] Fix off-by-one...

feldera 0.338.0

- [adapters] fix delta filter over undeclared columns in follow mode [adapters] size the datafusion sort reservation from the pool

feldera 0.337.0

- [nexmark] Port Nexmark unit test data from Rust to SQL/Java [web-console] Fix transient test failure due to reverse scroll mechanism not aborting [SQL] Support the MODE aggregate function by desugaring into GROUP BY + COUNT + ARG_MAX [adapters] Retry Delta table opens on a transient GCS listing flake.

feldera 0.336.0

- [python] Drop unoptimized profile from platform config tests [docs] Update Delta input docs to with correct config param [SQL] Inline user-defined functions when they call NOW() directly or indirectly docs: consolidate build instructions into README tests: enable h2 frame-level tracing to chase a multihost completion hang [adapters] Fix PG fault injection...

feldera 0.335.0

- ci: remove docs.feldera.com linkcheck fix: repair broken blog links found by nightly linkcheck [adapters] pg-out: keep a test's fault injection inside that test fips: route cryptography through AWS-LC, remove OpenSSL from the dependency tree [web-console] Implement bi-directional search bar for logs tab and profiler metrics Improve heuristics to parse out...

feldera 0.334.0

- Fix concurrent bootstrap output progress Multiple Postgres output connector improvements.

feldera 0.333.0

- python: retry ingress POST past transient pipeline unreachability [web-console] Implement concurrent bootstrapping progress UI, coincide it with transaction UI [sql] Give the streams that leave a recursive circuit ids of their own Add pipeline processing and completion to time series stream, add pipeline latency graph to Performance tab dbsp: Give every...

feldera 0.332.0

- deps: bump roaring to 0.11.4 [SQL] Retry compiling a query with CTEs by converting CTEs to local views python: Raise test pipeline provisioning timeout to 300s [SQL] Optimization to share expensive expressions across sibling map operators Flat variant serialization bench [types] Serialize checkpoint fingerprint as OpenAPI format uint64

feldera 0.331.0

- [SQL] GC for JoinFilterMap operator was applied on the wrong side [SQL] Support for COVAR_ and REGR_* aggregate functions

feldera 0.330.0

- Membership-based tenant authorization, tenant lookup, idempotent tenant creation

feldera 0.329.0

- [DBSP] Remove add_input_set API and related helpers ci: pull the job image through the Artifact Registry mirror [SQL] Optimization to pull expensive operations out of filters Pass ConceptualHQ visitor ID and CTA placement to Calendly [SQL] Optimization removing a DISTINCT from the RHS of a LEFT JOIN deploy: drop the Go toolchain from the runtime image...

feldera 0.328.0

- [adapters] NATS: isolate and verify test server startup Fix checkpointing recursive circuits. [web-console] Bump Vite [adapters] Fix record loss when splitting a nested input buffer [adapters] Have output endpoints report their own checkpoint totals [web-console] Fix flaky log-search highlight race in LogList Re-enable test_jsonbench.py [connectors] Soft...

feldera 0.327.0

- Disable aws-lc-sys jitter entropy to avoid startup SIGABRT python: add LongOperationWarning to reduce poll-loop log spam [connectors] Implement Iceberg input follow mode python: surface commit/ingest progress in wait loop warnings [demos] Serve the batch-analytics TPC-H data from a live bucket [SQL] Support for nested (pure) lambda expressions APPLY(a, a...

feldera 0.326.0

- [adapters] Fix the tick-accounting race in test_clock [manager] Set the memory limits from the local OS/container when they are not specified [connectors] Fix completion counters on output removal connector: postgres sink respect column DEFAULTs for omitted columns [web-console] Fix content in Change Stream tab resets when opening Interaction panel tests...

feldera 0.325.0

- [CI] Do not fail test test_upgrade_from_local_checkpoint if Rust cannot be built; it may be impossible to build with the previous version of the libraries [connectors] retry loops and parallel parsing for Iceberg snapshots [web-console] Keep showing the pipeline metrics while the pipeline is stopping [adapters] Make /stats query parameters public.

feldera 0.324.0

- Concurrent bootstrapping. [SQL] Give a warning for inefficient use of NOW() [SQL] Optimization to pull aggregate filters into temporal filters where possible connectors: dynamodb_output: support conditional writes Add preview for per-worker metrics in the profiler [web-console] Update vulnerable deps Fix graphs on Performance tab disappearing [samply]...

feldera 0.323.0

- [SLT] Skip test that produces integer overflow (fails on Postgres as well) [adapters] Iceberg connector reads only columns declared in the SQL table [DOC] Bring list of unsupported SQL constructs up-to-date Performance optimizations (primarily for multihost) [SQL] Compile SQL window ROWS queries to RANGE (ROW_NUMBER) [web-console] Make side panels for...

feldera 0.322.0

- [adapters] Parse Debezium logical types in the Avro input connector deploy: prefer IPv4 in glibc DNS resolution [connectors] Improve Avro key name validation [dbsp] Don't issue warning for pidlock file.

feldera 0.321.0

- Enable loading profiles without a circuit profile present Various SEO fixes [web-console] Improve empty-state and Enter submit for tags [connectors]: read UC-Uniform/Iceberg column-mapped tables by field-id