Redpanda Connect
Redpanda Connect 4.116.0 adds incremental snapshot mode for MongoDB CDC and cache mode for SFTP, alongside several bug fixes.
Redpanda Connect 4.116.0 adds incremental snapshot mode for MongoDB CDC and cache mode for SFTP, alongside several bug fixes.
Redpanda Connect 4.115.1 fixes data race issues in the Kafka writer and updates OracleDB CDC timestamp types.
Redpanda Connect adds a Snowflake streaming pipe output connector and improves PostgreSQL CDC streaming with configurable batching.
For installation instructions check out the getting started guide. Added kafka: Added optional tombstone field to franz-based Kafka outputs (redpanda, kafka_franz) to support producing compacted topic deletes and null values.
For installation instructions check out the getting started guide. Added - oracledb_cdc: Oracle CDC input now exposes rs_id and ssn metadata to uniquely identify row changes in transactions. (@Leward, #4826) - oracledb_cdc: Oracle CDC input now emits row_seq metadata to distinguish rows in bulk DELETE operations where rs_id and ssn are identical.
For installation instructions check out the getting started guide. Added sftp: SFTP credentials now support an advanced opt-in block to enable additional SSH key exchange algorithms, ciphers, and MACs beyond the x/crypto/ssh defaults.
For installation instructions check out the getting started guide. Added postgres_cdc: Added incremental snapshot support to Postgres CDC, enabling tables to be backfilled in chunks while replication continues running, eliminating the need for snapshot-induced stream blocking or restart from the beginning.