RisingWave Labs/risingwave: Release v2.1.0

Name: risingwave

Owner: RisingWave Labs

Release: v2.1.0

Released: 2024-12-06

License: Apache-2.0

Release Assets:

• risectl-v2.1.0-aarch64-unknown-linux.tar.gz

• risectl-v2.1.0-x86_64-unknown-linux.tar.gz

• risingwave-v2.1.0-aarch64-unknown-linux-all-in-one.tar.gz

• risingwave-v2.1.0-aarch64-unknown-linux.dwp.tar.gz

• risingwave-v2.1.0-aarch64-unknown-linux.tar.gz

• risingwave-v2.1.0-x86_64-unknown-linux-all-in-one.tar.gz

• risingwave-v2.1.0-x86_64-unknown-linux.dwp.tar.gz

• risingwave-v2.1.0-x86_64-unknown-linux.tar.gz

Please use v2.1.2 instead

https://github.com/risingwavelabs/risingwave/pull/20107 fixed a bug that may lead to data loss.

For installation and running instructions, see Get started.

Main changes

SQL features

• Query syntax:
  • Technical preview: Supports ASOF JOIN to join and find the closest matching record by the event time or another ordered property. https://github.com/risingwavelabs/risingwave/pull/18683
  • Supports AGGREGATE: prefixed scalar function in streaming aggregation. https://github.com/risingwavelabs/risingwave/pull/18205
  • Supports using user-defined aggregate functions as window function. https://github.com/risingwavelabs/risingwave/pull/18181
  • Supports blocking subscription cursors and configuring cursor timeouts. https://github.com/risingwavelabs/risingwave/pull/18675
• SQL commands:
  • Enhances observability of cursors and subscription cursors by improving output results of SHOW SUBSCRIPTION CURSORS and SHOW CURSORS commands. https://github.com/risingwavelabs/risingwave/pull/18896
• SQL functions & operators:
  • Technical Preview: Supports the TVF postgres_query . https://github.com/risingwavelabs/risingwave/pull/18811
• System catalog:
  • Supports pg_catalog.pg_sequence. https://github.com/risingwavelabs/risingwave/pull/18714
  • Supports information_schema.table_constraints. https://github.com/risingwavelabs/risingwave/pull/18716
  • Supports information_schema.schemata. https://github.com/risingwavelabs/risingwave/pull/18709

Connectors

• Breaking change: Changes scan.startup.mode=latest for NATS source connector to start consuming from next available message instead of last one. https://github.com/risingwavelabs/risingwave/pull/18733
• Public preview: Supports shared Kafka sources, which can be disabled by session variable streaming_use_shared_source. https://github.com/risingwavelabs/risingwave/pull/18749
• Supports recursively scanning file sources. https://github.com/risingwavelabs/risingwave/pull/18324
• Supports schemaless ingestion for data in JSON format from Kafka sources by using INCLUDE payload clause. https://github.com/risingwavelabs/risingwave/pull/18437
• Adds a set of options for NATS source connector based on the async_nats crate. https://github.com/risingwavelabs/risingwave/pull/17615
• Adds a required option, consumer.durable_name, for NATS source connector. https://github.com/risingwavelabs/risingwave/pull/18873
• Supports option max_packet_size for MQTT sources. https://github.com/risingwavelabs/risingwave/pull/18520
• Supports option database.encrypt for SQL Server CDC sources. https://github.com/risingwavelabs/risingwave/pull/18912
• Supports ingesting data from a partitioned table for PostgreSQL CDC sources. https://github.com/risingwavelabs/risingwave/pull/18456
• Supports option auto.schema.change for PostgreSQL CDC sources to enable replicating Postgres table schema change. https://github.com/risingwavelabs/risingwave/pull/18760
• Requires upstream table name to also be prefixed with database name when creating a SQL Server CDC table. https://github.com/risingwavelabs/risingwave/pull/18868
• Adds JSON encode for file sinks, allowing users to sink JSON files into object storage. https://github.com/risingwavelabs/risingwave/pull/18744
• Supports create_table_if_not_exists option for Iceberg sink connector. https://github.com/risingwavelabs/risingwave/pull/18362
• Supports WebHDFS sinks. https://github.com/risingwavelabs/risingwave/pull/18293
• Removes option bulk_write_max_entries for MongoDB sink and option default_max_batch_rows for DynamoDB sink. Adds options max_batch_item_nums and max_future_send_nums for DynamoDB sink. https://github.com/risingwavelabs/risingwave/pull/17645
• Sets sink decoupling as the default policy for MongoDB, DynamoDB, and Redis sink connectors. https://github.com/risingwavelabs/risingwave/pull/17645
• Supports option routing_column for ElasticSearch sinks, allowing a column to be set as a routing key. https://github.com/risingwavelabs/risingwave/pull/18698
• Supports specifying batching strategy when sinking data in Parquet format. https://github.com/risingwavelabs/risingwave/pull/18472

Installation and deployment

• Adds a CLI argument of --license-key-path for the meta node, enabling a background task to watch and reload license key from the specified file. https://github.com/risingwavelabs/risingwave/pull/18768

Cluster configuration changes

• When visibility_mode is set to all, the latest uncommitted data will be queried, but consistency is no longer guaranteed between the tables. https://github.com/risingwavelabs/risingwave/pull/18230
• Supports SET TIME ZONE INTERVAL '+00:00' HOUR TO MINUTE as equivalent to SET TIME ZONE UTC. https://github.com/risingwavelabs/risingwave/pull/18705
• The etcd metastore is fully deprecated and unsupported. Users previously utilizing etcd metastore must manually migrate to a SQL backend (PostgreSQL, MySQL, or SQLite) to upgrade to v2.1.0

Full Changelog: https://github.com/risingwavelabs/risingwave/compare/v2.0.4...v2.1.0