Skip to main content

VERA changelog

This page describes the updates in the latest release of the VERA engine.

Engine updates​

Release Date: 2024-08-28

Engine version: vera-1.0.6-flink-1.17

VERA engine vera-1.0.6-flink-1.17 is an enterprise version of Apache Flink that is based on Flink version 1.17.2.

Real-time lakehouse​

Now, when you execute the CREATE TABLE AS or CREATE DATABASE AS statement to write data to Apache Paimon, an Apache Paimon table that uses the dynamic bucket mode can be created.

Connectors​

The MongoDB CDC connector supports the CREATE TABLE AS and CREATE DATABASE AS statements. This capability enhances data synchronization from all tables in a MongoDB database.

Kafka connector storage usage is now optimized by no longer considering empty values as a null value to a JSON string. Additionally, Kafka data can be filtered based on headers during data writing to facilitate data distribution.

Data can be read from an OceanBase source table by using the OceanBase CDC connector. You can now build OceanBase real-time data warehouses.

Lastly, support is now provided for Kafka catalog, Iceberg, and StarRocks connector.

SQL enhancements​

The new aggregate operator WindowAggregate of the CUMULATE function supports update streams. In this VERA version, the TUMBLE, HOP, CUMULATE, and SESSION window functions support update streams. In Apache Flink 1.18 and earlier versions, window functions do not support window aggregation for update streams.

Bug fixes​

The following issues are resolved:

  • The configuration of the shardWrite parameter for ClickHouse result tables does not take effect.
  • Savepoints of deployments cannot be generated in extreme cases
  • Bug fixes related to Paimon catalog and connector
  • Job metrics are visible again
  • The issue that the configuration of the shardWrite parameter for ClickHouse result tables does not take effect is fixed.