Ververica Platform 2.3.2
Release Date: 2020-12-01
Changelog
Apache Flink®
Ververica Platform 2.3.2 continues to support Apache Flink® 1.10 and 1.11 under SLA.
We have released new Flink 1.10.2 and 1.11.2 builds that enable Ververica Platform's support for bundled artifacts (see below).
Apache Flink® 1.10.2
-
For Stream Edition the following Apache Flink® Docker images are available. Please check Ververica Platform Docker Images for all available Apache Flink® images and additional tags.
1.10.2-stream3-scala_2.11
1.10.2-stream3-scala_2.12
-
For Spring Edition the following / archives are available
Apache Flink® 1.11.2
-
For Stream Edition the following Apache Flink® Docker images are available. Please check Ververica Platform Docker Images for all available Apache Flink® images and additional tags.
1.11.2-stream3-scala_2.11
1.11.2-stream3-scala_2.12
-
For Spring Edition the following / archives are available
Bug Fixes
Deployment
-
The memory configuration for Flink containers is translated to base 2 before being passed to Flink. Flink interprets the
m
unit as base 2 whereas Ververica Platform and Kubernetes interpretm
as base 10. This mismatch could result in containers being OOM killed, because Flink was allowed to allocate more memory than available to the container. -
For low memory configurations with less than
1000m
(base 2) of total process memory for TaskManagers, we reduce the managed memory fractiontaskmanager.memory.managed.fraction
to 0.2 (default: 0.4). This is required in order to account for the harmonized unit computation with our default configuration of1G
(base 10) for TaskManager memory. If the resulting total process memory is greater or equal to1000m
or the managed memory fraction has been configured manually, we do not set it. -
We now set the Kubernetes resources for the ResultFetcher service. The ResultFetcher is deployed as a sidecar container for SessionClusters and it is responsible to fetch the results of your SQL preview queries. Before this change, no Kubernetes resources were set which could lead to rejected SessionClusters due to Kubernetes resource quotas.
vvp:
resultFetcher:
resources:
limits:
cpu: 500m
memory: 500Mi
requests:
cpu: 100m
memory: 300Mi
Improvements
Deployment
-
Artifacts bundled as part of custom Flink Docker images can now be referenced in the artifact section of Deployments via the
file://
scheme. During startup, referenced dependencies will be linked to Flink’s usrlib directory (/flink/usrlib). It is possible to mix bundled and external dependencies.This is only supported with the newly released Flink images mentioned above and future versions.
Note that the bundled artifact(s) must be placed under a different location than /flink/usrlib, because this directory is the mount point for dynamically fetched artifacts.
-
Environment variables referenced in the Flink configuration section are now substituted during runtime of the Flink container.
-
We have added the following two labels to all Kubernetes resources created for Deployments and SessionClusters:
vvpNamespace
anddeploymentName
.
Frontend
- The SessionCluster form now has feature parity with Deployment forms, including the YAML editor and additional Flink configuration validation.
Upgrade
We recommend upgrading via Helm using the following commands:
helm repo add ververica https://charts.ververica.com
helm upgrade [RELEASE] ververica/ververica-platform --version 4.3.2 --values custom-values.yaml