Ververica Platform 2.13.1
Release Date: 2024-06-17
Changelog
Apache Flink®
Ververica Platform 2.13.1 supports the following versions:
- Apache Flink® 1.19
- Apache Flink® 1.18
- Apache Flink® 1.17
Ververica Platform 2.13.1 supports Apache Flink® 1.19, Apache Flink® 1.18, and Apache Flink® 1.17 under SLA.
For Stream Edition the following Apache Flink® Docker images are available. Please check Ververica Platform Docker Images for all available Apache Flink® images and additional tags.
- 1.17.2-stream3-scala_2.12-java8
- 1.17.2-stream3-scala_2.12-java11
- 1.18.1-stream3-scala_2.12-java8
- 1.18.1-stream3-scala_2.12-java11
- 1.18.1-stream3-scala_2.12-java17
- 1.19.0-stream1-scala_2.12-java8
- 1.19.0-stream1-scala_2.12-java11
- 1.19.0-stream1-scala_2.12-java17
For Spring Edition the following archives are available:
Additionally, the Apache Flink 1.17.2 has been patched to include the FLINK-34496 bug fix from Flink 1.19.0.
New features
JSON Schema for YAML configuration validation
We are excited to introduce a JSON Schema for pre-validating YAML files in Custom Resource deployments and Kubernetes Operator configurations. This enhancement ensures YAML configurations are reliable and correct by enforcing proper structure, required fields, data types, and value constraints. Our updated documentation includes the schema, enabling seamless integration into CI/CD pipelines for automatic validation, streamlining deployment and enhancing system integrity.
Improvements
Enhance error logging for Custom Resource deployment parameter issues
We have improved error logging for Custom Resource (CR) deployments to address user challenges with the generic "Deployment parameters are invalid" message. Our system now provides detailed descriptions of incorrect parameters and highlights specific discrepancies between the provided and expected values. This update ensures easier identification and correction of errors.
Audit Logs improvement
We are pleased to announce an enhancement to our audit logging functionality. Ververica Platform audit logs are now more descriptive, detailing activity changes, especially state changes like "Deployment Paused" and "Deployment Resumed". These improvements provide better insights into system actions, ensuring comprehensive tracking and easier troubleshooting.
Bug fixes
EndpointSuffix in Azure blob storage credential configuration not respected
Resolved an issue where the specified EndpointSuffix
value configured for Azure blob storage credentials was not respected, throwing an error.
Fix messaging when fetching connectors from JAR/URL
Previously, when creating a connector from a JAR file or URL, Ververica Platform messaging was unclear, for example, when there were no connectors in the provided source, it was treated as having multiple connectors. The platform messaging has been improved to account for such instances.
Fail deployment earlier when restoring from a snapshot that does not exist
A new deployment template configuration spec.template.spec.flinkFatalExceptionFailEarly
is added to allow the Flink job to fail early when the Flink job manager pod is in crash loop status with the exit code of 1, 2, or 239.
Deployment stays in TRANSITIONING when there is an exception
We have addressed an issue where deployments remained indefinitely in the TRANSITIONING state after encountering exceptions in the program's main method before the execution of the Flink job graph.
Previously, settings like spec.maxJobCreationAttempts
and spec.jobFailureExpirationTime
were ineffective in transitioning the deployment to a FAILED state or any other terminal state under such circumstances.
Fixed issue when configuring logging profiles
Resolved an issue where the text box for configuring custom templates for user profiles was acting as "read-only". It is now back to working as expected, as the user changes appear in the resulting deployment YAML.
Deprecation
Disable non-production mode in deployments
To enhance our licensing model and ensure fair usage, we have discontinued non-production mode in version 2.13.1. Previously, non-production mode allowed test deployments without impacting the licensed CPU core quota. Going forward, we are offering separate non-production licenses for customers who need extensive testing capabilities, ensuring uninterrupted testing workflows. For more details on obtaining a non-production license or any questions regarding this change, please contact our support team.
Vulnerability Fixes (outside of Apache Flink®)
- Upgraded to Angular 17.3.1, which resolves CVE-2023-42366, CVE-2023-42365, CVE-2024-34459, CVE-2024-4603
- Updated apache compress version to 1.26.0 to resolve CVE-2024-26308 & CVE-2023-42503
- Updated apache santuario xmlsec to 2.3.4 by updating openSaml version to 4.3.1 to resolve CVE-2023-44483
- Dropped nginx version from 404 pages
- Addressed helm chart vulnerability CKV_K8S_43. The example below showcases how to use digest in VVP configuration
values.yaml
under thevvp
key:
vvp:
resultFetcher:
tag: sha256:8d381486e25a3044cd8bb8736d53646e9cf68d593d8a23cb7d36342448abcb87
appmanager:
image:
digest: sha256:6866594ec3cfd9beda04902eaf768c2e5aa52c6c3b7583b9ec706361f84de13a
artifactFetcherTag: sha256:10a02abd451f7a377f0c75417e7e3bb1400fe0c48b65180246b81b7033c8d0d6
gateway:
image:
digest: sha256:09a06afe47c728c515a112e98f6b1765ac26c901ca213990132ac1edde7b47e1
ui:
image:
digest: sha256:5ed5dc93de5204ba7ded056a7af4db1f070958a0f309ca6f757e423012e12c24
Upgrade
As always, we recommend upgrading via Helm using the following commands:
$ helm repo add ververica https://charts.ververica.com
$ helm repo update
$ helm upgrade [RELEASE] ververica/ververica-platform --version 5.9.1 --values custom-values.yaml