Version: 2.13

Scaling Session Clusters

The scale of SessionClusters is configured via the numberOfTaskManagers attribute and the number of task slots Flink configuration. All Flink jobs running on a SessionCluster will share the available task slots for execution.

note

The Resources (CPU, Memory) page covers how to configure the allocated compute resources.

Overview

The scale of your SessionClusters is configured via the numberOfTaskManagers attribute and the number of task slots Flink configuration.

kind: SessionCluster
spec:
  numberOfTaskManagers: n
  flinkConfiguration:
    taskmanager.numberOfTaskSlots: s

By default, each created TaskManager instance will be configured with a single slot. It is highly recommended to adjust this configuration for your use case. Typically, the number of slots per TaskManager should be adjusted hand in hand with the allocated compute resources per TaskManager.

It is possible to add more TaskManagers while a SessionCluster is running, but reducing the number of TaskManagers or adjusting the number of slots per TaskManager requires a full redeploy of the Flink cluster.

Overview​

Overview