Configure Deployment Resources
On this page
Expert Mode gives you fine-grained control over the CPU and memory resources allocated to the JobManager and TaskManagers of a deployment, and — in Multiple SSG (Slot Sharing Group) mode — over the resources allocated to individual operators. Use Expert Mode when the default Basic resource configuration does not give you the control you need over how a job's resources are distributed.
When to Use Expert Mode
Use Expert Mode when you need to:
- Set JobManager and TaskManager CPU and memory independently of the Basic resource presets.
- Tune the number of task slots per TaskManager.
- Allocate resources to individual operators (in Multiple SSG mode) so that heavy operators get dedicated resources and do not contend with lighter ones.
Configure Expert Mode Resources
- In the Console navigation pane, click Deployments.
- Click the name of the target deployment.
- On the deployment details page, click the Configuration tab, then click Edit.
- In the Resources section, set Resource Mode to Expert.
- Configure the following parameters.
- Click Save to apply the configuration.
Configure Operator Resources (Multiple SSG Mode)
Multiple SSG mode lets you place operators into separate slot sharing groups and assign resources to each group individually. This is useful when a job contains operators with very different resource profiles — for example, a stateful aggregation that needs more memory alongside a lightweight source.
To configure operator resources, enable Multiple SSG mode in the Expert resource configuration, then assign each operator to a slot sharing group and set that group's resources.
Parameters
Why Use Per-Operator State TTL
Setting state TTL per operator lets you expire state for individual operators independently rather than applying a single global TTL to the whole job. This keeps state size under control for operators whose state grows quickly, without prematurely expiring state for operators that need to retain it longer.
Limitations
- Expert Mode and Multiple SSG configuration apply to the deployment they are set on; they are not inherited by other deployments.
- Per-operator resource assignment requires Multiple SSG mode to be enabled.
- Changing resource configuration requires restarting the deployment for the new values to take effect.