View data lineage from the metadata perspective
note
You can only view data lineage for SQL deployments.
Navigate to the Deployments page within the Ververica Cloud console. Here, you can identify the deployment of interest and access details on deployment nodes, data nodes, dependencies between the deployment's tables, and affiliations between its tables and fields.
note
Should a catalog's table be linked with numerous deployments, the data lineage graph might appear congested. To enhance clarity:
- Zoom in or out on the graph.
- Activate the "Auto focus clicked node" feature. Once enabled, clicking on a desired deployment or table will automatically center the associated node.
- On the Dashboard page, open the console for the workspace you want to manage.
- In the Console navigation pane, click Deployments.
- Click the name of the desired deployment.
- On the Lineage tab, click Table Level to view table-level data lineage or Column Level to view field-level data lineage.
Table-level data lineage
Within the Table Level tab:
- You can see which deployments reference a specific table in the catalog.
- If there's a change in table schema or data, it allows for prompt actions on the deployments referencing this table, such as modifying the deployment code or canceling them.
To delve deeper into a deployment:
- Double-click on the desired deployment node. This displays the deployment's ID, creation details, and modification history.
- To navigate directly to the Deployments page for that specific deployment, click on the deployment name highlighted in red in the following picture.
Field-level data lineage
Within the field-level data lineage graph:
- Click on your desired field to pinpoint deployments and tables that reference it.
- Fields connected with blue solid lines signify associations.
- If a field is removed, or if there's a change in its name or attributes, this facilitates swift identification of the referencing deployments and tables. It also lets you detect and manage the associated fields accordingly.
You have the capability to:
- See table field names and their respective types.
- Observe names of databases, catalogs, and connector types for tables at the same level.
- Access information related to the deployment.