Skip to main content

Exceptions in Log Files

An automated exception log analysis tool automatically detects, parses, and interprets errors from system-generated event logs in real time. These logs contain timestamped records of key activities such as messages, error reports, file requests and transfers, and sign-in or sign-out events.

By analyzing these logs, the tool uncovers issues, anomalies, and exceptions that may impact system or application performance. Log analysis supports a wide range of use cases, including:

  • Bug Detection: Identifying and resolving software bugs or issues.

  • Security: Monitoring for security breaches and unauthorized access.

  • Performance Monitoring: Analyzing system or application performance.

  • Troubleshooting: Investigating issues or outages by reviewing historical logs.

  • Compliance: Ensuring that systems comply with regulatory requirements.

Ververica Unified Streaming Data Platform includes an Automated Exception Log Analysis feature that helps developers identify and resolve issues during the development and deployment of Flink job applications. This feature is available in both the development and operational phases of a job within the Ververica Unified Streaming Data Platform Console.

Development State Exception​

The Automated Exception Log Analysis feature is available in the SQL Editor during the development state, allowing developers to identify issues early in the development process.

  1. On the Dashboard page, open the console for the workspace you want to manage.

  2. In the Console navigation pane, click SQL Editor.

  3. Create a new draft.

  4. Enter or copy/paste in the SQL code.

  5. Click Validate to analyze the SQL.

The validation results will be displayed, and the information icon will indicate the Log Analysis Results.

The following image shows an example of what the log analysis displays in the pre-deployment phase of the application. In this case, the SQL syntax and network connectivity check fails, and the log analysis provides a ‘Cause’ and ‘Solution’ to the failed check.

Automated Exception Log Analysis in Development State

By analyzing the logs in the development stage, this feature proactively aids developers by equipping them with possible causes, solutions, and reference scenarios before deployment.

Operation State Exception​

Similar to the development state, the Automated Exception Log Analysis tool is available for deployments beyond the draft stage, helping identify and troubleshoot runtime issues.

  1. On the Dashboard page, open the console for the workspace you want to manage.

  2. In the Console navigation pane, click Deployments.

  3. Open the deployment to be analyzed and display the Diagnostics tab.

  4. Display the JM Exceptions tab to examine the Log Analysis Results indicated by the information icon.

The screenshot below shows the analysis with an output of potential causes for errors and solutions to investigate. This example indicates a potential issue from a Java application and instructs the user to check out their UDFs.

Automated Exception Log Analysis in Development State

By getting log analysis at the deployment level, users can quickly understand issues with their applications with actionable solutions to save on time otherwise spent troubleshooting.

On this page