Skip to main content

VERA's Core Pillars

VERA (Ververica Runtime Assembly) unites the power of three technologies into a singular engine that allows you to connect, process, analyze, and govern your data in one solution. The technologies include:

  • Streaming Data Movement
  • Real-time Stream Processing
  • Streaming Lakehouse (Ververica’s Streamhouse).

VERA overview

At Ververica, we call these combined technologies the Core Pillars of VERA.

Streaming data movement​

VERA Streaming Data Movement

Streaming Data Movement is the end-to-end process of utilizing Flink Change Data Capture (Flink CDC) to move data and events through VERA. This is accomplished by loading data generated from various applications and systems (often in different formats and volumes) and transforming it into a uniform type, then continuously processing that data in real time. This is followed by consuming the processed data and finally putting it into destination systems for potential later use, all while maintaining data lineage and security.

Benefits​

  • Easily access, format, process and store any data
  • Use data for future decision making
  • Move your data and events into a common stateful processing layer
  • Benefit from a unified, 365-degree, real-time view and processing window onto your data.
  • Develop apps with out-of-the-box support for Java, Python, or SQL.

In short: Streaming Data Movement makes all of your data easily available, so you can take action faster and make better-informed business decisions using that data.

Real-time stream processing​

VERA Real-time Stream Processing

VERA is highly scalable and stable, thanks to the decoupling of the storage and compute layers, and is optimized to deliver both stream processing and batch processing capabilities that allow for stateful computations over data streams. VERA manages the execution of Flink applications and seamlessly integrates with Flink and Flink APIs, which in turn allows developers to process and analyze large amounts of data to extract insights in real time. Benefits

Stop waiting for data to catch up, and instead make fast, reliable decisions using the freshest information available. Take action on your data as it arrives, in whatever format it arrives, and use it to make immediate decisions.

Streaming lakehouse (streamhouse)​

VERA Real-time Stream Processing

At its essence, Streamhouse provides Flink with a storage layer that leverages a table format to make data in dynamic tables directly accessible. So, how does Streamhouse achieve this?

  • Flink CDC handles data ingestion and adds the lake entries
  • Flink SQL performs streaming and batch ETL, and ad-hoc analysis
  • A set of engines completes data entry, analysis, and queries.

Benefits​

Streamhouse navigates the fine line between real-time streaming (super low latency but very costly) and traditional Lakehouse batch processing (inexpensive, but very slow). So, VERA provides the best of both worlds:

  • Nearly unlimited storage inside your streaming compute engine
  • Run queries across petabytes (or exabytes!) of data without having to compromise your ability to store it in a cost-effective manner
  • Run real-time and near real-time stream processing from one powerful engine, giving you the ability to make informed decisions leveraging both current and historical data.

Where to go next?​