dA Platform Setup

This section covers initial setup and operation of the dA Platform and its components.

About dA Platform

dA Platform provides the infrastructure for building a stateful streaming platform.

It consists of the following core components:

  • Application Manager: Web UI and API for managing stateful streaming applications.
  • Apache Flink®: Framework for implementing stateful streaming applications.

In addition to these core components, we provide additional components for demonstation purposes.

Demonstration components:

  • Logstash, ElasticSearch, Kibana: Centralized logging
  • InfluxDB, Grafana: Centralized metrics

We do not recommend using the demonstration components for production. The demonstration components were not designed or tested for large-scale and long-term production use.

Note

We highly recommend integrating Application Manager with existing logging and metrics infrastructure.

Note

dA Platform and Application Manager include and depend on open source software. The distribution of dA platform contains a licenses/ directory which documents the software packages used and includes copies of their licenses.

dA Platform Architecture

The figure below depicts the architecture of the platform.

../_images/architecture.png

The core of dA Platform is Application Manager. It provides a REST API and a web user interface for controlling Deployments. Each deployment controls how Flink jobs and clusters are created and evolve over time. The resources to run these Flink clusters are managed by Kubernetes.