dA Platform Setup¶
This section covers initial setup and operation of the dA Platform and its components.
About dA Platform¶
dA Platform provides the infrastructure for building a stateful streaming platform.
It consists of the following core components:
- Application Manager: Web UI and API for managing stateful streaming applications.
- Apache Flink®: Framework for implementing stateful streaming applications.
In addition to these core components, we provide additional components for demonstation purposes.
- Logstash, ElasticSearch, Kibana: Centralized logging
- InfluxDB, Grafana: Centralized metrics
We do not recommend using the demonstration components for production. The demonstration components were not designed or tested for large-scale and long-term production use.
We highly recommend integrating Application Manager with existing logging and metrics infrastructure.
dA Platform and Application Manager include and depend on open source software. The distribution of dA platform contains a
licenses/ directory which documents the software packages used and includes copies of their licenses.
dA Platform Architecture¶
The figure below depicts the architecture of the platform.
The core of dA Platform is Application Manager. It provides a REST API and a web user interface for controlling Deployments. Each deployment controls how Flink jobs and clusters are created and evolve over time. The resources to run these Flink clusters are managed by Kubernetes.