Data & Streaming
State and streams. The data layer everything else reads and writes.
Every service in this group has its own page documenting how it runs: the values it is deployed with, and the trade-offs behind those choices.
| Service | What it does |
|---|---|
| Apache Flink | Processes event streams in real time with stateful, exactly-once pipelines |
| AutoMQ | Kafka with logs on S3-compatible storage: the event backbone every producer and consumer shares |
| Metabase | Query builder and dashboards over the cluster databases, no SQL knowledge required |
| PostgreSQL (CloudNativePG) | PostgreSQL as a primary with replicas, backed up to object storage via the CNPG operator |
| RustFS | S3-compatible object storage that backs Velero, AutoMQ, and the media pipeline |