- K8s Operator for Multi-Transfer Deployments
- Delta Sink
- Iceberg Sink
- Clickhouse Exactly Once Support
Develop a Kubernetes operator to manage multiple data transfers, simplifying the process for large-scale environments.
- Define CRD (Custom Resource Definitions) for transfer configurations.
- Implement operator logic for scaling and managing multi-transfer deployments.
- Add support for monitoring, scaling, and error recovery.
- Write user documentation for deploying and managing transfers via the operator.
Provide a scalable solution for managing multiple data transfers in Kubernetes environments with an operator.
TODO