|
Hi all,
Has someone successfully run Flink jobs with this type of setup (Gitlab CI CD and Kubernetes)?
Since Flink jobs can’t be dockerized and deployed in a natural way as part of the container (according to Flip-6) I am not very sure of how is the best way of doing this.
We are thinking of having 3 Docker files: One for the Job manager, one for the Task Manager, and one for a container that will submit the jars and properties File to the Job Manager. With this setup we can still use the official Flink Docker images, and we can automatically generate the third Docker file with the project specific tasks. This setup allows to have Continuous deployment. However, it implies that we will have a new Flink cluster every time there is a new code version.
What do you think of this set up? Has someone implemented something similar? Is there any documentation about Flink-Gitlab-CI-CD-Kubernetes?
Thank you very much,
Nancy
|