Native kubernetes integration for standalone job clusters.

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Native kubernetes integration for standalone job clusters.

Akshay Iyangar

 

Hi

 

So we actually run Flink in Kubernetes as a standalone Flink job for each Flink pipeline currently.

 

We wanted to take advantage of Flink HA using K8 but looks like it only supports Flink session  clusters currently for version 1.10.

 

Any ideas when will it have support for standalone job clusters?

 

Thanks

Akshay I

 

Reply | Threaded
Open this post in threaded view
|

Re: Native kubernetes integration for standalone job clusters.

Yang Wang
Hi Akshay,

Currently, zookeeper HA service could be used for both session cluster and job cluster
when deploying Flink on K8s. If you mean to using the native K8s HA(i.g. native leader
election and configmap to store meta)[1], i think it could not be supported now.



Best,
Yang

Akshay Iyangar <[hidden email]> 于2020年6月2日周二 上午3:46写道:

 

Hi

 

So we actually run Flink in Kubernetes as a standalone Flink job for each Flink pipeline currently.

 

We wanted to take advantage of Flink HA using K8 but looks like it only supports Flink session  clusters currently for version 1.10.

 

Any ideas when will it have support for standalone job clusters?

 

Thanks

Akshay I