Is it possible to mount node local disk for task managers in a k8s application cluster?

[Chen-Che Huang]

Hi,

We use the per-job deployment mode to deploy our Flink services on Kubernetes. We're considering to move from the per-job mode to the application mode in view of the advantages of the application mode. However, it seems that `bin/flink run-application --target kubernetes-application` does not support to configure the task managers to mount volumes from the node local disk (volumes - hostPath) according to https://ci.apache.org/projects/flink/flink-docs-stable/deployment/config.html#kubernetes. If it is feasible, please let me know which option should be used. If not, could I create an issue for this feature. Thanks.

Best regards,
Chen-Che Huang

[Yang Wang]

 I think the pod template[1] is what you are looking for. It will be released in 1.13.

[1]. https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/resource-providers/native_kubernetes/#pod-template

Best,

Yang

Chen-Che Huang <[hidden email]> 于2021年3月16日周二 下午1:26写道：

Hi,

We use the per-job deployment mode to deploy our Flink services on Kubernetes. We're considering to move from the per-job mode to the application mode in view of the advantages of the application mode. However, it seems that `bin/flink run-application --target kubernetes-application` does not support to configure the task managers to mount volumes from the node local disk (volumes - hostPath) according to https://ci.apache.org/projects/flink/flink-docs-stable/deployment/config.html#kubernetes. If it is feasible, please let me know which option should be used. If not, could I create an issue for this feature. Thanks.

Best regards,
Chen-Che Huang

[Chen-Che Huang]

Hi Yang,

Thanks for the reply. Looking forward to 1.13 :)

Best wishes,
Chen-Che

On 2021/03/16 07:41:18, Yang Wang <[hidden email]> wrote:

>  I think the pod template[1] is what you are looking for. It will be
> released in 1.13.
>
> [1].
> https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/resource-providers/native_kubernetes/#pod-template
>
> Best,
> Yang
>
> Chen-Che Huang <[hidden email]> 于2021年3月16日周二 下午1:26写道：
>
> > Hi,
> >
> > We use the per-job deployment mode to deploy our Flink services on
> > Kubernetes. We're considering to move from the per-job mode to the
> > application mode in view of the advantages of the application mode.
> > However, it seems that `bin/flink run-application --target
> > kubernetes-application` does not support to configure the task managers to
> > mount volumes from the node local disk (volumes - hostPath) according to
> > https://ci.apache.org/projects/flink/flink-docs-stable/deployment/config.html#kubernetes.
> > If it is feasible, please let me know which option should be used. If not,
> > could I create an issue for this feature. Thanks.
> >
> > Best regards,
> > Chen-Che Huang
> >
>

... [show rest of quote]