Re: Getting error in pod template

[Priyanka Manickam]

On Mon, 17 May 2021, 17:38 Priyanka Manickam, <[hidden email]> wrote:

Hi Yang,

I have checked the documents you have shared in the previous mail. 

But i am not sure what we have to give for the $(CONTAINER_SCRIPTS)  in the line

-Dkubernetes.pod-template-file=$(CONTAINER_SCRIPTS)/Kubernetes-pod-template.yaml

Actually i was trying to get the logs from opt/flink/log folder and push to logstash and kibana.

And I was trying with both the approach Flink Application Mode in Kubernetes with yaml files and Native one.

While trying with native one , I used these two pod-template files but I am getting errors with these two also.

Please find the  attached pod-template yaml file which I was working on , but I am getting this error -Init:0/1

Attached pod-template-files: https://github.com/PriyankaManickam/flink-doubts/tree/main/Pod-template

Could you please tell if i have missed out anything.

Thanks,

Priyanka Manickam

On Mon, May 17, 2021 at 3:09 PM Yang Wang <[hidden email]> wrote:

The feature pod template is used for native Kubernetes mode[1].

This is a common command for how to start a native K8s Flink application with pod template.[2]

[1]. https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/resource-providers/native_kubernetes/#pod-template

[2]. https://github.com/wangyang0918/flink/blob/FLINK-19545-k8s-ha-e2e-dev-1/flink-end-to-end-tests/test-scripts/test_kubernetes_application_ha.sh

Best,

Yang

Priyanka Manickam <[hidden email]> 于2021年5月17日周一 下午3:55写道：

---------- Forwarded message ---------
From: Priyanka Manickam <[hidden email]>
Date: Fri, 14 May 2021, 21:00
Subject: Getting error in pod template
To: Yang Wang <[hidden email]>

Hi yang,

I was using pod template to fetch the logs to the particular repository.

But while deploying i have got some error , says " jobmanager-pod-template" is invalid : spec.containers(0).image: required value.

. And if i try to give add the image for flink-main-container. Its giving image pull back of error.

Am i proceeding in the a correct way . Because in the flink official website , no image is added after the flink-main-container.

Could you please help with this. I have also searchsd for the demo videos for using the pod template with flink native kubernetes but i could not able to find..If you could share any demo videos on the website it will very useful for everyone.

Good year ahead..

Thanks,

Priyanka Manickam.

[Priyanka Manickam]

Hi All,

I have used imagePullPolicy: Never, but still i am getting error in main container.

Could someone please help me out here

Thanks,

Priyanka Manickam

On Fri, 14 May 2021, 21:00 Priyanka Manickam, <[hidden email]> wrote:

Hi yang,

I was using pod template to fetch the logs to the particular repository.

But while deploying i have got some error , says " jobmanager-pod-template" is invalid : spec.containers(0).image: required value.

. And if i try to give add the image for flink-main-container. Its giving image pull back of error.

Am i proceeding in the a correct way . Because in the flink official website , no image is added after the flink-main-container.

Could you please help with this. I have also searchsd for the demo videos for using the pod template with flink native kubernetes but i could not able to find..If you could share any demo videos on the website it will very useful for everyone.

Good year ahead..

Thanks,

Priyanka Manickam.

[Yang Wang]

Could you share how you are starting the Flink native k8s application with pod template?

Usually it look like the following commands. And you need to have the Flink binary on your local machine.

Please note that pod template is working with native K8s mode only. And you could not use the "kubectl" to directly apply the pod template.

bin/flink run-application -t kubernetes-application \
        -Dkubernetes.cluster-id=my-flink-native-k8s-app \
        -Dkubernetes.container.image=flink:1.13 \
        -Djobmanager.memory.process.size=1088m \
        -Dkubernetes.jobmanager.cpu=0.5 \
        -Dkubernetes.taskmanager.cpu=0.5 \
        -Dkubernetes.rest-service.exposed.type=NodePort \
        -Dkubernetes.pod-template-file=/path/of/kubernetes-pod-template.yaml \
        local:///opt/flink/examples/streaming/StateMachineExample.jar

Best,
Yang

Priyanka Manickam <[hidden email]> 于2021年5月18日周二 下午5:24写道：

Hi All,

I have used imagePullPolicy: Never, but still i am getting error in main container.

Could someone please help me out here

Thanks,

Priyanka Manickam

On Fri, 14 May 2021, 21:00 Priyanka Manickam, <[hidden email]> wrote:

Hi yang,

I was using pod template to fetch the logs to the particular repository.

But while deploying i have got some error , says " jobmanager-pod-template" is invalid : spec.containers(0).image: required value.

. And if i try to give add the image for flink-main-container. Its giving image pull back of error.

Am i proceeding in the a correct way . Because in the flink official website , no image is added after the flink-main-container.

Could you please help with this. I have also searchsd for the demo videos for using the pod template with flink native kubernetes but i could not able to find..If you could share any demo videos on the website it will very useful for everyone.

Good year ahead..

Thanks,

Priyanka Manickam.