PartitionNotFoundException on deploying streaming job

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

PartitionNotFoundException on deploying streaming job

Kamil Dziublinski
Hi guys,

When I run my streaming job I almost always have initially PartitionNotFoundException. Job fails, after that restarts and it runs ok.
I wonder what is causing that and if I can adjust some parameters to not have this initial failure.

I have flink session on yarn with 55 task managers. 4 cores and 4gb per TM.
This setup is using 77% of my yarn cluster.

Any ideas?

Thanks,
Kamil.