Updating Job dependencies without restarting Flink

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Updating Job dependencies without restarting Flink

Rohil Surana
Hi, 

We have a lot of jobs on Flink cluster that are using some common dependencies and I wanted to know if there is a way to place those dependencies in the flink lib folder so they will be available to the applications without restarting the flink cluster, so that next time a job is started latest versions of  those dependencies are available for use. We are using Flink 1.4.0

Any help in this matter is appreciated.
Reply | Threaded
Open this post in threaded view
|

Re: Updating Job dependencies without restarting Flink

Fabian Hueske-2
Hi,

I'm quite sure that is not supported.
You'd have to take a savepoint and restart the application.
Depending on the sink system, you could start the new job before shutting the old job down.

Best, Fabian

2018-03-20 10:31 GMT+01:00 Rohil Surana <[hidden email]>:
Hi, 

We have a lot of jobs on Flink cluster that are using some common dependencies and I wanted to know if there is a way to place those dependencies in the flink lib folder so they will be available to the applications without restarting the flink cluster, so that next time a job is started latest versions of  those dependencies are available for use. We are using Flink 1.4.0

Any help in this matter is appreciated.