How to update Flink applications gracefully

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

How to update Flink applications gracefully

Yuta Morisawa
Hi all

Now I'm trying to update my streaming application.
But I have no idea how to update it gracefully.

Should I stop it, replace a jar file then restart it?
In my understanding, in that case, all the state will be recovered if I
use checkpoints in a persistent storage.
Is this correct?

Thank you,

Reply | Threaded
Open this post in threaded view
|

Re: How to update Flink applications gracefully

Nastaran

Hi Yuta,

You can use cancel-with-savepoint to stop you application and save the state in a savepoint, then update your jar and restart the application from the saved savepoint. Checkpointing is an automatic mechanism to recover from runtime failures and savepoints are designed for manual restart. See the following:

https://ci.apache.org/projects/flink/flink-docs-release-1.7/ops/state/savepoints.html



Kind regards,

Nastaran Motavalli




From: Yuta Morisawa <[hidden email]>
Sent: Tuesday, December 18, 2018 6:30:09 AM
To: [hidden email]
Subject: How to update Flink applications gracefully
 
Hi all

Now I'm trying to update my streaming application.
But I have no idea how to update it gracefully.

Should I stop it, replace a jar file then restart it?
In my understanding, in that case, all the state will be recovered if I
use checkpoints in a persistent storage.
Is this correct?

Thank you,

Reply | Threaded
Open this post in threaded view
|

Re: How to update Flink applications gracefully

Yuta Morisawa
Hi Nastaran

Thank you for your reply!
I got a concept of the savepoint.
It looks so nice.

Regards,
Yuta

On 2018/12/18 14:41, Nastaran Motavali wrote:

> Hi Yuta,
>
> You can use cancel-with-savepoint to stop you application and save the
> state in a savepoint, then update your jar and restart the application
> from the saved savepoint. Checkpointing is an automatic mechanism to
> recover from runtime failures and savepoints are designed for manual
> restart. See the following:
>
> https://ci.apache.org/projects/flink/flink-docs-release-1.7/ops/state/savepoints.html
>
>
>
> Kind regards,
>
> Nastaran Motavalli
>
>
>
> ------------------------------------------------------------------------
> *From:* Yuta Morisawa <[hidden email]>
> *Sent:* Tuesday, December 18, 2018 6:30:09 AM
> *To:* [hidden email]
> *Subject:* How to update Flink applications gracefully
> Hi all
>
> Now I'm trying to update my streaming application.
> But I have no idea how to update it gracefully.
>
> Should I stop it, replace a jar file then restart it?
> In my understanding, in that case, all the state will be recovered if I
> use checkpoints in a persistent storage.
> Is this correct?
>
> Thank you,
>