Restart the job from a checkpoint

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Restart the job from a checkpoint

tao xiao
Hi team,

Can we restart a flink job from previous successful checkpoint? I know we can start a flink from a savepoint but I wonder if I can do it similar by passing the checkpoint path to the flink run command to restore the job from checkpoint.
Reply | Threaded
Open this post in threaded view
|

Re: Restart the job from a checkpoint

Ufuk Celebi
Hey!

This is possible with the upcoming 1.2 version of Flink (also in the
current snapshot version):
https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/checkpoints.html#externalized-checkpoints

You have to manually activate it via the checkpoint config (see docs).

Ping me if you have any questions.

– Ufuk


On Mon, Jan 16, 2017 at 5:51 AM, tao xiao <[hidden email]> wrote:
> Hi team,
>
> Can we restart a flink job from previous successful checkpoint? I know we
> can start a flink from a savepoint but I wonder if I can do it similar by
> passing the checkpoint path to the flink run command to restore the job from
> checkpoint.
Reply | Threaded
Open this post in threaded view
|

Re: Restart the job from a checkpoint

tao xiao
Hi Ufuk,

Thank you for the reply. I want to know what the difference is between state.backend.fs.checkpoint.dir and state.checkpoints.dir in this case? Does state.checkpoint.dir store the metadata that points to the checkpoint that is stored in state.backend.fs.checkpoint.dir?

On Mon, 16 Jan 2017 at 19:24 Ufuk Celebi <[hidden email]> wrote:
Hey!

This is possible with the upcoming 1.2 version of Flink (also in the
current snapshot version):
https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/checkpoints.html#externalized-checkpoints

You have to manually activate it via the checkpoint config (see docs).

Ping me if you have any questions.

– Ufuk


On Mon, Jan 16, 2017 at 5:51 AM, tao xiao <[hidden email]> wrote:
> Hi team,
>
> Can we restart a flink job from previous successful checkpoint? I know we
> can start a flink from a savepoint but I wonder if I can do it similar by
> passing the checkpoint path to the flink run command to restore the job from
> checkpoint.
Reply | Threaded
Open this post in threaded view
|

Re: Restart the job from a checkpoint

Ufuk Celebi
Yes, exactly. This is a little cumbersome at the moment, but there are plans to improve this after 1.2 is released.

– Ufuk

On 16 January 2017 at 16:33:49, tao xiao ([hidden email]) wrote:

> Hi Ufuk,
>  
> Thank you for the reply. I want to know what the difference is between
> state.backend.fs.checkpoint.dir
> and state.checkpoints.dir in this case? Does state.checkpoint.dir store the
> metadata that points to the checkpoint that is stored in
> state.backend.fs.checkpoint.dir?
>  
> On Mon, 16 Jan 2017 at 19:24 Ufuk Celebi wrote:
>  
> > Hey!
> >
> > This is possible with the upcoming 1.2 version of Flink (also in the
> > current snapshot version):
> >
> > https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/checkpoints.html#externalized-checkpoints 
> >
> > You have to manually activate it via the checkpoint config (see docs).
> >
> > Ping me if you have any questions.
> >
> > – Ufuk
> >
> >
> > On Mon, Jan 16, 2017 at 5:51 AM, tao xiao wrote:
> > > Hi team,
> > >
> > > Can we restart a flink job from previous successful checkpoint? I know we
> > > can start a flink from a savepoint but I wonder if I can do it similar by
> > > passing the checkpoint path to the flink run command to restore the job
> > from
> > > checkpoint.
> >
>