Hi team,
Can we restart a flink job from previous successful checkpoint? I know we can start a flink from a savepoint but I wonder if I can do it similar by passing the checkpoint path to the flink run command to restore the job from checkpoint. |
Hey!
This is possible with the upcoming 1.2 version of Flink (also in the current snapshot version): https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/checkpoints.html#externalized-checkpoints You have to manually activate it via the checkpoint config (see docs). Ping me if you have any questions. – Ufuk On Mon, Jan 16, 2017 at 5:51 AM, tao xiao <[hidden email]> wrote: > Hi team, > > Can we restart a flink job from previous successful checkpoint? I know we > can start a flink from a savepoint but I wonder if I can do it similar by > passing the checkpoint path to the flink run command to restore the job from > checkpoint. |
Hi Ufuk, Thank you for the reply. I want to know what the difference is between state.backend.fs.checkpoint.dir and state.checkpoints.dir in this case? Does state.checkpoint.dir store the metadata that points to the checkpoint that is stored in state.backend.fs.checkpoint.dir? On Mon, 16 Jan 2017 at 19:24 Ufuk Celebi <[hidden email]> wrote: Hey! |
Yes, exactly. This is a little cumbersome at the moment, but there are plans to improve this after 1.2 is released.
– Ufuk On 16 January 2017 at 16:33:49, tao xiao ([hidden email]) wrote: > Hi Ufuk, > > Thank you for the reply. I want to know what the difference is between > state.backend.fs.checkpoint.dir > and state.checkpoints.dir in this case? Does state.checkpoint.dir store the > metadata that points to the checkpoint that is stored in > state.backend.fs.checkpoint.dir? > > On Mon, 16 Jan 2017 at 19:24 Ufuk Celebi wrote: > > > Hey! > > > > This is possible with the upcoming 1.2 version of Flink (also in the > > current snapshot version): > > > > https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/checkpoints.html#externalized-checkpoints > > > > You have to manually activate it via the checkpoint config (see docs). > > > > Ping me if you have any questions. > > > > – Ufuk > > > > > > On Mon, Jan 16, 2017 at 5:51 AM, tao xiao wrote: > > > Hi team, > > > > > > Can we restart a flink job from previous successful checkpoint? I know we > > > can start a flink from a savepoint but I wonder if I can do it similar by > > > passing the checkpoint path to the flink run command to restore the job > > from > > > checkpoint. > > > |
Free forum by Nabble | Edit this page |