Creating Job Savepoints at Regular Intervals

[Scott Kidder]

I'd like to create job savepoints at regular intervals to be used in the event of a total job failure where it's not possible to restore from a checkpoint. I'm aware that automatic savepoints are planned as part of FLIP-10, but I need something more immediate (using Flink 1.1.3).

I'm curious how other Flink users are doing this. CRON job on the active job-manager? Mostly just looking for a sanity-check.

Thanks!

--Scott Kidder

[Gyula Fóra]

Hi,

I personally use cron + grep the output for the savepoint path and write it to a file to keep track of the latest savepoints for each job. 

I can then use the last line of this file to restore from the latest savepoint if necessary.

Cheers,

Gyula

Scott Kidder <[hidden email]> ezt írta (időpont: 2016. nov. 22., K, 20:01):

I'd like to create job savepoints at regular intervals to be used in the event of a total job failure where it's not possible to restore from a checkpoint. I'm aware that automatic savepoints are planned as part of FLIP-10, but I need something more immediate (using Flink 1.1.3).

I'm curious how other Flink users are doing this. CRON job on the active job-manager? Mostly just looking for a sanity-check.

Thanks!

--Scott Kidder