Does savepoint reset the base for incremental checkpoint

[Steven Wu]

In this sequence of (checkpoint x, savepoint y, checkpoint x+1), does checkpoint x+1 build the incremental diff based on checkpoint x or savepoint y?

Thanks,

Steven

[Steven Wu]

In a slightly different variation of sequence (checkpoint x, savepoint y, redeploy/restart job from savepoint y, checkpoint x+1), checkpoint x+1 builds the incremental diff on savepoint y, right?

On Sun, Jul 5, 2020 at 8:08 PM Steven Wu <[hidden email]> wrote:

In this sequence of (checkpoint x, savepoint y, checkpoint x+1), does checkpoint x+1 build the incremental diff based on checkpoint x or savepoint y?

Thanks,

Steven

[Congxian Qiu]

Hi

checkpoint base is only used in the incremental checkpoint, the answer for the first question is checkpoint x.

After restoring from a savepoint, there is no base for the first checkpoint.

you can ref to the code[1][2] for more information.

[1] https://github.com/apache/flink/blob/c14f9d2f9f6d6f2da3dc41fcef010e12405e25eb/flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/snapshot/RocksIncrementalSnapshotStrategy.java#L416

[2] https://github.com/apache/flink/blob/master/flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/restore/RocksDBFullRestoreOperation.java

Steven Wu <[hidden email]> 于2020年7月6日周一 上午11:46写道：

In a slightly different variation of sequence (checkpoint x, savepoint y, redeploy/restart job from savepoint y, checkpoint x+1), checkpoint x+1 builds the incremental diff on savepoint y, right?

On Sun, Jul 5, 2020 at 8:08 PM Steven Wu <[hidden email]> wrote:

In this sequence of (checkpoint x, savepoint y, checkpoint x+1), does checkpoint x+1 build the incremental diff based on checkpoint x or savepoint y?

Thanks,

Steven