Checkpoint growth

Posted by Rex Fenley on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Checkpoint-growth-tp39365.html

Hello,

I'm reading the docs/blog on incremental checkpoints and it says:

>You can also no longer delete old checkpoints as newer checkpoints need them, and the history of differences between checkpoints can grow indefinitely over time. You need to plan for larger distributed storage to maintain the checkpoints and the network overhead to read from it.

source: https://flink.apache.org/features/2018/01/30/incremental-checkpointing.html

I'm wondering why this would be true though. It says earlier that incremental checkpoints compact so why would the history grow indefinitely?

Thanks!

--