Preserve accumulators after failure in DataStream API
Posted by
Wouter Zorgdrager-2 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Preserve-accumulators-after-failure-in-DataStream-API-tp27649.html
Hi all,
In the documentation I read about UDF accumulators [1] "Accumulators are automatically backup-ed by Flink’s checkpointing mechanism and restored in case of a failure to ensure exactly-once semantics." So I assumed this also was the case of accumulators used in the DataStream API, but I noticed that it isn't. So every time my jobs crashes and restarts, the accumulator is reset. Is there a way to retain this information?
Thanks,
Wouter