checkpointing when yarn session crashed

Posted by ysn2233 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/checkpointing-when-yarn-session-crashed-tp27105.html

Hi everyone:

Recently I am doing a bucketingsink (to hdfs) job by flink on yarn. However I found that if the yarn session crashed, or I manually killed the yarn session, the file on hdfs does not rename to .pending state and the latest checkpoint does not have _metadata. Therefore I cannot resume my job after yarn restarts. Any ideas about this issue? Thank you very much!