Failures on DataSet programs

Posted by Paulo Cezar on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Failures-on-DataSet-programs-tp9219.html

Hi Folks,

I was wondering if it's possible to keep partial outputs from dataset programs.

I have a batch pipeline that writes its output on HDFS using writeAsFormattedText. When it fails the output file is deleted but I would like to keep it so that I can generate new inputs for the pipeline to avoid reprocessing.

[]'s

Paulo Cezar