StreamingFileSink only writes data to MINIO during savepoint

Posted by Robert Cullen on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/StreamingFileSink-only-writes-data-to-MINIO-during-savepoint-tp44043.html

On my kubernetes cluster when I set the StreamingFileSink to write to a local instance of S3 (MINIO - 500 GB) it only writes the data after I execute a savepoint

The expected behavior is to write the data in real-time. I'm guessing the memory requirements have not been met or a configuration in MINIO is missing?  Any ideas?

--