Re: Cannot write record to fresh sort buffer. Record too large.
Posted by Sebastian Neef on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Cannot-write-record-to-fresh-sort-buffer-Record-too-large-tp13644p13724.html
Hi,
I removed the .distinct() and ran another test.
Without filtering duplicate entries, the Job processes more data and
runs much longer, but eventually fails with the following error:
> java.lang.OutOfMemoryError: Requested array size exceeds VM limit
Even then playing around with the aforementioned Flink settings does not
resolve the problem.
I guess, I need to debug this some more.
Best,
Sebastian