Re: Executing graph algorithms on Gelly that are larger then memmory
Posted by
Vasiliki Kalavri on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Executing-graph-algorithms-on-Gelly-that-are-larger-then-memmory-tp10358p10387.html
Hi,
can you give us some more details about the algorithm you are testing and your configuration?
Flink DataSet operators like join, coGroup, reduce, etc. spill to disk if there is not enough memory. If you are using a delta iteration operator though, the state that is kept across iterations (solution set) must fit in memory.
-Vasia.