Prevent from caching loop-invariant data

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Prevent from caching loop-invariant data

Asterios Katsifodimos
Hello,

is there a way to instruct Flink's optimiser to *not* cache loop invariant data? e.g. points in KMeans?

Thanks,
Asterios
Reply | Threaded
Open this post in threaded view
|

Re: Prevent from caching loop-invariant data

Stephan Ewen
Sorry, not right now. Closed loops can only work with cached data.

The equivalent of not caching is loop unrolling in Flink.

On Wed, Nov 5, 2014 at 5:42 PM, Asterios Katsifodimos <[hidden email]> wrote:
Hello,

is there a way to instruct Flink's optimiser to *not* cache loop invariant data? e.g. points in KMeans?

Thanks,
Asterios