flink loop

Posted by tanguy racinet on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/flink-loop-tp700.html

Hi,

We are trying to develop the Apriori algorith with the Flink for our Data minning project.

In our understanding, Flink could handle loop within the workflow.

However, our knowledge is limited and we cannot find a nice way to do it.

Here is the flow of my algorithm :

GenerateCandidates ----> CalculateFrequentItemSet

mapper                      ----> reducer

We would like to use the reducer result as the mapper's entry for a predefined number of times (loop x times).

Is there any smart way to that with Flink. Or should we just copy paste the loop x times ?

Thank you,

Racinet Tanguy EIT ICT Labs Master School Student Distributed Systems and Services Tel : <a href="tel:%2B33%206%2063%2020%2089%2016" value="[phone]" target="_blank">[phone] / <a href="tel:%2B49%20176%203749%208854" value="[phone]" target="_blank">[phone] Mail : [hidden email]

ᐧ