Re: breaking the pipe line

Posted by Hequn Cheng on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/breaking-the-pipe-line-tp25471p25478.html

Hi Alieh,

Which kind of API do you use? TableApi or SQL or DataStream or DataSet.

Would be great if you can show us some information about your pipeline or provide a way to reproduce the problem.

Best, Hequn

On Sat, Jan 12, 2019 at 1:58 AM Alieh <[hidden email]> wrote:

Hello all,

I have a very very long pipeline (implementation of an incremental
algorithm). It takes a very long time for Flink execution planner to
create the plan. So I splitted the pipeline into several independent
pipelines by writing down the intermediate results and again read them.
Is there any other more efficient way to do it?

Best,

Alieh