breaking the pipe line

[Alieh]

Hello all,

I have a very very long pipeline (implementation of an incremental
algorithm). It takes a very long time for Flink execution planner to
create the plan. So I splitted the pipeline into several independent
pipelines by writing down the intermediate results and again read them.
Is there any other more efficient way to do it?

Best,

Alieh

[Hequn Cheng]

Hi Alieh,

Which kind of API do you use? TableApi or SQL or DataStream or DataSet.

Would be great if you can show us some information about your pipeline or provide a way to reproduce the problem.

Best, Hequn

On Sat, Jan 12, 2019 at 1:58 AM Alieh <[hidden email]> wrote:

Hello all,

I have a very very long pipeline (implementation of an incremental
algorithm). It takes a very long time for Flink execution planner to
create the plan. So I splitted the pipeline into several independent
pipelines by writing down the intermediate results and again read them.
Is there any other more efficient way to do it?

Best,

Alieh