How to make my execution graph prettier?

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

How to make my execution graph prettier?

Hao Sun
Hi my execution graph looks like following, all things stuffed into on tile.image.png
How can I get something like this?


Reply | Threaded
Open this post in threaded view
|

Re: How to make my execution graph prettier?

Aljoscha Krettek
Hi,

The execution graph looks like this because Flink optimises your graph to fit all operations within a single Task. This operation is called chaining. The operation can be applied when there is no shuffle between operations and when the parallelism is the same (roughly speaking). 

If you wan't the graph to have separate tasks, you can disable chaining on the Flink ExecutionConfig. This can lead to worse performance, though.

Best,
Aljoscha

On 10. Oct 2017, at 06:36, Hao Sun <[hidden email]> wrote:

Hi my execution graph looks like following, all things stuffed into on tile.<image.png>
How can I get something like this?



Reply | Threaded
Open this post in threaded view
|

Re: How to make my execution graph prettier?

Hao Sun
Great, thanks! 

On Tue, Oct 10, 2017 at 7:52 AM Aljoscha Krettek <[hidden email]> wrote:
Hi,

The execution graph looks like this because Flink optimises your graph to fit all operations within a single Task. This operation is called chaining. The operation can be applied when there is no shuffle between operations and when the parallelism is the same (roughly speaking). 

If you wan't the graph to have separate tasks, you can disable chaining on the Flink ExecutionConfig. This can lead to worse performance, though.

Best,
Aljoscha

On 10. Oct 2017, at 06:36, Hao Sun <[hidden email]> wrote:

Hi my execution graph looks like following, all things stuffed into on tile.<image.png>
How can I get something like this?