Taskmanager with multiple slots vs running multiple taskmanagers with 1 slot each

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Taskmanager with multiple slots vs running multiple taskmanagers with 1 slot each

au.fp2018
Hi All,

As the subject indicates, what is the general consensus and best practices
around running 1 taskmanger with multiple slots vs running multiple
taskmanager each with 1 slot?

What is your reason for you picking one over the other?

Thanks,
Andre




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Taskmanager with multiple slots vs running multiple taskmanagers with 1 slot each

Kostas Kloudas
Hi Andre,

I cannot speak on behalf of everyone but I would recommend 1 TM with multiple slots.
This way you pay the “fixed costs” of running a TM (like allocating memory for network buffers,
launching thread pools, exchanging heartbeat messages etc) only once.

On the flip-side, this means that you have less isolation among the tasks running on the different
slots, as one misbehaving task can bring down the TM. But flink will take care of restarting the
running tasks on another TM.

I hope this helps,
Kostas

> On May 8, 2018, at 12:17 AM, au.fp2018 <[hidden email]> wrote:
>
> Hi All,
>
> As the subject indicates, what is the general consensus and best practices
> around running 1 taskmanger with multiple slots vs running multiple
> taskmanager each with 1 slot?
>
> What is your reason for you picking one over the other?
>
> Thanks,
> Andre
>
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/