Adding TaskManager on Cluster

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

Adding TaskManager on Cluster

tambunanw
Hi All, 

Currently we are running flink using standalone mode. 

Is there any way to add one node ( task manager ) to the cluster without bringing the cluster down ? 


Cheers
Reply | Threaded
Open this post in threaded view
|

Re: Adding TaskManager on Cluster

tambunanw
What i'm looking for here is the ability to add a node to the cluster (scale out) when there's no task slot left for use. 


On Tue, Nov 24, 2015 at 4:24 PM, Welly Tambunan <[hidden email]> wrote:
Hi All, 

Currently we are running flink using standalone mode. 

Is there any way to add one node ( task manager ) to the cluster without bringing the cluster down ? 


Cheers



--
Reply | Threaded
Open this post in threaded view
|

Re: Adding TaskManager on Cluster

Till Rohrmann-2

Hi Welly,

you can always start a new TaskManager by simply calling taskmanager.sh start [streaming|batch], depending whether you are running a streaming cluster or a batch cluster. You can find the script in /bin.

Cheers,
Till


On Tue, Nov 24, 2015 at 10:27 AM, Welly Tambunan <[hidden email]> wrote:
What i'm looking for here is the ability to add a node to the cluster (scale out) when there's no task slot left for use. 


On Tue, Nov 24, 2015 at 4:24 PM, Welly Tambunan <[hidden email]> wrote:
Hi All, 

Currently we are running flink using standalone mode. 

Is there any way to add one node ( task manager ) to the cluster without bringing the cluster down ? 


Cheers



--

Reply | Threaded
Open this post in threaded view
|

Re: Adding TaskManager on Cluster

tambunanw
Hi Till, 

I've just tried that. It's works like a charm. Thanks a lot. 

Is there any documentation on taskmanager.sh and other script and the parameters ? I try to look at the docs but can't find it

Thanks again



Cheers

On Tue, Nov 24, 2015 at 4:29 PM, Till Rohrmann <[hidden email]> wrote:

Hi Welly,

you can always start a new TaskManager by simply calling taskmanager.sh start [streaming|batch], depending whether you are running a streaming cluster or a batch cluster. You can find the script in /bin.

Cheers,
Till


On Tue, Nov 24, 2015 at 10:27 AM, Welly Tambunan <[hidden email]> wrote:
What i'm looking for here is the ability to add a node to the cluster (scale out) when there's no task slot left for use. 


On Tue, Nov 24, 2015 at 4:24 PM, Welly Tambunan <[hidden email]> wrote:
Hi All, 

Currently we are running flink using standalone mode. 

Is there any way to add one node ( task manager ) to the cluster without bringing the cluster down ? 


Cheers



--




--
Reply | Threaded
Open this post in threaded view
|

Re: Adding TaskManager on Cluster

Ufuk Celebi
I’ve added a section about this to the standalone cluster setup guide.

The webpage should be updated tonight by the automatic build bot.

– Ufuk

> On 24 Nov 2015, at 10:39, Welly Tambunan <[hidden email]> wrote:
>
> Hi Till,
>
> I've just tried that. It's works like a charm. Thanks a lot.
>
> Is there any documentation on taskmanager.sh and other script and the parameters ? I try to look at the docs but can't find it
>
> Thanks again
>
>
>
> Cheers
>
> On Tue, Nov 24, 2015 at 4:29 PM, Till Rohrmann <[hidden email]> wrote:
> Hi Welly,
>
> you can always start a new TaskManager by simply calling taskmanager.sh start [streaming|batch], depending whether you are running a streaming cluster or a batch cluster. You can find the script in /bin.
>
> Cheers,
> Till
>
>
> On Tue, Nov 24, 2015 at 10:27 AM, Welly Tambunan <[hidden email]> wrote:
> What i'm looking for here is the ability to add a node to the cluster (scale out) when there's no task slot left for use.
>
>
> On Tue, Nov 24, 2015 at 4:24 PM, Welly Tambunan <[hidden email]> wrote:
> Hi All,
>
> Currently we are running flink using standalone mode.
>
> Is there any way to add one node ( task manager ) to the cluster without bringing the cluster down ?
>
>
> Cheers
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com
>
>
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com
>
>
>
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com

Reply | Threaded
Open this post in threaded view
|

Re: Adding TaskManager on Cluster

tambunanw
Thanks a lot Ufuk. 

That will be really useful. 

Cheers

On Tue, Nov 24, 2015 at 7:36 PM, Ufuk Celebi <[hidden email]> wrote:
I’ve added a section about this to the standalone cluster setup guide.

The webpage should be updated tonight by the automatic build bot.

– Ufuk

> On 24 Nov 2015, at 10:39, Welly Tambunan <[hidden email]> wrote:
>
> Hi Till,
>
> I've just tried that. It's works like a charm. Thanks a lot.
>
> Is there any documentation on taskmanager.sh and other script and the parameters ? I try to look at the docs but can't find it
>
> Thanks again
>
>
>
> Cheers
>
> On Tue, Nov 24, 2015 at 4:29 PM, Till Rohrmann <[hidden email]> wrote:
> Hi Welly,
>
> you can always start a new TaskManager by simply calling taskmanager.sh start [streaming|batch], depending whether you are running a streaming cluster or a batch cluster. You can find the script in /bin.
>
> Cheers,
> Till
>
>
> On Tue, Nov 24, 2015 at 10:27 AM, Welly Tambunan <[hidden email]> wrote:
> What i'm looking for here is the ability to add a node to the cluster (scale out) when there's no task slot left for use.
>
>
> On Tue, Nov 24, 2015 at 4:24 PM, Welly Tambunan <[hidden email]> wrote:
> Hi All,
>
> Currently we are running flink using standalone mode.
>
> Is there any way to add one node ( task manager ) to the cluster without bringing the cluster down ?
>
>
> Cheers
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com
>
>
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com
>
>
>
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com




--