My task managers are not starting

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

My task managers are not starting

Felipe Gutierrez
Hi all,

I am deploying a Flink cluster using the version "flink-1.5.2-bin-hadoop28-scala_2.11.tgz". It is one master node and two slave nodes. I have configured the key-ssh between all nodes so I can log in without type the password (also the nodes of the cluster). When I start the cluster it show that it is starting the standalonesession for the master node. Should not be the JobManager? Or did it changed for version 1.5.+?

Additionally, my slave nodes do not start. I can see on the dashboard that my cluster is running, but I have no taskmanagers to process my tasks.

# /etc/flink-1.5.2/bin/start-cluster.sh 
Starting cluster.
Starting standalonesession daemon on host sense1.
Starting taskexecutor daemon on host sense3.
Starting taskexecutor daemon on host sense4.

I have considered to decrease the memory heap size for the job manager and tasks manager for 512 MB, but with no success. Does anyone could help me to start the cluster?

thanks,
Felipe


--
-- Felipe Gutierrez
-- skype: felipe.o.gutierrez
Reply | Threaded
Open this post in threaded view
|

Re: My task managers are not starting

Felipe Gutierrez
Strange. I decreased the max value (TM_MAX_OFFHEAP_SIZE) even it says the slave will not use all space and it worked.

        # Long.MAX_VALUE in TB: This is an upper bound, much less direct memory will be used
        # TM_MAX_OFFHEAP_SIZE="8388607T"



--
-- Felipe Gutierrez
-- skype: felipe.o.gutierrez

On Tue, Jul 31, 2018 at 5:38 PM, Felipe Gutierrez <[hidden email]> wrote:
Hi all,

I am deploying a Flink cluster using the version "flink-1.5.2-bin-hadoop28-scala_2.11.tgz". It is one master node and two slave nodes. I have configured the key-ssh between all nodes so I can log in without type the password (also the nodes of the cluster). When I start the cluster it show that it is starting the standalonesession for the master node. Should not be the JobManager? Or did it changed for version 1.5.+?

Additionally, my slave nodes do not start. I can see on the dashboard that my cluster is running, but I have no taskmanagers to process my tasks.

# /etc/flink-1.5.2/bin/start-cluster.sh 
Starting cluster.
Starting standalonesession daemon on host sense1.
Starting taskexecutor daemon on host sense3.
Starting taskexecutor daemon on host sense4.

I have considered to decrease the memory heap size for the job manager and tasks manager for 512 MB, but with no success. Does anyone could help me to start the cluster?

thanks,
Felipe


--
-- Felipe Gutierrez
-- skype: felipe.o.gutierrez