FlinkShell with standalone HA cluster

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

FlinkShell with standalone HA cluster

Scott Clasen
Hi All-

  I am having trouble using the FlinkShell against a standalone HA cluster (recovery.mode: zookeeper)

 If I remove the zookeeper conf from flink-conf.yaml and restart the cluster, I can execute stuff from the shell just fine. (One master is running)

  Adding back the config, and restarting, the cluster is up, with taskmanagers registered, etc, but even when pointing the FlinkShell at the master and its dynamically chosen port, I get an error "he program execution failed: Communication with JobManager failed: Lost connection to the JobManager."

Is there a requirement that multiple masters be up, or some other way to tell FlinkShell that the cluster is a standalone HA cluster?

Thanks!
SC
Reply | Threaded
Open this post in threaded view
|

Re: FlinkShell with standalone HA cluster

Stefan Richter
Hi,

one master should be enough to get Flink working. Did you ensure that all the configuration files are complete, correct, and also distributed to all nodes in the cluster? If you still can not start Flink after checking that, relevant sections from the log and your configuration would be helpful.

Best,
Stefan

> Am 22.07.2016 um 18:44 schrieb Scott Clasen <[hidden email]>:
>
> Hi All-
>
>   I am having trouble using the FlinkShell against a standalone HA cluster (recovery.mode: zookeeper)
>
>  If I remove the zookeeper conf from flink-conf.yaml and restart the cluster, I can execute stuff from the shell just fine. (One master is running)
>
>   Adding back the config, and restarting, the cluster is up, with taskmanagers registered, etc, but even when pointing the FlinkShell at the master and its dynamically chosen port, I get an error "he program execution failed: Communication with JobManager failed: Lost connection to the JobManager."
>
> Is there a requirement that multiple masters be up, or some other way to tell FlinkShell that the cluster is a standalone HA cluster?
>
> Thanks!
> SC