Set up Flink Cluster on Windows machines

[Yifei Li]

Hi,

Is it possible to set up cluster on Windows machines? I have git installed and when I use start-cluster.sh in git cmd, it asks me to type in password for other machines. After I did it, it showed nohup:command not found.

I am just wondering if it is possible to set up clusters on Windows machines? If yes, can anyone point me to any guide?

Thanks,

Yifei

[Fabian Hueske-2]

Hi Yifei,

I think this has not been done before. At least I am not aware of anybody running Flink in cluster mode on Windows.

In principle this should work. It is possible to start a local instance on Windows (start-local.bat) and to locally execute Flink programs on this instance using the flink.bat script.

However, there are no scripts or further tooling support to start Flink processes on remote Windows servers as for Linux using ssh.

I think the only way to do this right now is to manually start the Flink Java processes on each Windows machine. You should check the bash scripts for how to read certain configuration parameters from flink-conf.yaml and how to construct the right classpath.

Best, Fabian

2016-04-21 0:39 GMT+02:00 Yifei Li <[hidden email]>:

Hi,

Is it possible to set up cluster on Windows machines? I have git installed and when I use start-cluster.sh in git cmd, it asks me to type in password for other machines. After I did it, it showed nohup:command not found.

I am just wondering if it is possible to set up clusters on Windows machines? If yes, can anyone point me to any guide?

Thanks,

Yifei

[Jamie Grier]

I should also think that using Cygwin may work quite well and allow you to just use the current Unix-oriented shell scripts with maybe slight modifications.

-Jamie

On Wed, Apr 20, 2016 at 4:11 PM, Fabian Hueske <[hidden email]> wrote:

Hi Yifei,

I think this has not been done before. At least I am not aware of anybody running Flink in cluster mode on Windows.

In principle this should work. It is possible to start a local instance on Windows (start-local.bat) and to locally execute Flink programs on this instance using the flink.bat script.

However, there are no scripts or further tooling support to start Flink processes on remote Windows servers as for Linux using ssh.

I think the only way to do this right now is to manually start the Flink Java processes on each Windows machine. You should check the bash scripts for how to read certain configuration parameters from flink-conf.yaml and how to construct the right classpath.

Best, Fabian

2016-04-21 0:39 GMT+02:00 Yifei Li <[hidden email]>:

Hi,

Is it possible to set up cluster on Windows machines? I have git installed and when I use start-cluster.sh in git cmd, it asks me to type in password for other machines. After I did it, it showed nohup:command not found.

I am just wondering if it is possible to set up clusters on Windows machines? If yes, can anyone point me to any guide?

Thanks,

Yifei

--