Flink Cluster without HDFS

[Matthias-2]

Hi everyone,
Is there a way to run Flink in cluster mode without the use of HDFS?

Thanks in advance,
Matthias

[Aljoscha Krettek]

Yes, it is certainly possible. You just don't start an HDFS cluster
and read your data from some other data source.

Cheers,
Aljoscha

On Sat, Dec 13, 2014 at 1:46 AM, Matthias <[hidden email]> wrote:
> Hi everyone,
> Is there a way to run Flink in cluster mode without the use of HDFS?
>
> Thanks in advance,
> Matthias
>

[Stephan Ewen]

Sure, HDFS is not required for the cluster mode. Even if the cluster has no HDFS installed, Flink works all the same.

All you do need is that the binaries and the configuration are accessible from all notes (you either copy them onto each node, or put them in a shared nfs) and that machines can ssh to each other.

Stephan

Am 13.12.2014 01:47 schrieb "Matthias" <[hidden email]>:

Hi everyone,
Is there a way to run Flink in cluster mode without the use of HDFS?

Thanks in advance,
Matthias