Standalone HA Cluster using Shared Zookeeper

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Standalone HA Cluster using Shared Zookeeper

au.fp2018
Hello All,

I am planning on setting up a Standalone HA Cluster using the same Zookeeper
cluster I've that is managing a Kafka Cluster. The Zookeeper cluster for
Kafka has a /kafka chroot specified and for flink the chroot would be /flink
(so they are isolated).

Are there any downsides to this approach?

Also what is the purpose of this configuration:

   high-availability.cluster-id: /default_ns # important: customize per
cluster

Since I am not planning on running multiple HA clusters, do I have to worry
about this i.e. setting it to the default is good enough ?

Thanks,
Andre



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Standalone HA Cluster using Shared Zookeeper

Fabian Hueske-2
Hi Andre,

Sharing a Zookeeper cluster between Kafka and Flink should be OK.

If you're running just one cluster, you could in principle keep the default.
However, I'd change the configuration just in case.
Otherwise, you might get into trouble when you (accidentally) run another Flink setup.

Best, Fabian

2018-05-07 2:57 GMT+02:00 au.fp2018 <[hidden email]>:
Hello All,

I am planning on setting up a Standalone HA Cluster using the same Zookeeper
cluster I've that is managing a Kafka Cluster. The Zookeeper cluster for
Kafka has a /kafka chroot specified and for flink the chroot would be /flink
(so they are isolated).

Are there any downsides to this approach?

Also what is the purpose of this configuration:

   high-availability.cluster-id: /default_ns # important: customize per
cluster

Since I am not planning on running multiple HA clusters, do I have to worry
about this i.e. setting it to the default is good enough ?

Thanks,
Andre



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Reply | Threaded
Open this post in threaded view
|

Re: Standalone HA Cluster using Shared Zookeeper

au.fp2018
Thanks Fabian

After I understood the purpose of cluster-id configuration, I did end up
changing the default to something more specific to my cluster.


Fabian Hueske-2 wrote

> Hi Andre,
>
> Sharing a Zookeeper cluster between Kafka and Flink should be OK.
>
> If you're running just one cluster, you could in principle keep the
> default.
> However, I'd change the configuration just in case.
> Otherwise, you might get into trouble when you (accidentally) run another
> Flink setup.
>
> Best, Fabian
>
> 2018-05-07 2:57 GMT+02:00 au.fp2018 &lt;

> au.fp2018@

> &gt;:
>
>> Hello All,
>>
>> I am planning on setting up a Standalone HA Cluster using the same
>> Zookeeper
>> cluster I've that is managing a Kafka Cluster. The Zookeeper cluster for
>> Kafka has a /kafka chroot specified and for flink the chroot would be
>> /flink
>> (so they are isolated).
>>
>> Are there any downsides to this approach?
>>
>> Also what is the purpose of this configuration:
>>
>>    high-availability.cluster-id: /default_ns # important: customize per
>> cluster
>>
>> Since I am not planning on running multiple HA clusters, do I have to
>> worry
>> about this i.e. setting it to the default is good enough ?
>>
>> Thanks,
>> Andre
>>
>>
>>
>> --
>> Sent from: http://apache-flink-user-mailing-list-archive.2336050.
>> n4.nabble.com/
>>





--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/