zookeeper.connect is not needed but Flink requires it

[kant kodali]

Hi All,

The zookeeper.connect is not needed for KafkaConsumer or KafkaAdminClient however Flink requires it. You can also see in the Flink TaskManager logs the KafkaConsumer is not recognizing this property anyways.

bsTableEnv.connect(
    new Kafka()
        .property("bootstrap.servers", "localhost:9092")
        .property("zookeeper.connect", "localhost:2181")

2020-03-03 03:48:54,644 WARN org.apache.flink.kafka.shaded.org.apache.kafka.clients.consumer.ConsumerConfig - The configuration 'zookeeper.connect' was supplied but isn't a known config.

[Jark Wu-3]

Hi Kant,

You are right. It is not needed since Kafka 0.9+. We already have an issue to make it optional. 

https://issues.apache.org/jira/browse/FLINK-16125

Best,

Jark

On Tue, 3 Mar 2020 at 20:17, kant kodali <[hidden email]> wrote:

Hi All,

The zookeeper.connect is not needed for KafkaConsumer or KafkaAdminClient however Flink requires it. You can also see in the Flink TaskManager logs the KafkaConsumer is not recognizing this property anyways.

bsTableEnv.connect(
    new Kafka()
        .property("bootstrap.servers", "localhost:9092")
        .property("zookeeper.connect", "localhost:2181")

2020-03-03 03:48:54,644 WARN org.apache.flink.kafka.shaded.org.apache.kafka.clients.consumer.ConsumerConfig - The configuration 'zookeeper.connect' was supplied but isn't a known config.