Question on the Kafka connector parameter "connector.properties.zookeeper.connect"

[DONG, Weike]

Hi,

 

Recently I have found that in the Flink Kafka Connector, the parameter "connector.properties.zookeeper.connect" is made mandatory for users. Therefore without it, Flink would throw an exception saying “Caused by: org.apache.flink.table.api.ValidationException: Could not find required property 'connector.properties.zookeeper.connect'”.

 

However, as far as I know, for Kafka versions that are currently supported by the universal connector, this setting is not mandatory anymore. Here I would like know if this parameter could be changed to optional, and what are the negative impacts if doing so?

 

 

Thanks : )

 

Sincerely,

Weike

[Jark Wu-3]

Hi Weike,

You are right. It is not needed since Kafka 0.9+. We already have an issue to make it optional.
See https://issues.apache.org/jira/browse/FLINK-16125. We are planning to fix it in 1.10.1 too. 

Best,
Jark

On Wed, 4 Mar 2020 at 18:23, Weike Dong <[hidden email]> wrote:

Hi,

 

Recently I have found that in the Flink Kafka Connector, the parameter "connector.properties.zookeeper.connect" is made mandatory for users. Therefore without it, Flink would throw an exception saying “Caused by: org.apache.flink.table.api.ValidationException: Could not find required property 'connector.properties.zookeeper.connect'”.

 

However, as far as I know, for Kafka versions that are currently supported by the universal connector, this setting is not mandatory anymore. Here I would like know if this parameter could be changed to optional, and what are the negative impacts if doing so?

 

 

Thanks : )

 

Sincerely,

Weike