Kafka: Unable to retrieve any partitions with KafkaTopicsDescriptor

[Abhijeet Kumar]

Hello Team,

I have written a streaming job that takes data from Kafka. I've noticed for some Kafka topics things are working fine but, with the few topics when I'm trying to get the data it's throwing error:

Exception in thread "main" org.apache.flink.runtime.client.JobExecutionException: java.lang.RuntimeException: Unable to retrieve any partitions with KafkaTopicsDescriptor: Fixed Topics ([crimedatademo])

at org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:623)

at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:123)

at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1511)

at com.argoid.crimedemo.flink.streaming.CrimeDemo.CrimeDemoStream.startStream(CrimeDemoStream.java:82)

at com.argoid.crimedemo.flink.streaming.CrimeDemo.CrimeDemoApplication.main(CrimeDemoApplication.java:5)

Caused by: java.lang.RuntimeException: Unable to retrieve any partitions with KafkaTopicsDescriptor: Fixed Topics ([crimedatademo])

at org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer.discoverPartitions(AbstractPartitionDiscoverer.java:153)

at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.open(FlinkKafkaConsumerBase.java:473)

at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)

at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:102)

at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:424)

at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:290)

at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)

at java.lang.Thread.run(Unknown Source)

I'm using 

Kafka --> 1.1.0 

Flink --> 1.6.1  

Kafka flink connector --> 1.6.1

Thanks,

Abhijeet Kumar Software Development Engineer, Sentienz Solutions Pvt Ltd Cognitive Data Platform - Perceive the Data ! [hidden email] |www.sentienz.com | Bengaluru