Hi Tarandeep,
The error you are seeing only occurs when on startup of the consumer, it couldn’t retrieve any partition information from Kafka.
Therefore, according to your description, there should be another error that caused the previous execution of the job to fail. Could you check that? Maybe that would give more insight into why this is happening.
Cheers,
Gordon
On 23 January 2018 at 5:37:15 AM, Tarandeep Singh ([hidden email]) wrote:
Hi,
Our flink streaming job that is reading from old version of
Kafka keeps failing (every 9 minutes or so) with this
error:
java.lang.RuntimeException:
Unable to retrieve any partitions for the requested topics
[extracted-dimensions]. Please check previous log entries
at
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08.getKafkaPartitions(FlinkKafkaConsumer08.java:220)
at
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.open(FlinkKafkaConsumerBase.java:381)
at
org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
at
org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:111)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:376)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:253)
at
org.apache.flink.runtime.taskmanager.Task.run(Task.java:702)
at
java.lang.Thread.run(Thread.java:748)
Sometimes it runs for a long time but when it starts to fail,
it is predictable failure every 9 minutes. The topic does exist in
the Kafka cluster.
Can someone help me understand what could be going
wrong?
Thank you,
Tarandeep
Locked
