Hello,
I am have a job that reads messages from kafka, processes them and writes back to kafka, this jobs works fine on flink 1.3.2. I upgraded cluster to 1.6.1 but now see below error. Has any one faced similar issue? I have updated all the dependencies to use <flink.version>1.6.1</flink.version> <dependency> java.lang.NoSuchMethodError: org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup; at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622) at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200) at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91) at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64) at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209) at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56) at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711) at java.lang.Thread.run(Thread.java:748) Thanks Chandu |
Hi Chandu, What mode does your Flink run in? In addition, can you check if the flink-metrics-core is included in the classpath of the Flink runtime environment? Thanks, vino. Chandu Kempaiah <[hidden email]> 于2018年10月11日周四 上午9:51写道:
|
Flink is running as standalone cluster in High Availability mode, My application jar is a fat jar which has all the necessary dependencies included. I will check once again and verify by adding the flink-metrics-core to the classpath. Thanks Chandu On Wed, Oct 10, 2018 at 8:38 PM vino yang <[hidden email]> wrote:
|
The cause cannot be that
flink-metrics-core is not on the classpath as in that case you'd
get a ClassNotFoundError.
This is a version conflict, either caused by your fat jar bundling an older version of flink-metrics-core but a newer version of the kafka connector, or you upgrade your application correctly but the cluster is actually still running an older version. Please check your dependencies and build setup. On 11.10.2018 08:05, Chandu Kempaiah wrote:
|
Free forum by Nabble | Edit this page |