Fwd: Getting NoMethod found error while running job on flink 1.6.1

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Fwd: Getting NoMethod found error while running job on flink 1.6.1

Chandu Kempaiah

Hello,

I am have a job that reads messages from kafka, processes them and writes back to kafka, this jobs works fine on flink 1.3.2. I upgraded cluster to 1.6.1 but now see below error. Has any one faced similar issue?

I have updated all the dependencies to use 
<flink.version>1.6.1</flink.version>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kafka-0.10_${scala.version}</artifactId>
<version>${flink.version}</version>
</dependency>

java.lang.NoSuchMethodError: org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup;
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622)
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
	at java.lang.Thread.run(Thread.java:748)


Thanks
Chandu
Reply | Threaded
Open this post in threaded view
|

Re: Getting NoMethod found error while running job on flink 1.6.1

vino yang
Hi Chandu,

What mode does your Flink run in? 
In addition, can you check if the flink-metrics-core is included in the classpath of the Flink runtime environment?

Thanks, vino.

Chandu Kempaiah <[hidden email]> 于2018年10月11日周四 上午9:51写道:

Hello,

I am have a job that reads messages from kafka, processes them and writes back to kafka, this jobs works fine on flink 1.3.2. I upgraded cluster to 1.6.1 but now see below error. Has any one faced similar issue?

I have updated all the dependencies to use 
<flink.version>1.6.1</flink.version>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kafka-0.10_${scala.version}</artifactId>
<version>${flink.version}</version>
</dependency>

java.lang.NoSuchMethodError: org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup;
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622)
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
	at java.lang.Thread.run(Thread.java:748)


Thanks
Chandu
Reply | Threaded
Open this post in threaded view
|

Re: Getting NoMethod found error while running job on flink 1.6.1

Chandu Kempaiah
Flink is running as standalone cluster in High Availability mode, My application jar is a fat jar which has all the necessary dependencies included. 

I will check once again and verify by adding the flink-metrics-core to the classpath.

Thanks
Chandu

On Wed, Oct 10, 2018 at 8:38 PM vino yang <[hidden email]> wrote:
Hi Chandu,

What mode does your Flink run in? 
In addition, can you check if the flink-metrics-core is included in the classpath of the Flink runtime environment?

Thanks, vino.

Chandu Kempaiah <[hidden email]> 于2018年10月11日周四 上午9:51写道:

Hello,

I am have a job that reads messages from kafka, processes them and writes back to kafka, this jobs works fine on flink 1.3.2. I upgraded cluster to 1.6.1 but now see below error. Has any one faced similar issue?

I have updated all the dependencies to use 
<flink.version>1.6.1</flink.version>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kafka-0.10_${scala.version}</artifactId>
<version>${flink.version}</version>
</dependency>

java.lang.NoSuchMethodError: org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup;
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622)
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
	at java.lang.Thread.run(Thread.java:748)


Thanks
Chandu
Reply | Threaded
Open this post in threaded view
|

Re: Getting NoMethod found error while running job on flink 1.6.1

Chesnay Schepler-2
The cause cannot be that flink-metrics-core is not on the classpath as in that case you'd get a ClassNotFoundError.

This is a version conflict, either caused by your fat jar bundling an older version of flink-metrics-core but a newer version of the kafka connector, or you upgrade your application correctly but the cluster is actually still running an older version.

Please check your dependencies and build setup.

On 11.10.2018 08:05, Chandu Kempaiah wrote:
Flink is running as standalone cluster in High Availability mode, My application jar is a fat jar which has all the necessary dependencies included. 

I will check once again and verify by adding the flink-metrics-core to the classpath.

Thanks
Chandu

On Wed, Oct 10, 2018 at 8:38 PM vino yang <[hidden email]> wrote:
Hi Chandu,

What mode does your Flink run in? 
In addition, can you check if the flink-metrics-core is included in the classpath of the Flink runtime environment?

Thanks, vino.

Chandu Kempaiah <[hidden email]> 于2018年10月11日周四 上午9:51写道:

Hello,

I am have a job that reads messages from kafka, processes them and writes back to kafka, this jobs works fine on flink 1.3.2. I upgraded cluster to 1.6.1 but now see below error. Has any one faced similar issue?

I have updated all the dependencies to use 
<flink.version>1.6.1</flink.version>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka-0.10_${scala.version}</artifactId>
    <version>${flink.version}</version>
</dependency>

java.lang.NoSuchMethodError: org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup;
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622)
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
	at java.lang.Thread.run(Thread.java:748)

                      

                      
Thanks
Chandu