(DEPRECATED) Apache Flink User Mailing List archive.

kafka and flink integration issue

classic Classic list List threaded Threaded
♦
♦
 6 messages Options
Pankaj Kumar
Reply | Threaded
Open this post in threaded view
♦
♦
|

kafka and flink integration issue

Pankaj Kumar
I am trying to integrate kafka and flink.
my pom file is where {flink.version} is 0.10.2
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>com.fasterxml.jackson.core</groupId>
    <artifactId>jackson-databind</artifactId>
    <version>2.6.4</version>
</dependency>
<dependency>
    <groupId>org.projectlombok</groupId>
    <artifactId>lombok</artifactId>
    <version>1.16.6</version>
    <scope>provided</scope>
</dependency>
<dependency>
    <groupId>org.springframework</groupId>
    <artifactId>spring-web</artifactId>
    <version>4.2.4.RELEASE</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka</artifactId>
    <version>${flink.version}</version>
</dependency>
when i am running my jar with flink command line using command
bin/flink run ~/apache_flink/target/Application-0.0.1.jar
I am getting error
tatus of job d20986a31f2a8166986d7db354de0ff7 changed to FAILED.
java.lang.NoSuchMethodError: org.apache.flink.streaming.api.operators.StreamingRuntimeContext.isCheckpointingEnabled()Z
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:387)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:55)

I am building final jar using command mvn clean package -Pbuild-jar
rmetzger0
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: kafka and flink integration issue

rmetzger0
Hi Pankaj,

I suspect you are trying to start Flink on a cluster with Flink 0.10.1 installed?

On Sat, Feb 27, 2016 at 9:20 AM, Pankaj Kumar <[hidden email]> wrote:
I am trying to integrate kafka and flink.
my pom file is where {flink.version} is 0.10.2
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>com.fasterxml.jackson.core</groupId>
    <artifactId>jackson-databind</artifactId>
    <version>2.6.4</version>
</dependency>
<dependency>
    <groupId>org.projectlombok</groupId>
    <artifactId>lombok</artifactId>
    <version>1.16.6</version>
    <scope>provided</scope>
</dependency>
<dependency>
    <groupId>org.springframework</groupId>
    <artifactId>spring-web</artifactId>
    <version>4.2.4.RELEASE</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka</artifactId>
    <version>${flink.version}</version>
</dependency>
when i am running my jar with flink command line using command
bin/flink run ~/apache_flink/target/Application-0.0.1.jar
I am getting error
tatus of job d20986a31f2a8166986d7db354de0ff7 changed to FAILED.
java.lang.NoSuchMethodError: org.apache.flink.streaming.api.operators.StreamingRuntimeContext.isCheckpointingEnabled()Z
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:387)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:55)

I am building final jar using command mvn clean package -Pbuild-jar
Pankaj Kumar
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: kafka and flink integration issue

Pankaj Kumar
Yes Robert , 
i was trying to start Flink on cluster 0.10.1.

But after changing flink version to 0.10.1 , also i am getting the same error.

On Sat, Feb 27, 2016 at 2:47 PM, Robert Metzger <[hidden email]> wrote:
Hi Pankaj,

I suspect you are trying to start Flink on a cluster with Flink 0.10.1 installed?

On Sat, Feb 27, 2016 at 9:20 AM, Pankaj Kumar <[hidden email]> wrote:
I am trying to integrate kafka and flink.
my pom file is where {flink.version} is 0.10.2
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>com.fasterxml.jackson.core</groupId>
    <artifactId>jackson-databind</artifactId>
    <version>2.6.4</version>
</dependency>
<dependency>
    <groupId>org.projectlombok</groupId>
    <artifactId>lombok</artifactId>
    <version>1.16.6</version>
    <scope>provided</scope>
</dependency>
<dependency>
    <groupId>org.springframework</groupId>
    <artifactId>spring-web</artifactId>
    <version>4.2.4.RELEASE</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka</artifactId>
    <version>${flink.version}</version>
</dependency>
when i am running my jar with flink command line using command
bin/flink run ~/apache_flink/target/Application-0.0.1.jar
I am getting error
tatus of job d20986a31f2a8166986d7db354de0ff7 changed to FAILED.
java.lang.NoSuchMethodError: org.apache.flink.streaming.api.operators.StreamingRuntimeContext.isCheckpointingEnabled()Z
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:387)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:55)

I am building final jar using command mvn clean package -Pbuild-jar
Stephan Ewen
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: kafka and flink integration issue

Stephan Ewen
Hi!

A "NoSuchMethodError" is always a sign of a version mixup. Please make sure both versions (cluster and client) are exactly the same.

Stephan


On Sat, Feb 27, 2016 at 11:05 AM, Pankaj Kumar <[hidden email]> wrote:
Yes Robert , 
i was trying to start Flink on cluster 0.10.1.

But after changing flink version to 0.10.1 , also i am getting the same error.

On Sat, Feb 27, 2016 at 2:47 PM, Robert Metzger <[hidden email]> wrote:
Hi Pankaj,

I suspect you are trying to start Flink on a cluster with Flink 0.10.1 installed?

On Sat, Feb 27, 2016 at 9:20 AM, Pankaj Kumar <[hidden email]> wrote:
I am trying to integrate kafka and flink.
my pom file is where {flink.version} is 0.10.2
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>com.fasterxml.jackson.core</groupId>
    <artifactId>jackson-databind</artifactId>
    <version>2.6.4</version>
</dependency>
<dependency>
    <groupId>org.projectlombok</groupId>
    <artifactId>lombok</artifactId>
    <version>1.16.6</version>
    <scope>provided</scope>
</dependency>
<dependency>
    <groupId>org.springframework</groupId>
    <artifactId>spring-web</artifactId>
    <version>4.2.4.RELEASE</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka</artifactId>
    <version>${flink.version}</version>
</dependency>
when i am running my jar with flink command line using command
bin/flink run ~/apache_flink/target/Application-0.0.1.jar
I am getting error
tatus of job d20986a31f2a8166986d7db354de0ff7 changed to FAILED.
java.lang.NoSuchMethodError: org.apache.flink.streaming.api.operators.StreamingRuntimeContext.isCheckpointingEnabled()Z
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:387)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:55)

I am building final jar using command mvn clean package -Pbuild-jar
Pankaj Kumar
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: kafka and flink integration issue

Pankaj Kumar
yes versioning was issue . Job is working fine on flink 0.10.2.

On Mon, Feb 29, 2016 at 3:15 PM, Stephan Ewen <[hidden email]> wrote:
Hi!

A "NoSuchMethodError" is always a sign of a version mixup. Please make sure both versions (cluster and client) are exactly the same.

Stephan


On Sat, Feb 27, 2016 at 11:05 AM, Pankaj Kumar <[hidden email]> wrote:
Yes Robert , 
i was trying to start Flink on cluster 0.10.1.

But after changing flink version to 0.10.1 , also i am getting the same error.

On Sat, Feb 27, 2016 at 2:47 PM, Robert Metzger <[hidden email]> wrote:
Hi Pankaj,

I suspect you are trying to start Flink on a cluster with Flink 0.10.1 installed?

On Sat, Feb 27, 2016 at 9:20 AM, Pankaj Kumar <[hidden email]> wrote:
I am trying to integrate kafka and flink.
my pom file is where {flink.version} is 0.10.2
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>com.fasterxml.jackson.core</groupId>
    <artifactId>jackson-databind</artifactId>
    <version>2.6.4</version>
</dependency>
<dependency>
    <groupId>org.projectlombok</groupId>
    <artifactId>lombok</artifactId>
    <version>1.16.6</version>
    <scope>provided</scope>
</dependency>
<dependency>
    <groupId>org.springframework</groupId>
    <artifactId>spring-web</artifactId>
    <version>4.2.4.RELEASE</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka</artifactId>
    <version>${flink.version}</version>
</dependency>
when i am running my jar with flink command line using command
bin/flink run ~/apache_flink/target/Application-0.0.1.jar
I am getting error
tatus of job d20986a31f2a8166986d7db354de0ff7 changed to FAILED.
java.lang.NoSuchMethodError: org.apache.flink.streaming.api.operators.StreamingRuntimeContext.isCheckpointingEnabled()Z
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:387)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:55)

I am building final jar using command mvn clean package -Pbuild-jar
Stephan Ewen
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: kafka and flink integration issue

Stephan Ewen
Good to hear. Thanks for letting us know!

On Mon, Feb 29, 2016 at 8:14 PM, Pankaj Kumar <[hidden email]> wrote:
yes versioning was issue . Job is working fine on flink 0.10.2.

On Mon, Feb 29, 2016 at 3:15 PM, Stephan Ewen <[hidden email]> wrote:
Hi!

A "NoSuchMethodError" is always a sign of a version mixup. Please make sure both versions (cluster and client) are exactly the same.

Stephan


On Sat, Feb 27, 2016 at 11:05 AM, Pankaj Kumar <[hidden email]> wrote:
Yes Robert , 
i was trying to start Flink on cluster 0.10.1.

But after changing flink version to 0.10.1 , also i am getting the same error.

On Sat, Feb 27, 2016 at 2:47 PM, Robert Metzger <[hidden email]> wrote:
Hi Pankaj,

I suspect you are trying to start Flink on a cluster with Flink 0.10.1 installed?

On Sat, Feb 27, 2016 at 9:20 AM, Pankaj Kumar <[hidden email]> wrote:
I am trying to integrate kafka and flink.
my pom file is where {flink.version} is 0.10.2
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>com.fasterxml.jackson.core</groupId>
    <artifactId>jackson-databind</artifactId>
    <version>2.6.4</version>
</dependency>
<dependency>
    <groupId>org.projectlombok</groupId>
    <artifactId>lombok</artifactId>
    <version>1.16.6</version>
    <scope>provided</scope>
</dependency>
<dependency>
    <groupId>org.springframework</groupId>
    <artifactId>spring-web</artifactId>
    <version>4.2.4.RELEASE</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka</artifactId>
    <version>${flink.version}</version>
</dependency>
when i am running my jar with flink command line using command
bin/flink run ~/apache_flink/target/Application-0.0.1.jar
I am getting error
tatus of job d20986a31f2a8166986d7db354de0ff7 changed to FAILED.
java.lang.NoSuchMethodError: org.apache.flink.streaming.api.operators.StreamingRuntimeContext.isCheckpointingEnabled()Z
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:387)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:55)

I am building final jar using command mvn clean package -Pbuild-jar
Free forum by Nabble Edit this page