(DEPRECATED) Apache Flink User Mailing List archive.

java.lang.NoClassDefFoundError for Keys Class

classic Classic list List threaded Threaded
♦
♦
 7 messages Options
Madhire, Naveen
Reply | Threaded
Open this post in threaded view
♦
♦
|

java.lang.NoClassDefFoundError for Keys Class

Madhire, Naveen

Hey All,

I am getting the below error while executing a simple Kafka-Flink Application.


java.lang.NoClassDefFoundError: org/apache/flink/api/java/operators/Keys




Below are the maven dependencies which I included in my application. 


<dependency>
   <groupId>org.apache.kafka</groupId>
   <artifactId>kafka_2.9.1</artifactId>
   <version>0.8.2.0</version>
</dependency>
 <dependency>
   <groupId>commons-configuration</groupId>
   <artifactId>commons-configuration</artifactId>
   <version>1.10</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-connector-kafka</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-clients</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-streaming-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>junit</groupId>
   <artifactId>junit</artifactId>
   <version>4.12</version>
 </dependency>


I checked the Flink source and couldn’t find the org.apache.flink.api.java.operators.Keys class.
I found org.apache.flink.api.common.operators.Keys instead. Is there any other Flink dependency which I am missing?


Thanks,
Naveen



The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
Stephan Ewen
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: java.lang.NoClassDefFoundError for Keys Class

Stephan Ewen
Hi!

You are using some outdated dependencies. Now, all Scala-dependent Flink artifacts include the Scala Version Suffix (following common conventions)

Please substitute:
  - flink-streaming-java--> flink-streaming-java_2.10
  - flink-clients --> flink-clients_2.10
  - flink-connector-kafka --> flink-connector-kafka-0.8_2.10

That should do it.

FYI:  You can also try to use the latest release candidate, described here: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Release-Apache-Flink-1-0-0-RC5-td10628.html

Greetings,
Stephan


On Thu, Mar 3, 2016 at 10:01 PM, Madhire, Naveen <[hidden email]> wrote:

Hey All,

I am getting the below error while executing a simple Kafka-Flink Application.


java.lang.NoClassDefFoundError: org/apache/flink/api/java/operators/Keys




Below are the maven dependencies which I included in my application. 


<dependency>
   <groupId>org.apache.kafka</groupId>
   <artifactId>kafka_2.9.1</artifactId>
   <version>0.8.2.0</version>
</dependency>
 <dependency>
   <groupId>commons-configuration</groupId>
   <artifactId>commons-configuration</artifactId>
   <version>1.10</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-connector-kafka</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-clients</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-streaming-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>junit</groupId>
   <artifactId>junit</artifactId>
   <version>4.12</version>
 </dependency>


I checked the Flink source and couldn’t find the org.apache.flink.api.java.operators.Keys class.
I found org.apache.flink.api.common.operators.Keys instead. Is there any other Flink dependency which I am missing?


Thanks,
Naveen



The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
Madhire, Naveen
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: java.lang.NoClassDefFoundError for Keys Class

Madhire, Naveen
Thanks Stephan. I am using the new dependencies from the 1.0.0 release candidate.

Now, my application is failing with the below error, 

java.lang.NoClassDefFoundError: scala/concurrent/ExecutionContext

The error is here,


Do I need to include any specific Scala or Akka dependency?


Thanks,
Naveen


From: <[hidden email]> on behalf of Stephan Ewen <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Thursday, March 3, 2016 at 3:49 PM
To: "[hidden email]" <[hidden email]>
Subject: Re: java.lang.NoClassDefFoundError for Keys Class

Hi!

You are using some outdated dependencies. Now, all Scala-dependent Flink artifacts include the Scala Version Suffix (following common conventions)

Please substitute:
  - flink-streaming-java--> flink-streaming-java_2.10
  - flink-clients --> flink-clients_2.10
  - flink-connector-kafka --> flink-connector-kafka-0.8_2.10

That should do it.

FYI:  You can also try to use the latest release candidate, described here: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Release-Apache-Flink-1-0-0-RC5-td10628.html

Greetings,
Stephan


On Thu, Mar 3, 2016 at 10:01 PM, Madhire, Naveen <[hidden email]> wrote:

Hey All,

I am getting the below error while executing a simple Kafka-Flink Application.


java.lang.NoClassDefFoundError: org/apache/flink/api/java/operators/Keys




Below are the maven dependencies which I included in my application. 


<dependency>
   <groupId>org.apache.kafka</groupId>
   <artifactId>kafka_2.9.1</artifactId>
   <version>0.8.2.0</version>
</dependency>
 <dependency>
   <groupId>commons-configuration</groupId>
   <artifactId>commons-configuration</artifactId>
   <version>1.10</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-connector-kafka</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-clients</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-streaming-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>junit</groupId>
   <artifactId>junit</artifactId>
   <version>4.12</version>
 </dependency>


I checked the Flink source and couldn’t find the org.apache.flink.api.java.operators.Keys class.
I found org.apache.flink.api.common.operators.Keys instead. Is there any other Flink dependency which I am missing?


Thanks,
Naveen



The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
Stephan Ewen
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: java.lang.NoClassDefFoundError for Keys Class

Stephan Ewen
Hi!

You actually don't need an extra Akka or Scala dependency.

My suspicion is that you have still some incorrect artifact in the dependencies. Good thing is that these problems disappear when you can reference a stable release.

Is it possible for you to share the complete dependency section of your project?

Thanks,
Stephan


On Fri, Mar 4, 2016 at 7:34 PM, Madhire, Naveen <[hidden email]> wrote:
Thanks Stephan. I am using the new dependencies from the 1.0.0 release candidate.

Now, my application is failing with the below error, 

java.lang.NoClassDefFoundError: scala/concurrent/ExecutionContext

The error is here,


Do I need to include any specific Scala or Akka dependency?


Thanks,
Naveen


From: <[hidden email]> on behalf of Stephan Ewen <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Thursday, March 3, 2016 at 3:49 PM
To: "[hidden email]" <[hidden email]>
Subject: Re: java.lang.NoClassDefFoundError for Keys Class

Hi!

You are using some outdated dependencies. Now, all Scala-dependent Flink artifacts include the Scala Version Suffix (following common conventions)

Please substitute:
  - flink-streaming-java--> flink-streaming-java_2.10
  - flink-clients --> flink-clients_2.10
  - flink-connector-kafka --> flink-connector-kafka-0.8_2.10

That should do it.

FYI:  You can also try to use the latest release candidate, described here: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Release-Apache-Flink-1-0-0-RC5-td10628.html

Greetings,
Stephan


On Thu, Mar 3, 2016 at 10:01 PM, Madhire, Naveen <[hidden email]> wrote:

Hey All,

I am getting the below error while executing a simple Kafka-Flink Application.


java.lang.NoClassDefFoundError: org/apache/flink/api/java/operators/Keys




Below are the maven dependencies which I included in my application. 


<dependency>
   <groupId>org.apache.kafka</groupId>
   <artifactId>kafka_2.9.1</artifactId>
   <version>0.8.2.0</version>
</dependency>
 <dependency>
   <groupId>commons-configuration</groupId>
   <artifactId>commons-configuration</artifactId>
   <version>1.10</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-connector-kafka</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-clients</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-streaming-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>junit</groupId>
   <artifactId>junit</artifactId>
   <version>4.12</version>
 </dependency>


I checked the Flink source and couldn’t find the org.apache.flink.api.java.operators.Keys class.
I found org.apache.flink.api.common.operators.Keys instead. Is there any other Flink dependency which I am missing?


Thanks,
Naveen



The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.



The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
Madhire, Naveen
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: java.lang.NoClassDefFoundError for Keys Class

Madhire, Naveen
Here it is, 

<properties>
  <flink.version>1.0.0</flink.version>
</properties>

<repositories>
  <repository>
    <id>apacherelease</id>
    <name>Apache release</name>
    <url>https://repository.apache.org/content/repositories/orgapacheflink-1069/</url>
    <releases>
      <enabled>true</enabled>
    </releases>
    <snapshots>
      <enabled>false</enabled>
    </snapshots>
  </repository>
</repositories>

<dependencies>
   <dependency>
      <groupId>org.apache.kafka</groupId>
      <artifactId>kafka_2.9.1</artifactId>
      <version>0.8.2.0</version>
   </dependency>
  <dependency>
    <groupId>commons-configuration</groupId>
    <artifactId>commons-configuration</artifactId>
    <version>1.10</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka-0.8_2.10</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients_2.10</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java_2.10</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>junit</groupId>
    <artifactId>junit</artifactId>
    <version>4.12</version>
  </dependency>
  <dependency>
    <groupId>info.batey.kafka</groupId>
    <artifactId>kafka-unit</artifactId>
    <version>0.2</version>
  </dependency>
</dependencies>

Thanks,
Naveen

From: <[hidden email]> on behalf of Stephan Ewen <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Friday, March 4, 2016 at 12:44 PM
To: "[hidden email]" <[hidden email]>
Subject: Re: java.lang.NoClassDefFoundError for Keys Class

Hi!

You actually don't need an extra Akka or Scala dependency.

My suspicion is that you have still some incorrect artifact in the dependencies. Good thing is that these problems disappear when you can reference a stable release.

Is it possible for you to share the complete dependency section of your project?

Thanks,
Stephan


On Fri, Mar 4, 2016 at 7:34 PM, Madhire, Naveen <[hidden email]> wrote:
Thanks Stephan. I am using the new dependencies from the 1.0.0 release candidate.

Now, my application is failing with the below error, 

java.lang.NoClassDefFoundError: scala/concurrent/ExecutionContext

The error is here,


Do I need to include any specific Scala or Akka dependency?


Thanks,
Naveen


From: <[hidden email]> on behalf of Stephan Ewen <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Thursday, March 3, 2016 at 3:49 PM
To: "[hidden email]" <[hidden email]>
Subject: Re: java.lang.NoClassDefFoundError for Keys Class

Hi!

You are using some outdated dependencies. Now, all Scala-dependent Flink artifacts include the Scala Version Suffix (following common conventions)

Please substitute:
  - flink-streaming-java--> flink-streaming-java_2.10
  - flink-clients --> flink-clients_2.10
  - flink-connector-kafka --> flink-connector-kafka-0.8_2.10

That should do it.

FYI:  You can also try to use the latest release candidate, described here: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Release-Apache-Flink-1-0-0-RC5-td10628.html

Greetings,
Stephan


On Thu, Mar 3, 2016 at 10:01 PM, Madhire, Naveen <[hidden email]> wrote:

Hey All,

I am getting the below error while executing a simple Kafka-Flink Application.


java.lang.NoClassDefFoundError: org/apache/flink/api/java/operators/Keys




Below are the maven dependencies which I included in my application. 


<dependency>
   <groupId>org.apache.kafka</groupId>
   <artifactId>kafka_2.9.1</artifactId>
   <version>0.8.2.0</version>
</dependency>
 <dependency>
   <groupId>commons-configuration</groupId>
   <artifactId>commons-configuration</artifactId>
   <version>1.10</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-connector-kafka</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-clients</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-streaming-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>junit</groupId>
   <artifactId>junit</artifactId>
   <version>4.12</version>
 </dependency>


I checked the Flink source and couldn’t find the org.apache.flink.api.java.operators.Keys class.
I found org.apache.flink.api.common.operators.Keys instead. Is there any other Flink dependency which I am missing?


Thanks,
Naveen



The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
rmetzger0
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: java.lang.NoClassDefFoundError for Keys Class

rmetzger0
The problem is probably this dependency:

 <dependency>
      <groupId>org.apache.kafka</groupId>
      <artifactId>kafka_2.9.1</artifactId>
      <version>0.8.2.0</version>
   </dependency>

Since it pulls Scala 2.9. You can probably remove this dependency because our kafka connector will also pull also that kafka dependency.

On Fri, Mar 4, 2016 at 8:07 PM, Madhire, Naveen <[hidden email]> wrote:
Here it is, 

<properties>
  <flink.version>1.0.0</flink.version>
</properties>

<repositories>
  <repository>
    <id>apacherelease</id>
    <name>Apache release</name>
    <url>https://repository.apache.org/content/repositories/orgapacheflink-1069/</url>
    <releases>
      <enabled>true</enabled>
    </releases>
    <snapshots>
      <enabled>false</enabled>
    </snapshots>
  </repository>
</repositories>

<dependencies>
   <dependency>
      <groupId>org.apache.kafka</groupId>
      <artifactId>kafka_2.9.1</artifactId>
      <version>0.8.2.0</version>
   </dependency>
  <dependency>
    <groupId>commons-configuration</groupId>
    <artifactId>commons-configuration</artifactId>
    <version>1.10</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka-0.8_2.10</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients_2.10</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java_2.10</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>junit</groupId>
    <artifactId>junit</artifactId>
    <version>4.12</version>
  </dependency>
  <dependency>
    <groupId>info.batey.kafka</groupId>
    <artifactId>kafka-unit</artifactId>
    <version>0.2</version>
  </dependency>
</dependencies>

Thanks,
Naveen

From: <[hidden email]> on behalf of Stephan Ewen <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Friday, March 4, 2016 at 12:44 PM

To: "[hidden email]" <[hidden email]>
Subject: Re: java.lang.NoClassDefFoundError for Keys Class

Hi!

You actually don't need an extra Akka or Scala dependency.

My suspicion is that you have still some incorrect artifact in the dependencies. Good thing is that these problems disappear when you can reference a stable release.

Is it possible for you to share the complete dependency section of your project?

Thanks,
Stephan


On Fri, Mar 4, 2016 at 7:34 PM, Madhire, Naveen <[hidden email]> wrote:
Thanks Stephan. I am using the new dependencies from the 1.0.0 release candidate.

Now, my application is failing with the below error, 

java.lang.NoClassDefFoundError: scala/concurrent/ExecutionContext

The error is here,


Do I need to include any specific Scala or Akka dependency?


Thanks,
Naveen


From: <[hidden email]> on behalf of Stephan Ewen <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Thursday, March 3, 2016 at 3:49 PM
To: "[hidden email]" <[hidden email]>
Subject: Re: java.lang.NoClassDefFoundError for Keys Class

Hi!

You are using some outdated dependencies. Now, all Scala-dependent Flink artifacts include the Scala Version Suffix (following common conventions)

Please substitute:
  - flink-streaming-java--> flink-streaming-java_2.10
  - flink-clients --> flink-clients_2.10
  - flink-connector-kafka --> flink-connector-kafka-0.8_2.10

That should do it.

FYI:  You can also try to use the latest release candidate, described here: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Release-Apache-Flink-1-0-0-RC5-td10628.html

Greetings,
Stephan


On Thu, Mar 3, 2016 at 10:01 PM, Madhire, Naveen <[hidden email]> wrote:

Hey All,

I am getting the below error while executing a simple Kafka-Flink Application.


java.lang.NoClassDefFoundError: org/apache/flink/api/java/operators/Keys




Below are the maven dependencies which I included in my application. 


<dependency>
   <groupId>org.apache.kafka</groupId>
   <artifactId>kafka_2.9.1</artifactId>
   <version>0.8.2.0</version>
</dependency>
 <dependency>
   <groupId>commons-configuration</groupId>
   <artifactId>commons-configuration</artifactId>
   <version>1.10</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-connector-kafka</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-clients</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-streaming-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>junit</groupId>
   <artifactId>junit</artifactId>
   <version>4.12</version>
 </dependency>


I checked the Flink source and couldn’t find the org.apache.flink.api.java.operators.Keys class.
I found org.apache.flink.api.common.operators.Keys instead. Is there any other Flink dependency which I am missing?


Thanks,
Naveen



The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.



The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
Madhire, Naveen
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: java.lang.NoClassDefFoundError for Keys Class

Madhire, Naveen
Its working now. Thanks Robert and Stephan.

From: Robert Metzger <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Friday, March 4, 2016 at 1:09 PM
To: "[hidden email]" <[hidden email]>
Subject: Re: java.lang.NoClassDefFoundError for Keys Class

The problem is probably this dependency: 

 <dependency>
      <groupId>org.apache.kafka</groupId>
      <artifactId>kafka_2.9.1</artifactId>
      <version>0.8.2.0</version>
   </dependency>

Since it pulls Scala 2.9. You can probably remove this dependency because our kafka connector will also pull also that kafka dependency.

On Fri, Mar 4, 2016 at 8:07 PM, Madhire, Naveen <[hidden email]> wrote:
Here it is, 

<properties>
  <flink.version>1.0.0</flink.version>
</properties>

<repositories>
  <repository>
    <id>apacherelease</id>
    <name>Apache release</name>
    <url>https://repository.apache.org/content/repositories/orgapacheflink-1069/</url>
    <releases>
      <enabled>true</enabled>
    </releases>
    <snapshots>
      <enabled>false</enabled>
    </snapshots>
  </repository>
</repositories>

<dependencies>
   <dependency>
      <groupId>org.apache.kafka</groupId>
      <artifactId>kafka_2.9.1</artifactId>
      <version>0.8.2.0</version>
   </dependency>
  <dependency>
    <groupId>commons-configuration</groupId>
    <artifactId>commons-configuration</artifactId>
    <version>1.10</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka-0.8_2.10</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients_2.10</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java_2.10</artifactId>
    <version>${flink.version}</version>
  </dependency>
  <dependency>
    <groupId>junit</groupId>
    <artifactId>junit</artifactId>
    <version>4.12</version>
  </dependency>
  <dependency>
    <groupId>info.batey.kafka</groupId>
    <artifactId>kafka-unit</artifactId>
    <version>0.2</version>
  </dependency>
</dependencies>

Thanks,
Naveen

From: <[hidden email]> on behalf of Stephan Ewen <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Friday, March 4, 2016 at 12:44 PM

To: "[hidden email]" <[hidden email]>
Subject: Re: java.lang.NoClassDefFoundError for Keys Class

Hi!

You actually don't need an extra Akka or Scala dependency.

My suspicion is that you have still some incorrect artifact in the dependencies. Good thing is that these problems disappear when you can reference a stable release.

Is it possible for you to share the complete dependency section of your project?

Thanks,
Stephan


On Fri, Mar 4, 2016 at 7:34 PM, Madhire, Naveen <[hidden email]> wrote:
Thanks Stephan. I am using the new dependencies from the 1.0.0 release candidate.

Now, my application is failing with the below error, 

java.lang.NoClassDefFoundError: scala/concurrent/ExecutionContext

The error is here,


Do I need to include any specific Scala or Akka dependency?


Thanks,
Naveen


From: <[hidden email]> on behalf of Stephan Ewen <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Thursday, March 3, 2016 at 3:49 PM
To: "[hidden email]" <[hidden email]>
Subject: Re: java.lang.NoClassDefFoundError for Keys Class

Hi!

You are using some outdated dependencies. Now, all Scala-dependent Flink artifacts include the Scala Version Suffix (following common conventions)

Please substitute:
  - flink-streaming-java--> flink-streaming-java_2.10
  - flink-clients --> flink-clients_2.10
  - flink-connector-kafka --> flink-connector-kafka-0.8_2.10

That should do it.

FYI:  You can also try to use the latest release candidate, described here: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Release-Apache-Flink-1-0-0-RC5-td10628.html

Greetings,
Stephan


On Thu, Mar 3, 2016 at 10:01 PM, Madhire, Naveen <[hidden email]> wrote:

Hey All,

I am getting the below error while executing a simple Kafka-Flink Application.


java.lang.NoClassDefFoundError: org/apache/flink/api/java/operators/Keys




Below are the maven dependencies which I included in my application. 


<dependency>
   <groupId>org.apache.kafka</groupId>
   <artifactId>kafka_2.9.1</artifactId>
   <version>0.8.2.0</version>
</dependency>
 <dependency>
   <groupId>commons-configuration</groupId>
   <artifactId>commons-configuration</artifactId>
   <version>1.10</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-connector-kafka</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-clients</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>org.apache.flink</groupId>
   <artifactId>flink-streaming-java</artifactId>
   <version>1.0-SNAPSHOT</version>
 </dependency>
 <dependency>
   <groupId>junit</groupId>
   <artifactId>junit</artifactId>
   <version>4.12</version>
 </dependency>


I checked the Flink source and couldn’t find the org.apache.flink.api.java.operators.Keys class.
I found org.apache.flink.api.common.operators.Keys instead. Is there any other Flink dependency which I am missing?


Thanks,
Naveen



The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
Free forum by Nabble Edit this page