Unable to run the batch examples after running stream examples

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Unable to run the batch examples after running stream examples

subashbasnet
Hello all,

The scenario is I am working on Kafka Read/Write examples. It works fine, but now when I try to run the batch examples such as PiEstimation or any other, I get the following error:

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.flink.api.common.Plan.getRestartStrategyConfiguration()Lorg/apache/flink/api/common/restartstrategy/RestartStrategies$RestartStrategyConfiguration;
at org.apache.flink.optimizer.plantranslate.JobGraphGenerator.compileJobGraph(JobGraphGenerator.java:222)
at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:187)
at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:90)
at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:855)
at org.apache.flink.api.java.DataSet.collect(DataSet.java:410)
at org.apache.flink.examples.java.misc.PiEstimation.main(PiEstimation.java:63)

Previously before running the Kafka examples, the batch examples were working fine, now not. Now only the streaming examples are working. 

Best Regards,
Subash Basnet

Reply | Threaded
Open this post in threaded view
|

Re: Unable to run the batch examples after running stream examples

Chesnay Schepler
where did you run the batch/streaming jobs? did both job use the same flink version?

On 21.03.2016 17:06, subash basnet wrote:
Hello all,

The scenario is I am working on Kafka Read/Write examples. It works fine, but now when I try to run the batch examples such as PiEstimation or any other, I get the following error:

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.flink.api.common.Plan.getRestartStrategyConfiguration()Lorg/apache/flink/api/common/restartstrategy/RestartStrategies$RestartStrategyConfiguration;
at org.apache.flink.optimizer.plantranslate.JobGraphGenerator.compileJobGraph(JobGraphGenerator.java:222)
at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:187)
at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:90)
at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:855)
at org.apache.flink.api.java.DataSet.collect(DataSet.java:410)
at org.apache.flink.examples.java.misc.PiEstimation.main(PiEstimation.java:63)

Previously before running the Kafka examples, the batch examples were working fine, now not. Now only the streaming examples are working. 

Best Regards,
Subash Basnet


Reply | Threaded
Open this post in threaded view
|

Re: Unable to run the batch examples after running stream examples

subashbasnet
In reply to this post by subashbasnet
Hello Chesnay Schepler, 

I am running the latest flink examples from here in eclipse.
I had used the WikipediaAnalysis pom properties/dependency in batch pom as shown below:
            <properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<flink.version>1.0.0</flink.version>
          </properties>
          <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.0.0</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.10</artifactId>
<version>${flink.version}</version>
</dependency>

But the original pom of batch has dependency:
                <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>${project.version}</version>
</dependency>

Shouldn't both the above mean the same? I couldn't find the pom file where 'project.version' property was defined. Yeah it's working when I used the original pom of batch, but I am confused why the modified one is not working. 

Best Regards,
Subash Basnet


On Mon, Mar 21, 2016 at 5:14 PM, Chesnay Schepler <[hidden email]> wrote:
Boxbe This message is eligible for Automatic Cleanup! ([hidden email]) Add cleanup rule | More info

where did you run the batch/streaming jobs? did both job use the same flink version?

On 21.03.2016 17:06, subash basnet wrote:
Hello all,

The scenario is I am working on Kafka Read/Write examples. It works fine, but now when I try to run the batch examples such as PiEstimation or any other, I get the following error:

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.flink.api.common.Plan.getRestartStrategyConfiguration()Lorg/apache/flink/api/common/restartstrategy/RestartStrategies$RestartStrategyConfiguration;
at org.apache.flink.optimizer.plantranslate.JobGraphGenerator.compileJobGraph(JobGraphGenerator.java:222)
at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:187)
at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:90)
at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:855)
at org.apache.flink.api.java.DataSet.collect(DataSet.java:410)
at org.apache.flink.examples.java.misc.PiEstimation.main(PiEstimation.java:63)

Previously before running the Kafka examples, the batch examples were working fine, now not. Now only the streaming examples are working. 

Best Regards,
Subash Basnet




Reply | Threaded
Open this post in threaded view
|

Re: Unable to run the batch examples after running stream examples

Chesnay Schepler
the project.version property is not defined explicitly; it resembles the version of the parent.

Plan#getRestartStrategyConfiguration() exists in Flink 1.0.0, but not in 1.1-SNAPSHOT.

When you set the version to 1.0.0 you may have created this version mismatch.

On 21.03.2016 19:23, subash basnet wrote:
Hello Chesnay Schepler, 

I am running the latest flink examples from here in eclipse.
I had used the WikipediaAnalysis pom properties/dependency in batch pom as shown below:
            <properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<flink.version>1.0.0</flink.version>
          </properties>
          <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.0.0</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.10</artifactId>
<version>${flink.version}</version>
</dependency>

But the original pom of batch has dependency:
                <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>${project.version}</version>
</dependency>

Shouldn't both the above mean the same? I couldn't find the pom file where 'project.version' property was defined. Yeah it's working when I used the original pom of batch, but I am confused why the modified one is not working. 

Best Regards,
Subash Basnet


On Mon, Mar 21, 2016 at 5:14 PM, Chesnay Schepler <[hidden email]> wrote:
Boxbe This message is eligible for Automatic Cleanup! ([hidden email]) Add cleanup rule | More info

where did you run the batch/streaming jobs? did both job use the same flink version?

On 21.03.2016 17:06, subash basnet wrote:
Hello all,

The scenario is I am working on Kafka Read/Write examples. It works fine, but now when I try to run the batch examples such as PiEstimation or any other, I get the following error:

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.flink.api.common.Plan.getRestartStrategyConfiguration()Lorg/apache/flink/api/common/restartstrategy/RestartStrategies$RestartStrategyConfiguration;
at org.apache.flink.optimizer.plantranslate.JobGraphGenerator.compileJobGraph(JobGraphGenerator.java:222)
at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:187)
at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:90)
at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:855)
at org.apache.flink.api.java.DataSet.collect(DataSet.java:410)
at org.apache.flink.examples.java.misc.PiEstimation.main(PiEstimation.java:63)

Previously before running the Kafka examples, the batch examples were working fine, now not. Now only the streaming examples are working. 

Best Regards,
Subash Basnet