Re: data flow example on cluster

Posted by Lydia Ickler on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/data-flow-example-on-cluster-tp2963p3001.html

It is a university cluster which we have to use.

So I am forced to use it :(

How can I bypass that version conflict?

Am 02.10.2015 um 12:07 schrieb Robert Metzger <[hidden email]>:

Are you relying on a feature only available in 0.10-SNAPSHOT?

Otherwise, I would recommend to use the latest stable release (0.9.1) for your flink job and on the cluster.

On Fri, Oct 2, 2015 at 11:55 AM, Lydia Ickler <[hidden email]> wrote:

Hi,

but inside the pom of flunk-job is the flink version set to 0.8

<flink.version>0.8-incubating-SNAPSHOT</flink.version>

how can I change it to the newest?

<flink.version>0.10-SNAPSHOT</flink.version>

Is not working

Am 02.10.2015 um 11:48 schrieb Robert Metzger <[hidden email]>:

I think there is a version mismatch between the Flink version you've used to compile your job and the Flink version installed on the cluster.

Maven automagically pulls newer 0.10-SNAPSHOT versions every time you're building your job.

On Fri, Oct 2, 2015 at 11:45 AM, Lydia Ickler <[hidden email]> wrote:

Hi Till,

I want to execute your Matrix Completion program „ALSJoin“.

Locally it works perfect.

Now I want to execute it on the cluster with:

run -c com.github.projectflink.als.ALSJoin -cp /tmp/icklerly/flink-jobs-0.1-SNAPSHOT.jar 0 2 0.001 10 1 1

but I get the following error:

java.lang.NoSuchMethodError: org.apache.flink.api.scala.typeutils.CaseClassTypeInfo.<init>(Ljava/lang/Class;Lscala/collection/Seq;Lscala/collection/Seq;)V

I guess something like the flink-scala-0.10-SNAPSHOT.jar is missing.

How can I add that to the path?

Best regards,

Lydia