(DEPRECATED) Apache Flink User Mailing List archive.

Flink and sbt

classic Classic list List threaded Threaded
♦
♦
 5 messages Options
Giancarlo Pagano
Reply | Threaded
Open this post in threaded view
♦
♦
|

Flink and sbt

Giancarlo Pagano
Hi,

I’m trying to write a simple test project using Flink streaming and sbt. The project is in scala and it’s basically the set version of the maven archetype.
I’m using the latest Flink 0.10-SNAPSHOT, building it for scala 2.11. I’ve written a simple test that starts a local environment, creates a stream from a collection and applies a map transformation.
When running the test from sbt I get a ClassNotFoundException. When running the test from Intellij everything is fine.
Could anyone please help with this? Following is the stack trace of the error.

Thanks,
Giancarlo

org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:414)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LeaderSessionMessageFilter$$anonfun$receive$1.applyOrElse(LeaderSessionMessageFilter.scala:36)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28)
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:104)
...
Cause: java.lang.Exception: Could not load the task's invokable class.
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:726)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
...
Cause: java.lang.ClassNotFoundException: org.apache.flink.streaming.runtime.tasks.OneInputStreamTask
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:722)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
Anwar Rizal
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink and sbt

Anwar Rizal
Can you share the build.sbt or the scala , and maybe a small portion of the code ?


On Wed, Sep 9, 2015 at 12:27 PM, Giancarlo Pagano <[hidden email]> wrote:
Hi,

I’m trying to write a simple test project using Flink streaming and sbt. The project is in scala and it’s basically the set version of the maven archetype.
I’m using the latest Flink 0.10-SNAPSHOT, building it for scala 2.11. I’ve written a simple test that starts a local environment, creates a stream from a collection and applies a map transformation.
When running the test from sbt I get a ClassNotFoundException. When running the test from Intellij everything is fine.
Could anyone please help with this? Following is the stack trace of the error.

Thanks,
Giancarlo

org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:414)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LeaderSessionMessageFilter$$anonfun$receive$1.applyOrElse(LeaderSessionMessageFilter.scala:36)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28)
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:104)
...
Cause: java.lang.Exception: Could not load the task's invokable class.
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:726)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
...
Cause: java.lang.ClassNotFoundException: org.apache.flink.streaming.runtime.tasks.OneInputStreamTask
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:722)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
Giancarlo Pagano
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink and sbt

Giancarlo Pagano
I’ve actually found the problem in the meanwhile, build.sbt was missing 'fork := true'.
Sorry about that.

Thanks,
Giancarlo



On 9 Sep 2015, at 11:43, Anwar Rizal <[hidden email]> wrote:

Can you share the build.sbt or the scala , and maybe a small portion of the code ?


On Wed, Sep 9, 2015 at 12:27 PM, Giancarlo Pagano <[hidden email]> wrote:
Hi,

I’m trying to write a simple test project using Flink streaming and sbt. The project is in scala and it’s basically the set version of the maven archetype.
I’m using the latest Flink 0.10-SNAPSHOT, building it for scala 2.11. I’ve written a simple test that starts a local environment, creates a stream from a collection and applies a map transformation.
When running the test from sbt I get a ClassNotFoundException. When running the test from Intellij everything is fine.
Could anyone please help with this? Following is the stack trace of the error.

Thanks,
Giancarlo

org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:414)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LeaderSessionMessageFilter$$anonfun$receive$1.applyOrElse(LeaderSessionMessageFilter.scala:36)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28)
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:104)
...
Cause: java.lang.Exception: Could not load the task's invokable class.
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:726)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
...
Cause: java.lang.ClassNotFoundException: org.apache.flink.streaming.runtime.tasks.OneInputStreamTask
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:722)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
rmetzger0
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink and sbt

rmetzger0
Damn. I saw this discussion too late. I think the "fork = true" is documented here: https://ci.apache.org/projects/flink/flink-docs-release-0.9/quickstart/scala_api_quickstart.html#alternative-build-tools-sbt

On Wed, Sep 9, 2015 at 2:46 PM, Giancarlo Pagano <[hidden email]> wrote:
I’ve actually found the problem in the meanwhile, build.sbt was missing 'fork := true'.
Sorry about that.

Thanks,
Giancarlo




On 9 Sep 2015, at 11:43, Anwar Rizal <[hidden email]> wrote:

Can you share the build.sbt or the scala , and maybe a small portion of the code ?


On Wed, Sep 9, 2015 at 12:27 PM, Giancarlo Pagano <[hidden email]> wrote:
Hi,

I’m trying to write a simple test project using Flink streaming and sbt. The project is in scala and it’s basically the set version of the maven archetype.
I’m using the latest Flink 0.10-SNAPSHOT, building it for scala 2.11. I’ve written a simple test that starts a local environment, creates a stream from a collection and applies a map transformation.
When running the test from sbt I get a ClassNotFoundException. When running the test from Intellij everything is fine.
Could anyone please help with this? Following is the stack trace of the error.

Thanks,
Giancarlo

org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:414)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LeaderSessionMessageFilter$$anonfun$receive$1.applyOrElse(LeaderSessionMessageFilter.scala:36)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28)
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:104)
...
Cause: java.lang.Exception: Could not load the task's invokable class.
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:726)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
...
Cause: java.lang.ClassNotFoundException: org.apache.flink.streaming.runtime.tasks.OneInputStreamTask
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:722)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
Giancarlo Pagano
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink and sbt

Giancarlo Pagano
Yes, it says 'fork in run := true’, I had forgotten to change it to ‘fork := true’ to make it work with the test tasks too.

On 9 Sep 2015, at 13:48, Robert Metzger <[hidden email]> wrote:

Damn. I saw this discussion too late. I think the "fork = true" is documented here: https://ci.apache.org/projects/flink/flink-docs-release-0.9/quickstart/scala_api_quickstart.html#alternative-build-tools-sbt

On Wed, Sep 9, 2015 at 2:46 PM, Giancarlo Pagano <[hidden email]> wrote:
I’ve actually found the problem in the meanwhile, build.sbt was missing 'fork := true'.
Sorry about that.

Thanks,
Giancarlo




On 9 Sep 2015, at 11:43, Anwar Rizal <[hidden email]> wrote:

Can you share the build.sbt or the scala , and maybe a small portion of the code ?


On Wed, Sep 9, 2015 at 12:27 PM, Giancarlo Pagano <[hidden email]> wrote:
Hi,

I’m trying to write a simple test project using Flink streaming and sbt. The project is in scala and it’s basically the set version of the maven archetype.
I’m using the latest Flink 0.10-SNAPSHOT, building it for scala 2.11. I’ve written a simple test that starts a local environment, creates a stream from a collection and applies a map transformation.
When running the test from sbt I get a ClassNotFoundException. When running the test from Intellij everything is fine.
Could anyone please help with this? Following is the stack trace of the error.

Thanks,
Giancarlo

org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:414)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LeaderSessionMessageFilter$$anonfun$receive$1.applyOrElse(LeaderSessionMessageFilter.scala:36)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33)
at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28)
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:104)
...
Cause: java.lang.Exception: Could not load the task's invokable class.
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:726)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
...
Cause: java.lang.ClassNotFoundException: org.apache.flink.streaming.runtime.tasks.OneInputStreamTask
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:722)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:471)
at java.lang.Thread.run(Thread.java:745)
Free forum by Nabble Edit this page