(DEPRECATED) Apache Flink User Mailing List archive.

Fenzo NoClassDefFoundError: ObjectMapper

classic Classic list List threaded Threaded
♦
♦
 5 messages Options
Jared Stehler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Fenzo NoClassDefFoundError: ObjectMapper

Jared Stehler
Getting the following error on app master startup with flink-mesos 1.4.0:

ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at java.util.concurrent.FutureTask.report(FutureTask.java:122)
    at java.util.concurrent.FutureTask.get(FutureTask.java:192)
    at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
    at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
    at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
...
(17 additional frame(s) were not displayed)

NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
    at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
    at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
    at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
    at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
...
(6 additional frame(s) were not displayed)

ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
...
(10 additional frame(s) were not displayed)


--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703
Jared Stehler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Fenzo NoClassDefFoundError: ObjectMapper

Jared Stehler
I see a shaded jackson class with jackson2 in the package, but none with the path shown below.

--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703



On Dec 14, 2017, at 3:05 PM, Jared Stehler <[hidden email]> wrote:

Getting the following error on app master startup with flink-mesos 1.4.0:

ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at java.util.concurrent.FutureTask.report(FutureTask.java:122)
    at java.util.concurrent.FutureTask.get(FutureTask.java:192)
    at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
    at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
    at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
...
(17 additional frame(s) were not displayed)

NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
    at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
    at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
    at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
    at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
...
(6 additional frame(s) were not displayed)

ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
...
(10 additional frame(s) were not displayed)


--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703
Jared Stehler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Fenzo NoClassDefFoundError: ObjectMapper

Jared Stehler
Possibly missing an include for jackson here in the flink-mesos pom?

<artifactSet>
<includes combine.children="append">
<include>com.google.protobuf:protobuf-java</include>
<include>org.apache.mesos:mesos</include>
<include>com.netflix.fenzo:fenzo-core</include>
</includes>
</artifactSet>
<relocations combine.children="append">
<relocation>
<pattern>com.google.protobuf</pattern>
<shadedPattern>org.apache.flink.mesos.shaded.com.google.protobuf</shadedPattern>
</relocation>
<relocation>
<pattern>com.fasterxml.jackson</pattern>
<shadedPattern>org.apache.flink.mesos.shaded.com.fasterxml.jackson</shadedPattern>
</relocation>
</relocations>

--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703



On Dec 14, 2017, at 3:10 PM, Jared Stehler <[hidden email]> wrote:

I see a shaded jackson class with jackson2 in the package, but none with the path shown below.

--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703



On Dec 14, 2017, at 3:05 PM, Jared Stehler <[hidden email]> wrote:

Getting the following error on app master startup with flink-mesos 1.4.0:

ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at java.util.concurrent.FutureTask.report(FutureTask.java:122)
    at java.util.concurrent.FutureTask.get(FutureTask.java:192)
    at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
    at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
    at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
...
(17 additional frame(s) were not displayed)

NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
    at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
    at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
    at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
    at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
...
(6 additional frame(s) were not displayed)

ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
...
(10 additional frame(s) were not displayed)


--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703
Eron Wright
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Fenzo NoClassDefFoundError: ObjectMapper

Eron Wright
Jared, I think you're correct that the shaded `ObjectMapper` is missing.   Based on the above details and a quick look at the Fenzo code, it appears that this bug is expressed when you've configured some hard constraints that Mesos couldn't satisfy.  Do you agree?  Thanks also for suggesting a fix, would you mind annotating FLINK-8265?


Sorry about this!
 
Eron


On Thu, Dec 14, 2017 at 12:17 PM, Jared Stehler <[hidden email]> wrote:
Possibly missing an include for jackson here in the flink-mesos pom?

<artifactSet>
<includes combine.children="append">
<include>com.google.protobuf:protobuf-java</include>
<include>org.apache.mesos:mesos</include>
<include>com.netflix.fenzo:fenzo-core</include>
</includes>
</artifactSet>
<relocations combine.children="append">
<relocation>
<pattern>com.google.protobuf</pattern>
<shadedPattern>org.apache.flink.mesos.shaded.com.google.protobuf</shadedPattern>
</relocation>
<relocation>
<pattern>com.fasterxml.jackson</pattern>
<shadedPattern>org.apache.flink.mesos.shaded.com.fasterxml.jackson</shadedPattern>
</relocation>
</relocations>

--
Jared Stehler
Chief Architect - Intellify Learning
o: <a href="tel:(617)%20701-6330" value="+16177016330" target="_blank">617.701.6330 x703



On Dec 14, 2017, at 3:10 PM, Jared Stehler <[hidden email]> wrote:

I see a shaded jackson class with jackson2 in the package, but none with the path shown below.

--
Jared Stehler
Chief Architect - Intellify Learning
o: <a href="tel:(617)%20701-6330" value="+16177016330" target="_blank">617.701.6330 x703



On Dec 14, 2017, at 3:05 PM, Jared Stehler <[hidden email]> wrote:

Getting the following error on app master startup with flink-mesos 1.4.0:

ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at java.util.concurrent.FutureTask.report(FutureTask.java:122)
    at java.util.concurrent.FutureTask.get(FutureTask.java:192)
    at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
    at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
    at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
...
(17 additional frame(s) were not displayed)

NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
    at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
    at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
    at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
    at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
...
(6 additional frame(s) were not displayed)

ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
...
(10 additional frame(s) were not displayed)


--
Jared Stehler
Chief Architect - Intellify Learning
o: <a href="tel:(617)%20701-6330" value="+16177016330" target="_blank">617.701.6330 x703
Jared Stehler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Fenzo NoClassDefFoundError: ObjectMapper

Jared Stehler
No problem, thanks! 

--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703



On Dec 14, 2017, at 3:59 PM, Eron Wright <[hidden email]> wrote:

Jared, I think you're correct that the shaded `ObjectMapper` is missing.   Based on the above details and a quick look at the Fenzo code, it appears that this bug is expressed when you've configured some hard constraints that Mesos couldn't satisfy.  Do you agree?  Thanks also for suggesting a fix, would you mind annotating FLINK-8265?


Sorry about this!
 
Eron


On Thu, Dec 14, 2017 at 12:17 PM, Jared Stehler <[hidden email]> wrote:
Possibly missing an include for jackson here in the flink-mesos pom?

<artifactSet>
<includes combine.children="append">
<include>com.google.protobuf:protobuf-java</include>
<include>org.apache.mesos:mesos</include>
<include>com.netflix.fenzo:fenzo-core</include>
</includes>
</artifactSet>
<relocations combine.children="append">
<relocation>
<pattern>com.google.protobuf</pattern>
<shadedPattern>org.apache.flink.mesos.shaded.com.google.protobuf</shadedPattern>
</relocation>
<relocation>
<pattern>com.fasterxml.jackson</pattern>
<shadedPattern>org.apache.flink.mesos.shaded.com.fasterxml.jackson</shadedPattern>
</relocation>
</relocations>

--
Jared Stehler
Chief Architect - Intellify Learning
o: <a href="tel:(617)%20701-6330" value="+16177016330" target="_blank" class="">617.701.6330 x703



On Dec 14, 2017, at 3:10 PM, Jared Stehler <[hidden email]> wrote:

I see a shaded jackson class with jackson2 in the package, but none with the path shown below.

--
Jared Stehler
Chief Architect - Intellify Learning
o: <a href="tel:(617)%20701-6330" value="+16177016330" target="_blank" class="">617.701.6330 x703



On Dec 14, 2017, at 3:05 PM, Jared Stehler <[hidden email]> wrote:

Getting the following error on app master startup with flink-mesos 1.4.0:

ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at java.util.concurrent.FutureTask.report(FutureTask.java:122)
    at java.util.concurrent.FutureTask.get(FutureTask.java:192)
    at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
    at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
    at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
...
(17 additional frame(s) were not displayed)

NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
    at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
    at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
    at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
    at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
...
(6 additional frame(s) were not displayed)

ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
...
(10 additional frame(s) were not displayed)


--
Jared Stehler
Chief Architect - Intellify Learning
o: <a href="tel:(617)%20701-6330" value="+16177016330" target="_blank" class="">617.701.6330 x703
Free forum by Nabble Edit this page