Migration from flink 1.7.2 to 1.8.0

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Migration from flink 1.7.2 to 1.8.0

Farouk
Hi

We are migrating our app to Flink 1.8.0.

We built a docker image like this as Hadoop is not anymore bundled :


When running Flink, we are facing the stack trace below  : 

java.lang.NullPointerException
at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:284)
at org.apache.flink.streaming.runtime.tasks.OperatorChain.createChainedOperator(OperatorChain.java:360)
at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:296)
at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:133)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:267)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
at java.lang.Thread.run(Thread.java:748)

Any idea on what's happening ?

I think it's a problem with classloading.

With Flink 1.7.2, every thing works fine

Thanks
Farouk
Reply | Threaded
Open this post in threaded view
|

Re: Migration from flink 1.7.2 to 1.8.0

Till Rohrmann
Hi Farouk,

from the stack trace alone I cannot say much. Would it be possible to share a minimal example which reproduces the problem?

My suspicion is that OperatorChain.java:294 produces a null value. Differently, said that somehow there is no StreamConfig registered for the given outputId. What you could check is whether you have compiled the Flink job with Flink 1.8.0 and not 1.7.2? Maybe something changed wrt the output enumeration.

Cheers,
Till

On Tue, May 7, 2019 at 5:34 PM Farouk <[hidden email]> wrote:
Hi

We are migrating our app to Flink 1.8.0.

We built a docker image like this as Hadoop is not anymore bundled :


When running Flink, we are facing the stack trace below  : 

java.lang.NullPointerException
at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:284)
at org.apache.flink.streaming.runtime.tasks.OperatorChain.createChainedOperator(OperatorChain.java:360)
at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:296)
at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:133)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:267)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
at java.lang.Thread.run(Thread.java:748)

Any idea on what's happening ?

I think it's a problem with classloading.

With Flink 1.7.2, every thing works fine

Thanks
Farouk
Reply | Threaded
Open this post in threaded view
|

Re: Migration from flink 1.7.2 to 1.8.0

Farouk
Hi Till

Thanks. I'll check it out.

Farouk

Garanti sans virus. www.avg.com

Le mer. 8 mai 2019 à 16:59, Till Rohrmann <[hidden email]> a écrit :
Hi Farouk,

from the stack trace alone I cannot say much. Would it be possible to share a minimal example which reproduces the problem?

My suspicion is that OperatorChain.java:294 produces a null value. Differently, said that somehow there is no StreamConfig registered for the given outputId. What you could check is whether you have compiled the Flink job with Flink 1.8.0 and not 1.7.2? Maybe something changed wrt the output enumeration.

Cheers,
Till

On Tue, May 7, 2019 at 5:34 PM Farouk <[hidden email]> wrote:
Hi

We are migrating our app to Flink 1.8.0.

We built a docker image like this as Hadoop is not anymore bundled :


When running Flink, we are facing the stack trace below  : 

java.lang.NullPointerException
at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:284)
at org.apache.flink.streaming.runtime.tasks.OperatorChain.createChainedOperator(OperatorChain.java:360)
at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:296)
at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:133)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:267)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
at java.lang.Thread.run(Thread.java:748)

Any idea on what's happening ?

I think it's a problem with classloading.

With Flink 1.7.2, every thing works fine

Thanks
Farouk