Re: Re: Flink and Akka version incompatibility ..

Posted by Jeff Zhang on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-and-Akka-version-incompatibility-tp29000p29011.html

I think it is better to shade all the dependencies of flink so that all the projects that use flink won't hit this kind of issue.

Haibo Sun <[hidden email]> 于2019年7月24日周三 下午4:07写道：

Hi,   Debasish Ghosh

I don't know why not shade Akka, maybe it can be shaded. Chesnay may be able to answer that.

I recommend to shade Akka dependency of your application because it don't be known what's wrong with shading Flink's Akka.

CC  @Chesnay Schepler 

Best,

Haibo

At 2019-07-24 15:48:59, "Debasish Ghosh" <[hidden email]> wrote:

The problem that I am facing is with Akka serialization .. Why not shade the whole of Akka ?

java.lang.AbstractMethodError: akka.remote.RemoteActorRefProvider.serializationInformation()Lakka/serialization/Serialization$Information;
at akka.serialization.Serialization.serializationInformation(Serialization.scala:166)

Akka 2.6 is just around the corner and I don't think Flink will upgrade to Akka 2.6 that soon .. so somehow this problem is bound to recur ..

regards.

On Wed, Jul 24, 2019 at 1:01 PM Zili Chen <[hidden email]> wrote:

I can see that we relocate akka's netty, akka uncommon math but also

be curious why Flink doesn't shaded all of akka dependencies...

Debasish Ghosh <[hidden email]> 于2019年7月24日周三 下午3:15写道：

Hello Haibo -

Yes, my application depends on Akka 2.5. 

Just curious, why do you think it's recommended to shade Akka version of my application instead of Flink ?

regards.

On Wed, Jul 24, 2019 at 12:42 PM Haibo Sun <[hidden email]> wrote:

Hi  Debasish Ghosh,
 

Does your application have to depend on Akka 2.5? If not, it's a good idea to always keep the Akka version that the application depend on in line with Flink. 

If you want to try shading Akka dependency, I think that it is more recommended to shade Akka dependency of your application.

Best,

Haibo

At 2019-07-24 14:31:29, "Debasish Ghosh" <[hidden email]> wrote:

Hello -

An application that uses Akka 2.5 and Flink 1.8.0 gives runtime errors because of version mismatch between Akka that we use and the one that Flink uses (which is Akka 2.4). Anyone tried shading Akka dependency with Flink ? 

Or is there any other alternative way to handle this issue ? I know Flink 1.9 has upgraded to Akka 2.5 but this is (I think) going to be a recurring problem down the line with mismatch between the new releases of Akka and Flink.

regards.

--

--

--

--