Can flink 1.9.1 use flink-shaded 2.8.3-1.8.2

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Can flink 1.9.1 use flink-shaded 2.8.3-1.8.2

Jeff Zhang
Hi all,

There's no new flink shaded release for flink 1.9, so I'd like to confirm with you can flink 1.9.1 use flink-shaded 2.8.3-1.8.2 ? Or the flink shaded is not necessary for flink 1.9 afterwards ?


--
Best Regards

Jeff Zhang
Reply | Threaded
Open this post in threaded view
|

Re: Can flink 1.9.1 use flink-shaded 2.8.3-1.8.2

vino yang
Hi Jeff,

Maybe [hidden email] could tell you the answer. 

Best,
Vino

Jeff Zhang <[hidden email]> 于2019年10月25日周五 下午3:54写道:
Hi all,

There's no new flink shaded release for flink 1.9, so I'd like to confirm with you can flink 1.9.1 use flink-shaded 2.8.3-1.8.2 ? Or the flink shaded is not necessary for flink 1.9 afterwards ?


--
Best Regards

Jeff Zhang
Reply | Threaded
Open this post in threaded view
|

Re: Can flink 1.9.1 use flink-shaded 2.8.3-1.8.2

Chesnay Schepler
In reply to this post by Jeff Zhang
If you need hadoop, but the approach outlined here doesn't work for you, then you still need a flink-shaded-hadoop-jar that you can download here.

On 25/10/2019 09:54, Jeff Zhang wrote:
Hi all,

There's no new flink shaded release for flink 1.9, so I'd like to confirm with you can flink 1.9.1 use flink-shaded 2.8.3-1.8.2 ? Or the flink shaded is not necessary for flink 1.9 afterwards ?


--
Best Regards

Jeff Zhang


Reply | Threaded
Open this post in threaded view
|

Re: Can flink 1.9.1 use flink-shaded 2.8.3-1.8.2

Jeff Zhang
Thanks Chesnay, is there any document to explain which version of flink-shaded-hadoop-jar should I use for specific version of flink ?
e.g. The document of flink 1.9 here https://flink.apache.org/downloads.html#apache-flink-191 point me to flink-shaded-hadoop-jar 7.0, but the latest version of flink-shaded-hadoop-jar is 8.0, then when should I use flink-shaded-hadoop-jar 8.0 ?

Another question is that whether flink-shaded-hadoop-2-uber 2.8.3-7.0 could be used for hadoop 2.8.5 as well ? I believe so, but want to confirm it. And if it works for all hadoop 2.8.x, then it may make more sense to omit the hadoop minor version, e.g. name it as 2.8-7.0, otherwise it may make user confused.


Chesnay Schepler <[hidden email]> 于2019年10月25日周五 下午4:21写道:
If you need hadoop, but the approach outlined here doesn't work for you, then you still need a flink-shaded-hadoop-jar that you can download here.

On 25/10/2019 09:54, Jeff Zhang wrote:
Hi all,

There's no new flink shaded release for flink 1.9, so I'd like to confirm with you can flink 1.9.1 use flink-shaded 2.8.3-1.8.2 ? Or the flink shaded is not necessary for flink 1.9 afterwards ?


--
Best Regards

Jeff Zhang




--
Best Regards

Jeff Zhang
Reply | Threaded
Open this post in threaded view
|

Re: Can flink 1.9.1 use flink-shaded 2.8.3-1.8.2

Chesnay Schepler
Simple, you pick the version that is listed on the download page for the Flink version you are using.

We have not done any tests as to whether hadoop 2.8.3 works with hadoop 2.8.5 .

On 25/10/2019 10:36, Jeff Zhang wrote:
Thanks Chesnay, is there any document to explain which version of flink-shaded-hadoop-jar should I use for specific version of flink ?
e.g. The document of flink 1.9 here https://flink.apache.org/downloads.html#apache-flink-191 point me to flink-shaded-hadoop-jar 7.0, but the latest version of flink-shaded-hadoop-jar is 8.0, then when should I use flink-shaded-hadoop-jar 8.0 ?

Another question is that whether flink-shaded-hadoop-2-uber 2.8.3-7.0 could be used for hadoop 2.8.5 as well ? I believe so, but want to confirm it. And if it works for all hadoop 2.8.x, then it may make more sense to omit the hadoop minor version, e.g. name it as 2.8-7.0, otherwise it may make user confused.


Chesnay Schepler <[hidden email]> 于2019年10月25日周五 下午4:21写道:
If you need hadoop, but the approach outlined here doesn't work for you, then you still need a flink-shaded-hadoop-jar that you can download here.

On 25/10/2019 09:54, Jeff Zhang wrote:
Hi all,

There's no new flink shaded release for flink 1.9, so I'd like to confirm with you can flink 1.9.1 use flink-shaded 2.8.3-1.8.2 ? Or the flink shaded is not necessary for flink 1.9 afterwards ?


--
Best Regards

Jeff Zhang




--
Best Regards

Jeff Zhang