Re: [DISCUSS] Towards a leaner flink-dist
Posted by
Hequn Cheng on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/DISCUSS-Towards-a-leaner-flink-dist-tp25615p25764.html
Hi Chesnay,
Thanks a lot for the proposal! +1 for a leaner flink-dist and improve the "Download" page.
I think a leaner flink-dist would be very helpful. If we bundle all jars into a single one, this will easily cause class conflict problem.
Best,
Hequn
Hi Chesnay,
Thank you for the proposal. And i like it very much.
+1 for the leaner distribution.
About improve the "Download" page, I think we can add the connectors download link in the "Optional components" section which
[hidden email] mentioned above.
Regards,
Jincheng
Hello,
the binary distribution that we release by now contains quite a lot of
optional components, including various filesystems, metric reporters and
libraries. Most users will only use a fraction of these, and as such
pretty much only increase the size of flink-dist.
With Flink growing more and more in scope I don't believe it to be
feasible to ship everything we have with every distribution, and instead
suggest more of a "pick-what-you-need" model, where flink-dist is rather
lean and additional components are downloaded separately and added by
the user.
This would primarily affect the /opt directory, but could also be
extended to cover flink-dist. For example, the yarn and mesos code could
be spliced out into separate jars that could be added to lib manually.
Let me know what you think.
Regards,
Chesnay