Re: [DISCUSS] Towards a leaner flink-dist

Posted by Chesnay Schepler on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/DISCUSS-Towards-a-leaner-flink-dist-tp25615p25831.html

It is not viable for us, as of right now, to release both a lean and fat
version of flink-dist.
We don't have the required tooling to assemble a correct NOTICE file for
that scenario.

Besides that his would also go against recent efforts to reduce the
total size of a Flink release,
as we'd be increasing the total size again by roughly 60% (and naturally
also increase the compile
time of releases), which I'd like to avoid.

I like Stephans compromise of excluding reporters and file-systems; this
removes more than 100mb
from the distribution yet still retains all the user-facing APIs.

Do note that hadoop will already not be included in convenience binaries
for 1.8 . This was
the motivation behind the new section on the download page.

On 25.01.2019 06:42, Jark Wu wrote:

> +1 for the leaner distribution and improve the "Download" page.
>
> On Fri, 25 Jan 2019 at 01:54, Bowen Li <[hidden email]> wrote:
>
>> +1 for leaner distribution and a better 'download' webpage.
>>
>> +1 for a full distribution if we can automate it besides supporting the
>> leaner one. If we support both, I'd image release managers should be able
>> to package two distributions with a single change of parameter instead of
>> manually package the full distribution. How to achieve that needs to be
>> evaluated and discussed, probably can be something like 'mvn clean install
>> -Dfull/-Dlean', I'm not sure yet.
>>
>>
>> On Wed, Jan 23, 2019 at 10:11 AM Thomas Weise <[hidden email]> wrote:
>>
>>> +1 for trimming the size by default and offering the fat distribution as
>>> alternative download
>>>
>>>
>>> On Wed, Jan 23, 2019 at 8:35 AM Till Rohrmann <[hidden email]>
>>> wrote:
>>>
>>>> Ufuk's proposal (having a lean default release and a user convenience
>>>> tarball) sounds good to me. That way advanced users won't be bothered by
>>>> an
>>>> unnecessarily large release and new users can benefit from having many
>>>> useful extensions bundled in one tarball.
>>>>
>>>> Cheers,
>>>> Till
>>>>
>>>> On Wed, Jan 23, 2019 at 3:42 PM Ufuk Celebi <[hidden email]> wrote:
>>>>
>>>>> On Wed, Jan 23, 2019 at 11:01 AM Timo Walther <[hidden email]>
>>>> wrote:
>>>>>> I think what is more important than a big dist bundle is a helpful
>>>>>> "Downloads" page where users can easily find available filesystems,
>>>>>> connectors, metric repoters. Not everyone checks Maven central for
>>>>>> available JAR files. I just saw that we added a "Optional components"
>>>>>> section recently [1], we just need to make it more prominent. This is
>>>>>> also done for the SQL connectors and formats [2].
>>>>> +1 I fully agree with the importance of the Downloads page. We
>>>>> definitely need to make any optional dependencies that users need to
>>>>> download easy to find.
>>>>>