some questions about flink packaging

[Marvin777]

hi, all:

The flink-dist package downloaded from the flink community does not have the dependencies of Jackson and protobuf, like figure 1.
But when I pull the code from github and compile and package it using the mvn clean package command, flink-dist has dependencies on Jackson and protobuf, like figure 2.

Am I forgetting something? Who knows why.

Thanks.

figure 1 

figure 2  

[Flavio Pompermaier]

From some version of Flink many libraries (included jackson) are shaded into org.apache.flink.shaded in order to avoid conflicts during class loading.

See https://github.com/apache/flink-shaded 

Best,

Flavio

On Wed, Jul 10, 2019 at 10:21 AM Marvin777 <[hidden email]> wrote:

hi, all:

The flink-dist package downloaded from the flink community does not have the dependencies of Jackson and protobuf, like figure 1.
But when I pull the code from github and compile and package it using the mvn clean package command, flink-dist has dependencies on Jackson and protobuf, like figure 2.

Am I forgetting something? Who knows why.

Thanks.

figure 1 

figure 2  

[Flavio Pompermaier]

For your specific problem try to look at https://ci.apache.org/projects/flink/flink-docs-stable/flinkDev/building.html#dependency-shading.

Which version of maven are you using?

On Wed, Jul 10, 2019 at 10:25 AM Flavio Pompermaier <[hidden email]> wrote:

From some version of Flink many libraries (included jackson) are shaded into org.apache.flink.shaded in order to avoid conflicts during class loading.

See https://github.com/apache/flink-shaded 

Best,

Flavio

On Wed, Jul 10, 2019 at 10:21 AM Marvin777 <[hidden email]> wrote:

hi, all:

The flink-dist package downloaded from the flink community does not have the dependencies of Jackson and protobuf, like figure 1.
But when I pull the code from github and compile and package it using the mvn clean package command, flink-dist has dependencies on Jackson and protobuf, like figure 2.

Am I forgetting something? Who knows why.

Thanks.

figure 1 

figure 2  

[Marvin777]

The version of maven is 3.5.4.

Flavio Pompermaier <[hidden email]> 于2019年7月10日周三 下午4:28写道：

For your specific problem try to look at https://ci.apache.org/projects/flink/flink-docs-stable/flinkDev/building.html#dependency-shading.

Which version of maven are you using?

On Wed, Jul 10, 2019 at 10:25 AM Flavio Pompermaier <[hidden email]> wrote:

From some version of Flink many libraries (included jackson) are shaded into org.apache.flink.shaded in order to avoid conflicts during class loading.

See https://github.com/apache/flink-shaded 

Best,

Flavio

On Wed, Jul 10, 2019 at 10:21 AM Marvin777 <[hidden email]> wrote:

hi, all:

The flink-dist package downloaded from the flink community does not have the dependencies of Jackson and protobuf, like figure 1.
But when I pull the code from github and compile and package it using the mvn clean package command, flink-dist has dependencies on Jackson and protobuf, like figure 2.

Am I forgetting something? Who knows why.

Thanks.

figure 1 

figure 2  

[Flavio Pompermaier]

Have you tried to follow the instruction to build Flink for Maven >= 3.4? That is:

mvn clean install -DskipTests
cd flink-dist
mvn clean install

On Wed, Jul 10, 2019 at 10:34 AM Marvin777 <[hidden email]> wrote:

The version of maven is 3.5.4.

Flavio Pompermaier <[hidden email]> 于2019年7月10日周三 下午4:28写道：

For your specific problem try to look at https://ci.apache.org/projects/flink/flink-docs-stable/flinkDev/building.html#dependency-shading.

Which version of maven are you using?

On Wed, Jul 10, 2019 at 10:25 AM Flavio Pompermaier <[hidden email]> wrote:

From some version of Flink many libraries (included jackson) are shaded into org.apache.flink.shaded in order to avoid conflicts during class loading.

See https://github.com/apache/flink-shaded 

Best,

Flavio

On Wed, Jul 10, 2019 at 10:21 AM Marvin777 <[hidden email]> wrote:

hi, all:

The flink-dist package downloaded from the flink community does not have the dependencies of Jackson and protobuf, like figure 1.
But when I pull the code from github and compile and package it using the mvn clean package command, flink-dist has dependencies on Jackson and protobuf, like figure 2.

Am I forgetting something? Who knows why.

Thanks.

figure 1 

figure 2  

[Marvin777]

it works.

thanks very much.

Flavio Pompermaier <[hidden email]> 于2019年7月10日周三 下午5:04写道：

Have you tried to follow the instruction to build Flink for Maven >= 3.4? That is:

mvn clean install -DskipTests
cd flink-dist
mvn clean install

On Wed, Jul 10, 2019 at 10:34 AM Marvin777 <[hidden email]> wrote:

The version of maven is 3.5.4.

Flavio Pompermaier <[hidden email]> 于2019年7月10日周三 下午4:28写道：

For your specific problem try to look at https://ci.apache.org/projects/flink/flink-docs-stable/flinkDev/building.html#dependency-shading.

Which version of maven are you using?

On Wed, Jul 10, 2019 at 10:25 AM Flavio Pompermaier <[hidden email]> wrote:

From some version of Flink many libraries (included jackson) are shaded into org.apache.flink.shaded in order to avoid conflicts during class loading.

See https://github.com/apache/flink-shaded 

Best,

Flavio

On Wed, Jul 10, 2019 at 10:21 AM Marvin777 <[hidden email]> wrote:

hi, all:

The flink-dist package downloaded from the flink community does not have the dependencies of Jackson and protobuf, like figure 1.
But when I pull the code from github and compile and package it using the mvn clean package command, flink-dist has dependencies on Jackson and protobuf, like figure 2.

Am I forgetting something? Who knows why.

Thanks.

figure 1 

figure 2