Building some specific modules in flink

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Building some specific modules in flink

syed
Hi;
I am trying to modify some core functionalities of flink for my through
understanding about flink.  I already build the flink from source, now I am
looking to build only a few modules which I have modified. Is this possible,
or every time I have to build the flink in full (all modules). As it takes
me about 30-35 minutes to build the flink in full.

Specifically, I have modified some classes in *flink-streaming-java* and
*flink-runtime* modules. I am looking to build only these two modules and
integrate these into already build flink (all modules). I alrady tried using
–pl option using mvn, it installs these modules but changes are not updated
in already build binaries.
Please guide me how can I do this.
Kind regards;
syed




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Building some specific modules in flink

Jeff Zhang
You need to specify flink-dist in -pl. Module flink-dist will build the flink binary distribution. 

syed <[hidden email]> 于2019年6月25日周二 上午9:14写道:
Hi;
I am trying to modify some core functionalities of flink for my through
understanding about flink.  I already build the flink from source, now I am
looking to build only a few modules which I have modified. Is this possible,
or every time I have to build the flink in full (all modules). As it takes
me about 30-35 minutes to build the flink in full.

Specifically, I have modified some classes in *flink-streaming-java* and
*flink-runtime* modules. I am looking to build only these two modules and
integrate these into already build flink (all modules). I alrady tried using
–pl option using mvn, it installs these modules but changes are not updated
in already build binaries.
Please guide me how can I do this.
Kind regards;
syed




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/


--
Best Regards

Jeff Zhang
Reply | Threaded
Open this post in threaded view
|

Re: Building some specific modules in flink

Yun Tang
In reply to this post by syed
Hi Syed

You could use 'mvn clean package -pl :flink-streaming-java_2.11 -DskipTests -am' to build flink-streaming-java and flink-runtime modules. If the 'already built binary' means the flink-dist-*.jar package, the former mvn command would not update the dist jar package. As far as I know, a quick solution is using `jar uf` [1] command to update the dist jar package with your changed classes. Otherwise, you need to build flink-dist module from scratch.


Best
Yun Tang


From: syed <[hidden email]>
Sent: Tuesday, June 25, 2019 9:14
To: [hidden email]
Subject: Building some specific modules in flink
 
Hi;
I am trying to modify some core functionalities of flink for my through
understanding about flink.  I already build the flink from source, now I am
looking to build only a few modules which I have modified. Is this possible,
or every time I have to build the flink in full (all modules). As it takes
me about 30-35 minutes to build the flink in full.

Specifically, I have modified some classes in *flink-streaming-java* and
*flink-runtime* modules. I am looking to build only these two modules and
integrate these into already build flink (all modules). I alrady tried using
–pl option using mvn, it installs these modules but changes are not updated
in already build binaries.
Please guide me how can I do this.
Kind regards;
syed




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/