Re: Flink Kuberntes Libraries

Posted by Till Rohrmann on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-Kuberntes-Libraries-tp38528p38599.html

Hi Saksham,

if you want to extend the Flink Docker image you can find here more details [1]. 

If you want to include the library in your user jar, then you have to add the library as a dependency to your pom.xml file and enable the shade plugin for building an uber jar [2].

[1] https://ci.apache.org/projects/flink/flink-docs-stable/ops/deployment/docker.html#advanced-customization

[2] https://maven.apache.org/plugins/maven-shade-plugin/examples/includes-excludes.html

Cheers,

Till

On Fri, Oct 9, 2020 at 3:22 PM saksham sapra <[hidden email]> wrote:

Thanks Till for helping out,

The way you suggested, is it possible to copy libs which is in D directory to FLINK_HOME/libs. I tried to run a copy command : copy D:/data/libs to FLINK_HOME/libs and it gets copied but i dont how can i check where it gets copied and this libs is taken by flink?

Thanks,

Saksham Sapra

On Wed, Oct 7, 2020 at 9:40 PM Till Rohrmann <[hidden email]> wrote:

HI Saksham,

the easiest approach would probably be to include the required libraries in your user code jar which you submit to the cluster. Using maven's shade plugin should help with this task. Alternatively, you could also create a custom Flink Docker image where you add the required libraries to the FLINK_HOME/libs directory. This would however mean that every job you submit to the Flink cluster would see these libraries in the system class path.

Cheers,

Till

On Wed, Oct 7, 2020 at 2:08 PM saksham sapra <[hidden email]> wrote:

Hi ,

i have made some configuration using this link page :https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/deployment/kubernetes.html.

and i am able to run flink on UI , but i need to submit a job using : http://localhost:8001/api/v1/namespaces/default/services/flink-jobmanager:webui/proxy/#/submit through POstman, and i have some libraries which in local i can add in libs folder but in this how can i add my libraries so that it works properly.