adding core-site xml to flink1.11

Posted by scarmeli on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/adding-core-site-xml-to-flink1-11-tp38933.html

Hi,
I'm trying to define filesystem to flink 1.11 using core-site.xml
I tried adding in the flink-conf.yaml env.hadoop.conf.dir and I see it is added to the classpath
also adding environment variable HADOOP_CONF_DIR didn't help

The flink 1.11.2 is running on docker using kubernetes

I added hadoop using plugin as mentioned in https://ci.apache.org/projects/flink/flink-docs-stable/ops/filesystems/s3.html#hadooppresto-s3-file-systems-plugins

when configure the parameters manually I can connect to the local s3a server
So it looks like the flink is not reading the core-site.xml file

please advise
 
Thanks,
Shachar