Re: Using native libraries in Flink EMR jobs
Posted by
Timur Fayruzov on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Using-native-libraries-in-Flink-EMR-jobs-tp5975p5979.html
there is a hack for this issue: copying my native library to $HADOOP_HOME/lib/native makes it discoverable and a program runs, however this is not an appropriate solution and it seems to be fragile.
I tried to find where 'lib/native' path appears in the configuration and found 2 places:
hadoop-env.sh: export JAVA_LIBRARY_PATH="$JAVA_LIBRARY_PATH:/usr/lib/hadoop-lzo/lib/native
mapred-site.xml: key: mapreduce.admin.user.env
I tried to add path to dir with my native lib in both places, but still no luck.
Thanks,
Timur