Configuring S3 with Flink and Mesos

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Configuring S3 with Flink and Mesos

Guillaume Balaine
Hi Flink fellas,

I am painfully trying to get the taskmanager launched by the MesosTaskManagerRunner to recognize the fs.hdfs.hadoopconf property. 
It seems the HadoopUtils class is unable to recognize the possibleHadoopConfPath of fs.hdfs.hadoopconf / core-site.xml. despite it being mounted in /mnt/mesos/sandbox/flink/conf and fs.hdfs.hadoopconf being set to file:/mnt/mesos/sandbox/flink/conf (I use debugging logs, and the config is indeed loaded there).
Has anyone ever got flink taskmanager images running in Mesos/DCOS using the MesosApplicationMasterRunner ?