How to access a file with Flink application running on Mesos?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

How to access a file with Flink application running on Mesos?

Felipe Gutierrez
Hi,

I am running Flink on Mesos without DC/OS. My application has to read files from the file system. However, it is been deployed on Meses, hence it uses its sandbox. And my application cannot find the file.
How should I call the file from the file system using Flink running on Mesos?

Here is the error message.
Thanks,
Felipe

    Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
    at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146)
    at org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:259)
    ... 22 more
    Caused by: java.lang.Exception: java.nio.file.NoSuchFileException: /tmp/mesos/slave/slaves/b8a9eb06-df49-4924-87d7-cdbcfada265f-S0/frameworks/e07862e2-1d6f-4090-b145-9de80dc5d390-0035/executors/taskmanager-00002/runs/e410a0bb-4c3c-44e8-afc2-1004fc008cba/nfshome/felipe/resources/valencia/traffic-jam-state-offline.json
    at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.checkThrowSourceExecutionException(SourceStreamTask.java:212)
    at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.performDefaultAction(SourceStreamTask.java:132)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.run(StreamTask.java:298)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:403)
    at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
    at java.lang.Thread.run(Thread.java:748)

--
-- Felipe Gutierrez
-- skype: felipe.o.gutierrez