Flink Job Deployment

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink Job Deployment

Rinat
Hi folks !
I’ve got a question about running flink job on the top of YARN.
Is there any possibility to store job sources in hdfs, for example

/app/flink/job-name/
  - /lib/*.jar
  - /etc/*.properties

and specify directories, that should be added to the job classpath ?

Thx.



Reply | Threaded
Open this post in threaded view
|

Re: Flink Job Deployment

Fabian Hueske-2
Hi Rinat,

no, this is unfortunately not possible.
When a job is submitted, all required JARs are copied into an HDFS location that's job-specific.

Best, Fabian

2017-09-04 13:11 GMT+02:00 Rinat <[hidden email]>:
Hi folks !
I’ve got a question about running flink job on the top of YARN.
Is there any possibility to store job sources in hdfs, for example

/app/flink/job-name/
  - /lib/*.jar
  - /etc/*.properties

and specify directories, that should be added to the job classpath ?

Thx.