Flink on YARN

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink on YARN

Soheil Pourbafrani
Hi,

I have a YARN cluster(containing no Flink installation) that I want to run Flink application on that. I was wondering if it is needed to install Flink on every node of YARN cluster or not it suffices to install Flink on edge node (the node that I want to submit a job to remote YARN cluster)?

Thanks
Reply | Threaded
Open this post in threaded view
|

Re: Flink on YARN

Kien Truong
Hi,

You only need to install Flink on the node where you want to perform job
submission.

Regards,

Kien


On 1/20/2018 3:23 PM, Soheil Pourbafrani wrote:
> Hi,
>
> I have a YARN cluster(containing no Flink installation) that I want to
> run Flink application on that. I was wondering if it is needed to
> install Flink on every node of YARN cluster or not it suffices to
> install Flink on edge node (the node that I want to submit a job to
> remote YARN cluster)?
>
> Thanks
Reply | Threaded
Open this post in threaded view
|

Re: Flink on YARN

Mingmin Xu
In the Flink client node, you also need to have YARN configuration files which tells where's YARN.

> Flink doc: the Client requires the YARN_CONF_DIR or HADOOP_CONF_DIR environment variable to be set to read the YARN and HDFS configuration. 

On Sat, Jan 20, 2018 at 3:54 AM, Kien Truong <[hidden email]> wrote:
Hi,

You only need to install Flink on the node where you want to perform job submission.

Regards,

Kien



On 1/20/2018 3:23 PM, Soheil Pourbafrani wrote:
Hi,

I have a YARN cluster(containing no Flink installation) that I want to run Flink application on that. I was wondering if it is needed to install Flink on every node of YARN cluster or not it suffices to install Flink on edge node (the node that I want to submit a job to remote YARN cluster)?

Thanks



--
----
Mingmin