How to let Flink 1.7.X run Flink session cluster on YARN in Java 7 default environment

[胡逸才]

At present, all YARN clusters adopt JAVA 7 environment.

While trying to use FLINK to handle the deployment of flow processing business scenarios, it was found that FLINK ON YARN mode always failed to perform a session task. The application log of YARN shows Unsupported major. minor version 52.0.

I tried to add env. java. home: < JDK 1.8PATH > in flink-conf. yaml of the mailing list solution. And the startup command adds -yD yarn. taskmanager. env. JAVA_HOME= < JDK1.8PATH>、-yD containerized. master. env. JAVA_HOME= < JDK1.8PATH>, -yD containerized. taskmanager. env. JAVA_HOME= < JDK1.8PATH>. Flink session cluster in YARN can not run Application in JAVA 8 environment.

So can I use Flink1.7.X submit Flink session cluster application in YARN under JAVA 7 environment?

 

[126]

Flink源码中用到了很多java1.8的特性，所以用jdk1.7是不行的

发自我的 iPhone

在 2019年4月26日，17:48，胡逸才 <[hidden email]> 写道：

At present, all YARN clusters adopt JAVA 7 environment.

While trying to use FLINK to handle the deployment of flow processing business scenarios, it was found that FLINK ON YARN mode always failed to perform a session task. The application log of YARN shows Unsupported major. minor version 52.0.

I tried to add env. java. home: < JDK 1.8PATH > in flink-conf. yaml of the mailing list solution. And the startup command adds -yD yarn. taskmanager. env. JAVA_HOME= < JDK1.8PATH>、-yD containerized. master. env. JAVA_HOME= < JDK1.8PATH>, -yD containerized. taskmanager. env. JAVA_HOME= < JDK1.8PATH>. Flink session cluster in YARN can not run Application in JAVA 8 environment.

So can I use Flink1.7.X submit Flink session cluster application in YARN under JAVA 7 environment?

 

[Yun Tang]

Hi Zhangjun

Thanks for your reply!

However, Flink user mailing list is tracked in English and user-zh mailing list is specific for Chinese. Reply in Chinese in flink user mailing list would be somehow unfriendly for those non-Chinese speakers.

I think your reply could be translated as official requirements.[1]

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/projectsetup/java_api_quickstart.html#requirements

---

From: 126 <[hidden email]>
Sent: Sunday, April 28, 2019 8:24
To: 胡逸才
Cc: [hidden email]; dev; user
Subject: Re: How to let Flink 1.7.X run Flink session cluster on YARN in Java 7 default environment

 

Flink源码中用到了很多java1.8的特性，所以用jdk1.7是不行的

发自我的 iPhone

在 2019年4月26日，17:48，胡逸才 <[hidden email]> 写道：

At present, all YARN clusters adopt JAVA 7 environment.

While trying to use FLINK to handle the deployment of flow processing business scenarios, it was found that FLINK ON YARN mode always failed to perform a session task. The application log of YARN shows Unsupported major. minor version 52.0.

I tried to add env. java. home: < JDK 1.8PATH > in flink-conf. yaml of the mailing list solution. And the startup command adds -yD yarn. taskmanager. env. JAVA_HOME= < JDK1.8PATH>、-yD containerized. master. env. JAVA_HOME= < JDK1.8PATH>, -yD containerized. taskmanager. env. JAVA_HOME= < JDK1.8PATH>. Flink session cluster in YARN can not run Application in JAVA 8 environment.

So can I use Flink1.7.X submit Flink session cluster application in YARN under JAVA 7 environment?

 

[126]

Thank you for your reminder, I will pay attention to this issue in the future.

I read some flink source code and saw that there are a lot of new features of java8, such as CompletableFuture and Lambda expressions, which causes flink do not run in jdk 1.7 environment, so you may need to upgrade your jdk to 1.8.

> 在 2019年4月28日，上午8:24，126 <[hidden email]> 写道：
>
> Flink源码中用到了很多java1.8的特性，所以用jdk1.7是不行的
>
> 发自我的 iPhone
>
>> 在 2019年4月26日，17:48，胡逸才 <[hidden email]> 写道：
>>
>> At present, all YARN clusters adopt JAVA 7 environment.
>>
>> While trying to use FLINK to handle the deployment of flow processing business scenarios, it was found that FLINK ON YARN mode always failed to perform a session task. The application log of YARN shows Unsupported major. minor version 52.0.
>>
>> I tried to add env. java. home: < JDK 1.8PATH > in flink-conf. yaml of the mailing list solution. And the startup command adds -yD yarn. taskmanager. env. JAVA_HOME= < JDK1.8PATH>、-yD containerized. master. env. JAVA_HOME= < JDK1.8PATH>, -yD containerized. taskmanager. env. JAVA_HOME= < JDK1.8PATH>. Flink session cluster in YARN can not run Application in JAVA 8 environment.
>>
>> So can I use Flink1.7.X submit Flink session cluster application in YARN under JAVA 7 environment?
>>
>>
>>

[胡逸才]

Thanks Tang：

Following your prompt, I deleted the useless parameters from the command line and added your parameters to flink-config.xml, which has been successfully implemented on YARN in the JAVA 7 environment.

At 2019-04-28 11:54:18, "Yun Tang" <[hidden email]> wrote:

Hi Zhangjun

Thanks for your reply!

However, Flink user mailing list is tracked in English and user-zh mailing list is specific for Chinese. Reply in Chinese in flink user mailing list would be somehow unfriendly for those non-Chinese speakers.

I think your reply could be translated as official requirements.[1]

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/projectsetup/java_api_quickstart.html#requirements

---

From: 126 <[hidden email]>
Sent: Sunday, April 28, 2019 8:24
To: 胡逸才
Cc: [hidden email]; dev; user
Subject: Re: How to let Flink 1.7.X run Flink session cluster on YARN in Java 7 default environment

 

Flink源码中用到了很多java1.8的特性，所以用jdk1.7是不行的

发自我的 iPhone

在 2019年4月26日，17:48，胡逸才 <[hidden email]> 写道：

At present, all YARN clusters adopt JAVA 7 environment.

While trying to use FLINK to handle the deployment of flow processing business scenarios, it was found that FLINK ON YARN mode always failed to perform a session task. The application log of YARN shows Unsupported major. minor version 52.0.

I tried to add env. java. home: < JDK 1.8PATH > in flink-conf. yaml of the mailing list solution. And the startup command adds -yD yarn. taskmanager. env. JAVA_HOME= < JDK1.8PATH>、-yD containerized. master. env. JAVA_HOME= < JDK1.8PATH>, -yD containerized. taskmanager. env. JAVA_HOME= < JDK1.8PATH>. Flink session cluster in YARN can not run Application in JAVA 8 environment.

So can I use Flink1.7.X submit Flink session cluster application in YARN under JAVA 7 environment?