HighAvailability :: FsNegativeRunningJobsRegistry

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

HighAvailability :: FsNegativeRunningJobsRegistry

Mikhail Pryakhin-2
Hi guys, 
I'm trying to substitute Zookeeper-based HA registry with YARN-based HA registry. (The idea was taken from the issue https://issues.apache.org/jira/browse/FLINK-5254)
In Flink 1.6.1, there exists an org.apache.flink.runtime.highavailability.FsNegativeRunningJobsRegistry which claims to be tailored towards YRN deployment mode. I've looked through org.apache.flink.configuration.HighAvailabilityOptions in order to figure out how to enable YARN-based HA registry but haven't found anything about it. The Flink documentation mentions nothing about it either. 

Do I miss something? Is there a way to use this exact registry for YARN deployments?

Thank you in advance.

Kind Regards,
Mike Pryakhin


smime.p7s (2K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: HighAvailability :: FsNegativeRunningJobsRegistry

Mikhail Pryakhin-2
Hi all, 
I’ve realised that the feature I requested information about hasn’t been released yet.
Could you please reveal when approximately the release-1.6.2-rc1 is going to be rolled out?

Thank you.

Kind Regards,
Mike Pryakhin

On 24 Oct 2018, at 16:12, Mikhail Pryakhin <[hidden email]> wrote:

Hi guys, 
I'm trying to substitute Zookeeper-based HA registry with YARN-based HA registry. (The idea was taken from the issue https://issues.apache.org/jira/browse/FLINK-5254)
In Flink 1.6.1, there exists an org.apache.flink.runtime.highavailability.FsNegativeRunningJobsRegistry which claims to be tailored towards YRN deployment mode. I've looked through org.apache.flink.configuration.HighAvailabilityOptions in order to figure out how to enable YARN-based HA registry but haven't found anything about it. The Flink documentation mentions nothing about it either. 

Do I miss something? Is there a way to use this exact registry for YARN deployments?

Thank you in advance.

Kind Regards,
Mike Pryakhin



smime.p7s (2K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: HighAvailability :: FsNegativeRunningJobsRegistry

Chesnay Schepler
The release process for 1.6.2 is currently ongoing and will hopefully be finished within the next days.
In the mean-time you could use 1.6.2-rc1 artifacts:
binaries: https://dist.apache.org/repos/dist/dev/flink/flink-1.6.2/
maven: https://repository.apache.org/content/repositories/orgapacheflink-1186

On 25.10.2018 12:36, Mikhail Pryakhin wrote:
Hi all, 
I’ve realised that the feature I requested information about hasn’t been released yet.
Could you please reveal when approximately the release-1.6.2-rc1 is going to be rolled out?

Thank you.

Kind Regards,
Mike Pryakhin

On 24 Oct 2018, at 16:12, Mikhail Pryakhin <[hidden email]> wrote:

Hi guys, 
I'm trying to substitute Zookeeper-based HA registry with YARN-based HA registry. (The idea was taken from the issue https://issues.apache.org/jira/browse/FLINK-5254)
In Flink 1.6.1, there exists an org.apache.flink.runtime.highavailability.FsNegativeRunningJobsRegistry which claims to be tailored towards YRN deployment mode. I've looked through org.apache.flink.configuration.HighAvailabilityOptions in order to figure out how to enable YARN-based HA registry but haven't found anything about it. The Flink documentation mentions nothing about it either. 

Do I miss something? Is there a way to use this exact registry for YARN deployments?

Thank you in advance.

Kind Regards,
Mike Pryakhin