Question regarding effect of 'restart-strategy: none' on Flink (1.4.1) JobManager HA

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Question regarding effect of 'restart-strategy: none' on Flink (1.4.1) JobManager HA

Jash, Shaswata (Nokia - IN/Bangalore)

Hello Flink-Experts,

 

I am observing that even after setting ‘restart-strategy: none’ with Flink JobManager HA (High Availability) setup, JobManager is still continuing restarting the ongoing jobs after failover. Is it the expected behavior? Jobs have not used any checkpoint/savepoints. My understanding was – JobManager HA along with other than no restart strategy will only ensure job be will resubmitted by the new JobManager after failover. I am using FLink 1.4.1.

 

Can you please share your views?

 

Regards,

Shaswata

Reply | Threaded
Open this post in threaded view
|

Re: Question regarding effect of 'restart-strategy: none' on Flink (1.4.1) JobManager HA

Timo Walther
Hi Shaswata,

are you using a standalone Flink cluster or how does your deployement look like? E.g. YARN has its own restart attempts [1].

Regards,
Timo

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.4/ops/jobmanager_high_availability.html#yarn-cluster-high-availability


Am 14.03.18 um 13:20 schrieb Jash, Shaswata (Nokia - IN/Bangalore):

Hello Flink-Experts,

 

I am observing that even after setting ‘restart-strategy: none’ with Flink JobManager HA (High Availability) setup, JobManager is still continuing restarting the ongoing jobs after failover. Is it the expected behavior? Jobs have not used any checkpoint/savepoints. My understanding was – JobManager HA along with other than no restart strategy will only ensure job be will resubmitted by the new JobManager after failover. I am using FLink 1.4.1.

 

Can you please share your views?

 

Regards,

Shaswata


Reply | Threaded
Open this post in threaded view
|

Re: Question regarding effect of 'restart-strategy: none' on Flink (1.4.1) JobManager HA

Jash, Shaswata (Nokia - IN/Bangalore)
Hi Timo,

My observation was based on standalone cluster.

Regards,
Shaswata

From: Timo Walther
Sent: Wednesday, March 14, 22:11
Subject: Re: Question regarding effect of 'restart-strategy: none' on Flink (1.4.1) JobManager HA
Hi Shaswata,

are you using a standalone Flink cluster or how does your deployement look like? E.g. YARN has its own restart attempts [1].

Regards,
Timo

Am 14.03.18 um 13:20 schrieb Jash, Shaswata (Nokia - IN/Bangalore):
Hello Flink-Experts,
 
I am observing that even after setting ‘restart-strategy: none’ with Flink JobManager HA (High Availability) setup, JobManager is still continuing restarting the ongoing jobs after failover. Is it the expected behavior? Jobs have not used any checkpoint/savepoints. My understanding was – JobManager HA along with other than no restart strategy will only ensure job be will resubmitted by the new JobManager after failover. I am using FLink 1.4.1.
 
Can you please share your views?
 
Regards,
Shaswata