Setting different timeouts for savepoints and checkpoints

[Rex Fenley]

Hello,

I'm wondering if there's a way to set different timeouts for savepoints and checkpoints. Our savepoints can take a number of hours to complete, whereas incremental checkpoints at their slowest take around 10 min. We'd like to timeout a checkpoint on a significantly smaller duration than a savepoint.

Thanks!

--

[r_khachatryan]

Hi Rex,

Unfortunately not: the same timeout value is used both for savepoints and checkpoints.

On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]> wrote:

Hello,

I'm wondering if there's a way to set different timeouts for savepoints and checkpoints. Our savepoints can take a number of hours to complete, whereas incremental checkpoints at their slowest take around 10 min. We'd like to timeout a checkpoint on a significantly smaller duration than a savepoint.

Thanks!

--

Rex Fenley  |  Software Engineer - Mobile and Backend

Remind.com |  BLOG  |  FOLLOW US  |  LIKE US

[Rex Fenley]

Thanks for the quick response.

Is this something that can be added as a feature request? Given that the time it takes to restore from either is different, and the semantics are slightly different, it seems like they should have completely separate configurable timeouts.

Thanks!

On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman <[hidden email]> wrote:

Hi Rex,

Unfortunately not: the same timeout value is used both for savepoints and checkpoints.

Regards,
Roman

On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]> wrote:

Hello,

I'm wondering if there's a way to set different timeouts for savepoints and checkpoints. Our savepoints can take a number of hours to complete, whereas incremental checkpoints at their slowest take around 10 min. We'd like to timeout a checkpoint on a significantly smaller duration than a savepoint.

Thanks!

--

Rex Fenley  |  Software Engineer - Mobile and Backend

Remind.com |  BLOG  |  FOLLOW US  |  LIKE US

... [show rest of quote]

--

[Timo Walther]

Hi Rex,

feel free to open an issue for this. I could also imagine that
checkpoints and savepoints will further divert from each other and a
having different timeout might be reasonable.

Regards,
Timo


On 17.01.21 02:43, Rex Fenley wrote:

> Thanks for the quick response.
>
> Is this something that can be added as a feature request? Given that the
> time it takes to restore from either is different, and the semantics are
> slightly different, it seems like they should have completely separate
> configurable timeouts.
>
> Thanks!
>
>
> On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman
> <[hidden email] <mailto:[hidden email]>> wrote:
>
>     Hi Rex,
>
>     Unfortunately not: the same timeout value is used both for
>     savepoints and checkpoints.
>
>     Regards,
>     Roman
>
>
>     On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]
>     <mailto:[hidden email]>> wrote:
>
>         Hello,
>
>         I'm wondering if there's a way to set different timeouts for
>         savepoints and checkpoints. Our savepoints can take a number of
>         hours to complete, whereas incremental checkpoints at their
>         slowest take around 10 min. We'd like to timeout a checkpoint on
>         a significantly smaller duration than a savepoint.
>
>         Thanks!
>
>         --
>
>         Rex Fenley|Software Engineer - Mobile and Backend
>
>
>         Remind.com <https://www.remind.com/>| BLOG
>         <http://blog.remind.com/> | FOLLOW US
>         <https://twitter.com/remindhq> | LIKE US
>         <https://www.facebook.com/remindhq>
>
>
>
> --
>
> Rex Fenley|Software Engineer - Mobile and Backend
>
>
> Remind.com <https://www.remind.com/>| BLOG <http://blog.remind.com/> |
> FOLLOW US <https://twitter.com/remindhq> | LIKE US
> <https://www.facebook.com/remindhq>
>

... [show rest of quote]

[Yun Tang]

Hi Timo and Rex,

Actually, there existed several existing issues: FLINK-9465 [1] targets for CLI option while FLINK-10360 [2] targets for REST API.

[1] https://issues.apache.org/jira/browse/FLINK-9465

[2] https://issues.apache.org/jira/browse/FLINK-10360

Best

Yun Tang

---

From: Timo Walther <[hidden email]>
Sent: Monday, January 18, 2021 17:28
To: [hidden email] <[hidden email]>
Subject: Re: Setting different timeouts for savepoints and checkpoints

 

Hi Rex,

feel free to open an issue for this. I could also imagine that
checkpoints and savepoints will further divert from each other and a
having different timeout might be reasonable.

Regards,
Timo


On 17.01.21 02:43, Rex Fenley wrote:
> Thanks for the quick response.
>
> Is this something that can be added as a feature request? Given that the
> time it takes to restore from either is different, and the semantics are
> slightly different, it seems like they should have completely separate
> configurable timeouts.
>
> Thanks!
>
>
> On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman
> <[hidden email] <[hidden email]>> wrote:
>
>     Hi Rex,
>
>     Unfortunately not: the same timeout value is used both for
>     savepoints and checkpoints.
>
>     Regards,
>     Roman
>
>
>     On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]
>     <[hidden email]>> wrote:
>
>         Hello,
>
>         I'm wondering if there's a way to set different timeouts for
>         savepoints and checkpoints. Our savepoints can take a number of
>         hours to complete, whereas incremental checkpoints at their
>         slowest take around 10 min. We'd like to timeout a checkpoint on
>         a significantly smaller duration than a savepoint.
>
>         Thanks!
>
>         --
>
>         Rex Fenley|Software Engineer - Mobile and Backend
>
>
>         Remind.com <https://www.remind.com/>| BLOG
>         <http://blog.remind.com/> | FOLLOW US
>         <https://twitter.com/remindhq> | LIKE US
>         <https://www.facebook.com/remindhq>
>
>
>
> --
>
> Rex Fenley|Software Engineer - Mobile and Backend
>
>
> Remind.com <https://www.remind.com/>| BLOG <http://blog.remind.com/> |
> FOLLOW US <https://twitter.com/remindhq> | LIKE US
> <https://www.facebook.com/remindhq>
>

[Rex Fenley]

Here you go https://issues.apache.org/jira/browse/FLINK-21014 .

Thanks!

On Mon, Jan 18, 2021 at 1:28 AM Timo Walther <[hidden email]> wrote:

Hi Rex,

feel free to open an issue for this. I could also imagine that
checkpoints and savepoints will further divert from each other and a
having different timeout might be reasonable.

Regards,
Timo


On 17.01.21 02:43, Rex Fenley wrote:
> Thanks for the quick response.
>
> Is this something that can be added as a feature request? Given that the
> time it takes to restore from either is different, and the semantics are
> slightly different, it seems like they should have completely separate
> configurable timeouts.
>
> Thanks!
>
>
> On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman
> <[hidden email] <mailto:[hidden email]>> wrote:
>
>     Hi Rex,
>
>     Unfortunately not: the same timeout value is used both for
>     savepoints and checkpoints.
>
>     Regards,
>     Roman
>
>
>     On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]
>     <mailto:[hidden email]>> wrote:
>
>         Hello,
>
>         I'm wondering if there's a way to set different timeouts for
>         savepoints and checkpoints. Our savepoints can take a number of
>         hours to complete, whereas incremental checkpoints at their
>         slowest take around 10 min. We'd like to timeout a checkpoint on
>         a significantly smaller duration than a savepoint.
>
>         Thanks!
>
>         --
>
>         Rex Fenley|Software Engineer - Mobile and Backend
>
>
>         Remind.com <https://www.remind.com/>| BLOG
>         <http://blog.remind.com/> | FOLLOW US
>         <https://twitter.com/remindhq> | LIKE US
>         <https://www.facebook.com/remindhq>
>
>
>
> --
>
> Rex Fenley|Software Engineer - Mobile and Backend
>
>
> Remind.com <https://www.remind.com/>| BLOG <http://blog.remind.com/> |
> FOLLOW US <https://twitter.com/remindhq> | LIKE US
> <https://www.facebook.com/remindhq>
>

... [show rest of quote]

--

[Rex Fenley]

Wups, my bad, I should have refreshed. I will close my bug report.

On Mon, Jan 18, 2021 at 9:16 AM Rex Fenley <[hidden email]> wrote:

Here you go https://issues.apache.org/jira/browse/FLINK-21014 .

Thanks!

On Mon, Jan 18, 2021 at 1:28 AM Timo Walther <[hidden email]> wrote:

Hi Rex,

feel free to open an issue for this. I could also imagine that
checkpoints and savepoints will further divert from each other and a
having different timeout might be reasonable.

Regards,
Timo


On 17.01.21 02:43, Rex Fenley wrote:
> Thanks for the quick response.
>
> Is this something that can be added as a feature request? Given that the
> time it takes to restore from either is different, and the semantics are
> slightly different, it seems like they should have completely separate
> configurable timeouts.
>
> Thanks!
>
>
> On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman
> <[hidden email] <mailto:[hidden email]>> wrote:
>
>     Hi Rex,
>
>     Unfortunately not: the same timeout value is used both for
>     savepoints and checkpoints.
>
>     Regards,
>     Roman
>
>
>     On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]
>     <mailto:[hidden email]>> wrote:
>
>         Hello,
>
>         I'm wondering if there's a way to set different timeouts for
>         savepoints and checkpoints. Our savepoints can take a number of
>         hours to complete, whereas incremental checkpoints at their
>         slowest take around 10 min. We'd like to timeout a checkpoint on
>         a significantly smaller duration than a savepoint.
>
>         Thanks!
>
>         --
>
>         Rex Fenley|Software Engineer - Mobile and Backend
>
>
>         Remind.com <https://www.remind.com/>| BLOG
>         <http://blog.remind.com/> | FOLLOW US
>         <https://twitter.com/remindhq> | LIKE US
>         <https://www.facebook.com/remindhq>
>
>
>
> --
>
> Rex Fenley|Software Engineer - Mobile and Backend
>
>
> Remind.com <https://www.remind.com/>| BLOG <http://blog.remind.com/> |
> FOLLOW US <https://twitter.com/remindhq> | LIKE US
> <https://www.facebook.com/remindhq>
>

... [show rest of quote]

--

Rex Fenley  |  Software Engineer - Mobile and Backend

Remind.com |  BLOG  |  FOLLOW US  |  LIKE US

... [show rest of quote]

--