Setting different timeouts for savepoints and checkpoints

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Setting different timeouts for savepoints and checkpoints

Rex Fenley
Hello,

I'm wondering if there's a way to set different timeouts for savepoints and checkpoints. Our savepoints can take a number of hours to complete, whereas incremental checkpoints at their slowest take around 10 min. We'd like to timeout a checkpoint on a significantly smaller duration than a savepoint.

Thanks!

--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US

Reply | Threaded
Open this post in threaded view
|

Re: Setting different timeouts for savepoints and checkpoints

r_khachatryan
Hi Rex,

Unfortunately not: the same timeout value is used both for savepoints and checkpoints.

Regards,
Roman


On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]> wrote:
Hello,

I'm wondering if there's a way to set different timeouts for savepoints and checkpoints. Our savepoints can take a number of hours to complete, whereas incremental checkpoints at their slowest take around 10 min. We'd like to timeout a checkpoint on a significantly smaller duration than a savepoint.

Thanks!

--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US

Reply | Threaded
Open this post in threaded view
|

Re: Setting different timeouts for savepoints and checkpoints

Rex Fenley
Thanks for the quick response.

Is this something that can be added as a feature request? Given that the time it takes to restore from either is different, and the semantics are slightly different, it seems like they should have completely separate configurable timeouts.

Thanks!


On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman <[hidden email]> wrote:
Hi Rex,

Unfortunately not: the same timeout value is used both for savepoints and checkpoints.

Regards,
Roman


On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]> wrote:
Hello,

I'm wondering if there's a way to set different timeouts for savepoints and checkpoints. Our savepoints can take a number of hours to complete, whereas incremental checkpoints at their slowest take around 10 min. We'd like to timeout a checkpoint on a significantly smaller duration than a savepoint.

Thanks!

--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US



--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US

Reply | Threaded
Open this post in threaded view
|

Re: Setting different timeouts for savepoints and checkpoints

Timo Walther
Hi Rex,

feel free to open an issue for this. I could also imagine that
checkpoints and savepoints will further divert from each other and a
having different timeout might be reasonable.

Regards,
Timo


On 17.01.21 02:43, Rex Fenley wrote:

> Thanks for the quick response.
>
> Is this something that can be added as a feature request? Given that the
> time it takes to restore from either is different, and the semantics are
> slightly different, it seems like they should have completely separate
> configurable timeouts.
>
> Thanks!
>
>
> On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman
> <[hidden email] <mailto:[hidden email]>> wrote:
>
>     Hi Rex,
>
>     Unfortunately not: the same timeout value is used both for
>     savepoints and checkpoints.
>
>     Regards,
>     Roman
>
>
>     On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]
>     <mailto:[hidden email]>> wrote:
>
>         Hello,
>
>         I'm wondering if there's a way to set different timeouts for
>         savepoints and checkpoints. Our savepoints can take a number of
>         hours to complete, whereas incremental checkpoints at their
>         slowest take around 10 min. We'd like to timeout a checkpoint on
>         a significantly smaller duration than a savepoint.
>
>         Thanks!
>
>         --
>
>         Rex Fenley|Software Engineer - Mobile and Backend
>
>
>         Remind.com <https://www.remind.com/>| BLOG
>         <http://blog.remind.com/> | FOLLOW US
>         <https://twitter.com/remindhq> | LIKE US
>         <https://www.facebook.com/remindhq>
>
>
>
> --
>
> Rex Fenley|Software Engineer - Mobile and Backend
>
>
> Remind.com <https://www.remind.com/>| BLOG <http://blog.remind.com/> |
> FOLLOW US <https://twitter.com/remindhq> | LIKE US
> <https://www.facebook.com/remindhq>
>

Reply | Threaded
Open this post in threaded view
|

Re: Setting different timeouts for savepoints and checkpoints

Yun Tang
Hi Timo and Rex,

Actually, there existed several existing issues: FLINK-9465 [1] targets for CLI option while FLINK-10360 [2] targets for REST API.



Best
Yun Tang

From: Timo Walther <[hidden email]>
Sent: Monday, January 18, 2021 17:28
To: [hidden email] <[hidden email]>
Subject: Re: Setting different timeouts for savepoints and checkpoints
 
Hi Rex,

feel free to open an issue for this. I could also imagine that
checkpoints and savepoints will further divert from each other and a
having different timeout might be reasonable.

Regards,
Timo


On 17.01.21 02:43, Rex Fenley wrote:
> Thanks for the quick response.
>
> Is this something that can be added as a feature request? Given that the
> time it takes to restore from either is different, and the semantics are
> slightly different, it seems like they should have completely separate
> configurable timeouts.
>
> Thanks!
>
>
> On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman
> <[hidden email] <[hidden email]>> wrote:
>
>     Hi Rex,
>
>     Unfortunately not: the same timeout value is used both for
>     savepoints and checkpoints.
>
>     Regards,
>     Roman
>
>
>     On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]
>     <[hidden email]>> wrote:
>
>         Hello,
>
>         I'm wondering if there's a way to set different timeouts for
>         savepoints and checkpoints. Our savepoints can take a number of
>         hours to complete, whereas incremental checkpoints at their
>         slowest take around 10 min. We'd like to timeout a checkpoint on
>         a significantly smaller duration than a savepoint.
>
>         Thanks!
>
>         --
>
>         Rex Fenley|Software Engineer - Mobile and Backend
>
>
>         Remind.com <https://www.remind.com/>| BLOG
>         <http://blog.remind.com/> | FOLLOW US
>         <https://twitter.com/remindhq> | LIKE US
>         <https://www.facebook.com/remindhq>
>
>
>
> --
>
> Rex Fenley|Software Engineer - Mobile and Backend
>
>
> Remind.com <https://www.remind.com/>| BLOG <http://blog.remind.com/> |
> FOLLOW US <https://twitter.com/remindhq> | LIKE US
> <https://www.facebook.com/remindhq>
>

Reply | Threaded
Open this post in threaded view
|

Re: Setting different timeouts for savepoints and checkpoints

Rex Fenley
In reply to this post by Timo Walther

On Mon, Jan 18, 2021 at 1:28 AM Timo Walther <[hidden email]> wrote:
Hi Rex,

feel free to open an issue for this. I could also imagine that
checkpoints and savepoints will further divert from each other and a
having different timeout might be reasonable.

Regards,
Timo


On 17.01.21 02:43, Rex Fenley wrote:
> Thanks for the quick response.
>
> Is this something that can be added as a feature request? Given that the
> time it takes to restore from either is different, and the semantics are
> slightly different, it seems like they should have completely separate
> configurable timeouts.
>
> Thanks!
>
>
> On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman
> <[hidden email] <mailto:[hidden email]>> wrote:
>
>     Hi Rex,
>
>     Unfortunately not: the same timeout value is used both for
>     savepoints and checkpoints.
>
>     Regards,
>     Roman
>
>
>     On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]
>     <mailto:[hidden email]>> wrote:
>
>         Hello,
>
>         I'm wondering if there's a way to set different timeouts for
>         savepoints and checkpoints. Our savepoints can take a number of
>         hours to complete, whereas incremental checkpoints at their
>         slowest take around 10 min. We'd like to timeout a checkpoint on
>         a significantly smaller duration than a savepoint.
>
>         Thanks!
>
>         --
>
>         Rex Fenley|Software Engineer - Mobile and Backend
>
>
>         Remind.com <https://www.remind.com/>| BLOG
>         <http://blog.remind.com/> | FOLLOW US
>         <https://twitter.com/remindhq> | LIKE US
>         <https://www.facebook.com/remindhq>
>
>
>
> --
>
> Rex Fenley|Software Engineer - Mobile and Backend
>
>
> Remind.com <https://www.remind.com/>| BLOG <http://blog.remind.com/> |
> FOLLOW US <https://twitter.com/remindhq> | LIKE US
> <https://www.facebook.com/remindhq>
>



--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US

Reply | Threaded
Open this post in threaded view
|

Re: Setting different timeouts for savepoints and checkpoints

Rex Fenley
Wups, my bad, I should have refreshed. I will close my bug report.

On Mon, Jan 18, 2021 at 9:16 AM Rex Fenley <[hidden email]> wrote:

On Mon, Jan 18, 2021 at 1:28 AM Timo Walther <[hidden email]> wrote:
Hi Rex,

feel free to open an issue for this. I could also imagine that
checkpoints and savepoints will further divert from each other and a
having different timeout might be reasonable.

Regards,
Timo


On 17.01.21 02:43, Rex Fenley wrote:
> Thanks for the quick response.
>
> Is this something that can be added as a feature request? Given that the
> time it takes to restore from either is different, and the semantics are
> slightly different, it seems like they should have completely separate
> configurable timeouts.
>
> Thanks!
>
>
> On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman
> <[hidden email] <mailto:[hidden email]>> wrote:
>
>     Hi Rex,
>
>     Unfortunately not: the same timeout value is used both for
>     savepoints and checkpoints.
>
>     Regards,
>     Roman
>
>
>     On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley <[hidden email]
>     <mailto:[hidden email]>> wrote:
>
>         Hello,
>
>         I'm wondering if there's a way to set different timeouts for
>         savepoints and checkpoints. Our savepoints can take a number of
>         hours to complete, whereas incremental checkpoints at their
>         slowest take around 10 min. We'd like to timeout a checkpoint on
>         a significantly smaller duration than a savepoint.
>
>         Thanks!
>
>         --
>
>         Rex Fenley|Software Engineer - Mobile and Backend
>
>
>         Remind.com <https://www.remind.com/>| BLOG
>         <http://blog.remind.com/> | FOLLOW US
>         <https://twitter.com/remindhq> | LIKE US
>         <https://www.facebook.com/remindhq>
>
>
>
> --
>
> Rex Fenley|Software Engineer - Mobile and Backend
>
>
> Remind.com <https://www.remind.com/>| BLOG <http://blog.remind.com/> |
> FOLLOW US <https://twitter.com/remindhq> | LIKE US
> <https://www.facebook.com/remindhq>
>



--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US



--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US