Too man y checkpoint folders kept for externalized retention.

[John Smith]

Hi running 1.10.0.

Just curious is this specific to externalized retention or checkpointing in general.

I see my checkpoint folder counting thousands of chk-xxxxx folders.

If using default checkpoint or NONE externalized checkpointing does the count of chk-xxxx folders grow indefinitely until the job is killed or it retains up to certain amount?

Thanks

[Yun Gao]

Hi John,

Logically the maximum retained checkpoints are configured

by state.checkpoints.num-retained [1]. Have you configured 

this option?

Best,

Yun

[1] https://ci.apache.org/projects/flink/flink-docs-stable/deployment/config.html#state-checkpoints-num-retained

------------------------------------------------------------------
Sender:John Smith<[hidden email]>
Date:2021/04/24 01:41:41
Recipient:user<[hidden email]>
Theme:Too man y checkpoint folders kept for externalized retention.

Hi running 1.10.0.

Just curious is this specific to externalized retention or checkpointing in general.

I see my checkpoint folder counting thousands of chk-xxxxx folders.

If using default checkpoint or NONE externalized checkpointing does the count of chk-xxxx folders grow indefinitely until the job is killed or it retains up to certain amount?

Thanks

[John Smith]

No. But I decided to disable it finally

On Sun., Apr. 25, 2021, 5:14 a.m. Yun Gao, <[hidden email]> wrote:

Hi John,

Logically the maximum retained checkpoints are configured

by state.checkpoints.num-retained [1]. Have you configured 

this option?

Best,

Yun

[1] https://ci.apache.org/projects/flink/flink-docs-stable/deployment/config.html#state-checkpoints-num-retained

------------------------------------------------------------------
Sender:John Smith<[hidden email]>
Date:2021/04/24 01:41:41
Recipient:user<[hidden email]>
Theme:Too man y checkpoint folders kept for externalized retention.

Hi running 1.10.0.

Just curious is this specific to externalized retention or checkpointing in general.

I see my checkpoint folder counting thousands of chk-xxxxx folders.

If using default checkpoint or NONE externalized checkpointing does the count of chk-xxxx folders grow indefinitely until the job is killed or it retains up to certain amount?

Thanks