Enabling Flink’s checkpointing

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Enabling Flink’s checkpointing

Olga Luganska
Hello,

By reading Flink documentation I see that to enable checkpointing we need to:

1. Enable checkpointing at the execution environment.

2. Make sure that your source/sink implements either CheckpointedFunction or ListCheckpointed interfaces?

Is #2 a must, and how checkpointing mechanism is affected if your source does not implement mentioned above interfaces?

(I see example of using RuntimeContext accessing keyed state)

Please explain.
Thank you very much,
Olga


Sent from my iPhone
Reply | Threaded
Open this post in threaded view
|

Re: Enabling Flink’s checkpointing

Andrey Zagrebin
Hi Olga,

Not sure where it is stated in the docs to make sure that source/sink implements the interface.

From what I see in the source code, if a user function does not implement CheckpointedFunction or ListCheckpointed, its operator state will just not be snapshotted, but I do not see any problem for enabled checkpoint to snapshot what supports it and success for the job.

Best,
Andrey

> On 15 Nov 2018, at 18:20, Olga Luganska <[hidden email]> wrote:
>
> Hello,
>
> By reading Flink documentation I see that to enable checkpointing we need to:
>
> 1. Enable checkpointing at the execution environment.
>
> 2. Make sure that your source/sink implements either CheckpointedFunction or ListCheckpointed interfaces?
>
> Is #2 a must, and how checkpointing mechanism is affected if your source does not implement mentioned above interfaces?
>
> (I see example of using RuntimeContext accessing keyed state)
>
> Please explain.
> Thank you very much,
> Olga
>
>
> Sent from my iPhone