How to customize triggering of checkpoints?

[syed]

I am new to the flink environment and looking to analyze the triggering of
checkpoints. I am looking to trigger non-periodic checkpoints such that
checkpoint intervals are not of equal length, but not sure how can I do this
in Flink.  

My specific query is;

(1) How can I trigger non-periodic checkpoints in Flink? I am looking to
trigger first checkpoint say after 10 seconds, the next checkpoint at say 25
seconds, third at 45 seconds and so on. Can I define my own function which
triggers non-periodic checkpoints and generates no-uniform checkpoint
intervals?
Thanks.




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Chesnay Schepler]

Hello,

there is no way to manually trigger checkpoints or configure irregular intervals.

You will have to modify the CheckpointCoordinator and build Flink from source:

• startCheckpointScheduler() should only schedule a one-time execution of the trigger
• ScheduledTrigger#run() should reschedule itself
• Something like:
• triggerCheckpoint(System.currentTimeMillis(), true);
• long msUntilNextCheckpoint = // insert logic here
• timer.schedule(new ScheduledTrigger(), msUntilNextCheckpoint, TimeUnit.MILLISECONDS)

On 11.04.2018 05:15, syed wrote:

I am new to the flink environment and looking to analyze the triggering of
checkpoints. I am looking to trigger non-periodic checkpoints such that
checkpoint intervals are not of equal length, but not sure how can I do this
in Flink.  

My specific query is;

(1) How can I trigger non-periodic checkpoints in Flink? I am looking to
trigger first checkpoint say after 10 seconds, the next checkpoint at say 25
seconds, third at 45 seconds and so on. Can I define my own function which
triggers non-periodic checkpoints and generates no-uniform checkpoint
intervals?
Thanks.




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Steven Wu]

Syed, I am very curious about the motivation if you can share.

On Wed, Apr 11, 2018 at 1:35 AM, Chesnay Schepler <[hidden email]> wrote:

Hello,

there is no way to manually trigger checkpoints or configure irregular intervals.

You will have to modify the CheckpointCoordinator and build Flink from source:

• startCheckpointScheduler() should only schedule a one-time execution of the trigger
• ScheduledTrigger#run() should reschedule itself
• Something like:
• triggerCheckpoint(System.currentTimeMillis(), true);
• long msUntilNextCheckpoint = // insert logic here
• timer.schedule(new ScheduledTrigger(), msUntilNextCheckpoint, TimeUnit.MILLISECONDS)

On 11.04.2018 05:15, syed wrote:

I am new to the flink environment and looking to analyze the triggering of
checkpoints. I am looking to trigger non-periodic checkpoints such that
checkpoint intervals are not of equal length, but not sure how can I do this
in Flink.  

My specific query is;

(1) How can I trigger non-periodic checkpoints in Flink? I am looking to
trigger first checkpoint say after 10 seconds, the next checkpoint at say 25
seconds, third at 45 seconds and so on. Can I define my own function which
triggers non-periodic checkpoints and generates no-uniform checkpoint
intervals?
Thanks.




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/