Is there any complete code available for checkpointing

[Abdullah bin Omar]

Hi,

[1] speaks about enable checkpointing, and [2] speaks about checkpointed function. Do we need both to see a triggered and completed checkpoint (according to the pic) in the apache flink UI? 

Is there any complete code available for checkpointing so that we can run and see the triggered and completed checkpoint (according to the pic)?

[1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/checkpointing.html#java

[2] https://ci.apache.org/projects/flink/flink-docs-release-1.12/api/java/org/apache/flink/streaming/api/functions/source/SourceFunction.html

Thank you for your service!

[Arvid Heise-4]

Hi Abdullah,

You don't need to implement checkpointed functions for checkpointing to work - but you may lose state if you manage it manually.

If you have enabled checkpointing, you should see it with any application that is running. Make sure that the checkpointing interval is small enough so that you can see it and that the job is fully running.

If you want to try out a different application, you can check out the AsyncIOExample [1].

[1] https://github.com/apache/flink/blob/328e51b44db76cdd71dfa533c96967cb742b8d53/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/async/AsyncIOExample.java#L52

On Wed, Mar 10, 2021 at 8:10 PM Abdullah bin Omar <[hidden email]> wrote:

Hi,

[1] speaks about enable checkpointing, and [2] speaks about checkpointed function. Do we need both to see a triggered and completed checkpoint (according to the pic) in the apache flink UI? 

Is there any complete code available for checkpointing so that we can run and see the triggered and completed checkpoint (according to the pic)?

[1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/checkpointing.html#java

[2] https://ci.apache.org/projects/flink/flink-docs-release-1.12/api/java/org/apache/flink/streaming/api/functions/source/SourceFunction.html

Thank you for your service!

[Abdullah bin Omar]

Hi Arvid,

Thank you for your reply.

I am using to get input by using,

DataStream<String> data = env.socketTextStream("localhost", 9090);

It shows a error: The main method caused an error: org.apache.flink.client.program.ProgramInvocationException: Job failed 

Is there any particular rule to get input from localhost? or is only the above line of code enough? 

Thank you

On Thu, Mar 11, 2021 at 7:43 AM Arvid Heise <[hidden email]> wrote:

Hi Abdullah,

You don't need to implement checkpointed functions for checkpointing to work - but you may lose state if you manage it manually.

If you have enabled checkpointing, you should see it with any application that is running. Make sure that the checkpointing interval is small enough so that you can see it and that the job is fully running.

If you want to try out a different application, you can check out the AsyncIOExample [1].

[1] https://github.com/apache/flink/blob/328e51b44db76cdd71dfa533c96967cb742b8d53/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/async/AsyncIOExample.java#L52

On Wed, Mar 10, 2021 at 8:10 PM Abdullah bin Omar <[hidden email]> wrote:

Hi,

[1] speaks about enable checkpointing, and [2] speaks about checkpointed function. Do we need both to see a triggered and completed checkpoint (according to the pic) in the apache flink UI? 

Is there any complete code available for checkpointing so that we can run and see the triggered and completed checkpoint (according to the pic)?

[1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/checkpointing.html#java

[2] https://ci.apache.org/projects/flink/flink-docs-release-1.12/api/java/org/apache/flink/streaming/api/functions/source/SourceFunction.html

Thank you for your service!