Unable to restore the checkpoint on restarting the application!!

[Puneet Kinra-2]

Hi All

I am creating a poc where i am trying the out of box feature of flink

for managed state of operator . I am able to create the checkpoint while running my app in eclipse but when i am trying to restart the app . I am unable to restore

the state.

Please find attached below snippet.

step followed 

1) ran the application that generate tuple automatically.

2) check-pointing is triggering as  it configured.(able to see the data being written in files)

3) stopped the app in eclipse

4) restart the application (unable to restore) 

--

[Till Rohrmann]

Hi Puneet,

what exactly is the problem when you try to resume from a checkpoint?

Cheers,
Till

On Fri, Jan 4, 2019 at 2:31 PM Puneet Kinra <[hidden email]> wrote:

Hi All

I am creating a poc where i am trying the out of box feature of flink

for managed state of operator . I am able to create the checkpoint while running my app in eclipse but when i am trying to restart the app . I am unable to restore

the state.

Please find attached below snippet.

step followed 

1) ran the application that generate tuple automatically.

2) check-pointing is triggering as  it configured.(able to see the data being written in files)

3) stopped the app in eclipse

4) restart the application (unable to restore) 

--

[Puneet Kinra-2]

The List it returns is blank 

On Fri, Jan 4, 2019 at 7:15 PM Till Rohrmann <[hidden email]> wrote:

Hi Puneet,

what exactly is the problem when you try to resume from a checkpoint?

Cheers,
Till

On Fri, Jan 4, 2019 at 2:31 PM Puneet Kinra <[hidden email]> wrote:

Hi All

I am creating a poc where i am trying the out of box feature of flink

for managed state of operator . I am able to create the checkpoint while running my app in eclipse but when i am trying to restart the app . I am unable to restore

the state.

Please find attached below snippet.

step followed 

1) ran the application that generate tuple automatically.

2) check-pointing is triggering as  it configured.(able to see the data being written in files)

3) stopped the app in eclipse

4) restart the application (unable to restore) 

--

--

[Till Rohrmann]

When starting a job from within the IDE using the LocalEnvironment, it is not possible to specify a checkpoint from which to resume. That's why your recovered state is empty. Flink won't automatically pick up the latest checkpoint it finds in some checkpoint directory.

You can test it though by starting a local standalone cluster and submit the job via bin/flink run -s <PATH_TO_CHECKPOINT> job.jar [1].

[1] https://ci.apache.org/projects/flink/flink-docs-stable/ops/cli.html#restore-a-savepoint

Cheers,

Till

On Fri, Jan 4, 2019 at 2:49 PM Puneet Kinra <[hidden email]> wrote:

The List it returns is blank 

On Fri, Jan 4, 2019 at 7:15 PM Till Rohrmann <[hidden email]> wrote:

Hi Puneet,

what exactly is the problem when you try to resume from a checkpoint?

Cheers,
Till

On Fri, Jan 4, 2019 at 2:31 PM Puneet Kinra <[hidden email]> wrote:

Hi All

I am creating a poc where i am trying the out of box feature of flink

for managed state of operator . I am able to create the checkpoint while running my app in eclipse but when i am trying to restart the app . I am unable to restore

the state.

Please find attached below snippet.

step followed 

1) ran the application that generate tuple automatically.

2) check-pointing is triggering as  it configured.(able to see the data being written in files)

3) stopped the app in eclipse

4) restart the application (unable to restore) 

--

--

[Puneet Kinra-2]

Hi Till 

Its Working for me know ,but context.isRestored() is always returning false.

On Fri, Jan 4, 2019 at 7:42 PM Till Rohrmann <[hidden email]> wrote:

When starting a job from within the IDE using the LocalEnvironment, it is not possible to specify a checkpoint from which to resume. That's why your recovered state is empty. Flink won't automatically pick up the latest checkpoint it finds in some checkpoint directory.

You can test it though by starting a local standalone cluster and submit the job via bin/flink run -s <PATH_TO_CHECKPOINT> job.jar [1].

[1] https://ci.apache.org/projects/flink/flink-docs-stable/ops/cli.html#restore-a-savepoint

Cheers,

Till

On Fri, Jan 4, 2019 at 2:49 PM Puneet Kinra <[hidden email]> wrote:

The List it returns is blank 

On Fri, Jan 4, 2019 at 7:15 PM Till Rohrmann <[hidden email]> wrote:

Hi Puneet,

what exactly is the problem when you try to resume from a checkpoint?

Cheers,
Till

On Fri, Jan 4, 2019 at 2:31 PM Puneet Kinra <[hidden email]> wrote:

Hi All

I am creating a poc where i am trying the out of box feature of flink

for managed state of operator . I am able to create the checkpoint while running my app in eclipse but when i am trying to restart the app . I am unable to restore

the state.

Please find attached below snippet.

step followed 

1) ran the application that generate tuple automatically.

2) check-pointing is triggering as  it configured.(able to see the data being written in files)

3) stopped the app in eclipse

4) restart the application (unable to restore) 

--

--

--

[Till Rohrmann]

Hi Puneet,

if context.isRestored returns false, then Flink did not resume from a checkpoint/savepoint. Please make sure that you specify the correct path the an existing checkpoint.

Cheers,

Till

On Mon, Jan 7, 2019 at 11:04 AM Puneet Kinra <[hidden email]> wrote:

Hi Till 

Its Working for me know ,but context.isRestored() is always returning false.

On Fri, Jan 4, 2019 at 7:42 PM Till Rohrmann <[hidden email]> wrote:

When starting a job from within the IDE using the LocalEnvironment, it is not possible to specify a checkpoint from which to resume. That's why your recovered state is empty. Flink won't automatically pick up the latest checkpoint it finds in some checkpoint directory.

You can test it though by starting a local standalone cluster and submit the job via bin/flink run -s <PATH_TO_CHECKPOINT> job.jar [1].

[1] https://ci.apache.org/projects/flink/flink-docs-stable/ops/cli.html#restore-a-savepoint

Cheers,

Till

On Fri, Jan 4, 2019 at 2:49 PM Puneet Kinra <[hidden email]> wrote:

The List it returns is blank 

On Fri, Jan 4, 2019 at 7:15 PM Till Rohrmann <[hidden email]> wrote:

Hi Puneet,

what exactly is the problem when you try to resume from a checkpoint?

Cheers,
Till

On Fri, Jan 4, 2019 at 2:31 PM Puneet Kinra <[hidden email]> wrote:

Hi All

I am creating a poc where i am trying the out of box feature of flink

for managed state of operator . I am able to create the checkpoint while running my app in eclipse but when i am trying to restart the app . I am unable to restore

the state.

Please find attached below snippet.

step followed 

1) ran the application that generate tuple automatically.

2) check-pointing is triggering as  it configured.(able to see the data being written in files)

3) stopped the app in eclipse

4) restart the application (unable to restore) 

--

--

--