Rest API for Checkpoint Data

[sohimankotia]

Is there way to read checkpoint ( if not configured to save to hdfs ) data
through rest api (or some other way) for monitoring purpose ?



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Aljoscha Krettek]

Hi,

No, I'm afraid this is not possible. Why can't you write the data to some file system?

Best,
Aljoscha

> On 31. Aug 2017, at 09:33, sohimankotia <[hidden email]> wrote:
>
> Is there way to read checkpoint ( if not configured to save to hdfs ) data
> through rest api (or some other way) for monitoring purpose ?
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[sohimankotia]

I tried to use file system as Backend store .

env.setStateBackend(new
FsStateBackend("file:///home/user/Desktop/data/flink/checkpoints"));


After running job on local , I see a folder with name
*a2716e2992bfb6f8796347328ec23c82* under directory

/home/user/Desktop/data/flink/checkpoints .

What exactly this means ? How to read it ? :-)

 




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Aljoscha Krettek]

Hi,

This is the serialised data for the checkpoint. This is not meant to be user readable, though. There are some plans to make savepoints adhere to a specific schema, so that you could inspect savepoints (which are similar to checkpoints, but with additional metadata [1]). I'm not sure whether this will make it into Flink 1.4, though.

Best,

Aljoscha

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.4/ops/state/savepoints.html

On 4. Sep 2017, at 12:38, sohimankotia <[hidden email]> wrote:

I tried to use file system as Backend store .

env.setStateBackend(new
FsStateBackend("file:///home/user/Desktop/data/flink/checkpoints"));


After running job on local , I see a folder with name
*a2716e2992bfb6f8796347328ec23c82* under directory

/home/user/Desktop/data/flink/checkpoints .

What exactly this means ? How to read it ? :-)






--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[sohimankotia]

Can you point to code to  deserialize this data ? That would be great .



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/