Questions about how to use State Processor API

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Questions about how to use State Processor API

Tony Wei
Hi,

I'm recently trying to use State Processor API, but I have some questions during the development.

1. Does `OperatorTransformation#bootstrapWith` support scala api `DataSet`? I tried, but IDE showed that it will have compile error on that line.

2. It seems that creating RocksDBStateBackend should provide a checkpoint path, but by using
`Savepoint#create` we didn't read or write anything from or into this checkpoint path. This is for
constructing RocksDBStateBackend object only. Am I right?
```
Savepoint
    .create(new RocksDBStateBackend(checkpointPath), maxParallelism)
```
Thanks in advance.

Best,
Tony Wei
Reply | Threaded
Open this post in threaded view
|

Re: Questions about how to use State Processor API

Chesnay Schepler
1. Only the Java API is supported.

2. As far as I can tell you are correct, the given checkpoint path isn't
really used.

On 04/10/2019 10:39, Tony Wei wrote:

> Hi,
>
> I'm recently trying to use State Processor API, but I have some
> questions during the development.
>
> 1. Does `OperatorTransformation#bootstrapWith` support scala api
> `DataSet`? I tried, but IDE showed that it will have compile error on
> that line.
>
> 2. It seems that creating RocksDBStateBackend should provide a
> checkpoint path, but by using
> `Savepoint#create` we didn't read or write anything from or into this
> checkpoint path. This is for
> constructing RocksDBStateBackend object only. Am I right?
> ```
> Savepoint
>     .create(new RocksDBStateBackend(checkpointPath), maxParallelism)
> ```
> Thanks in advance.
>
> Best,
> Tony Wei