arbitrary state handling in python api

[Georg Heiler]

Hi,

does the python API expose some kind of mapGroupsWithState operator which can be applied on a window to handle arbitrary state?

I would want to perform time-series anomaly detection using a streaming implementation of the matrix profile algorithm using https://github.com/TDAmeritrade/stumpy There would be multiple instances of matrix profile, one for each group.

Best,

Georg

[Dian Fu]

Hi Georg,

It still doesn't support state access in Python API in the latest version 1.11. 

Could you take a look at if KeyedProcessFunction could meet your requirements? We are planning to support it in Python DataStream API in 1.12.

Regards,

Dian

在 2020年9月9日，下午2:28，Georg Heiler <[hidden email]> 写道：

Hi,

does the python API expose some kind of mapGroupsWithState operator which can be applied on a window to handle arbitrary state?

I would want to perform time-series anomaly detection using a streaming implementation of the matrix profile algorithm using https://github.com/TDAmeritrade/stumpy There would be multiple instances of matrix profile, one for each group.

Best,

Georg

[Georg Heiler]

Many thanks.

This is great to hear.

Yes! This looks great.

Many Thanks!

Best,

Georg

Am Do., 10. Sept. 2020 um 23:53 Uhr schrieb Dian Fu <[hidden email]>:

Hi Georg,

It still doesn't support state access in Python API in the latest version 1.11. 

Could you take a look at if KeyedProcessFunction could meet your requirements? We are planning to support it in Python DataStream API in 1.12.

Regards,

Dian

在 2020年9月9日，下午2:28，Georg Heiler <[hidden email]> 写道：

Hi,

does the python API expose some kind of mapGroupsWithState operator which can be applied on a window to handle arbitrary state?

I would want to perform time-series anomaly detection using a streaming implementation of the matrix profile algorithm using https://github.com/TDAmeritrade/stumpy There would be multiple instances of matrix profile, one for each group.

Best,

Georg