Is working with states supported in pyflink1.12?

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Is working with states supported in pyflink1.12?

Nadia Mostafa
Hello,

I'm new to flink and trying to build a stateful application using python datastream API but can't find any example of how to use states in python in flink 1.12 documentation.
Is states supported in the python datastream API?And if so, how can I use it?

Thanks in advance!
Reply | Threaded
Open this post in threaded view
|

Re: Is working with states supported in pyflink1.12?

Chesnay Schepler
It is currently not possible to access state with the Python API.

A proposal has recently been made to enhance the API with state access
(under FLIP-152), but at this time I cannot provide a prediction for
when it might be released.

On 12/15/2020 7:55 PM, Nadia Mostafa wrote:
> Hello,
>
> I'm new to flink and trying to build a stateful application using
> python datastream API but can't find any example of how to use states
> in python in flink 1.12 documentation.
> Is states supported in the python datastream API?And if so, how can I
> use it?
>
> Thanks in advance!


Reply | Threaded
Open this post in threaded view
|

Re: Is working with states supported in pyflink1.12?

Xingbo Huang
Hi,

As Chesnay said, PyFlink has already supported Python DataStream stateless APIs so that users are able to perform some basic data transformations, but doesn't provide state access support yet in release-1.12. The proposal[1] of enhancing the API with state access has been made and related discussion[2] has been initiated on the dev mailing list. According to the plan, this feature will be supported in release-1.13.


[1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-153%3A+Support+state+access+in+Python+DataStream+API
[2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-153-Support-state-access-in-Python-DataStream-API-tt47127.html

Best,
Xingbo

Chesnay Schepler <[hidden email]> 于2020年12月16日周三 上午3:54写道:
It is currently not possible to access state with the Python API.

A proposal has recently been made to enhance the API with state access
(under FLIP-152), but at this time I cannot provide a prediction for
when it might be released.

On 12/15/2020 7:55 PM, Nadia Mostafa wrote:
> Hello,
>
> I'm new to flink and trying to build a stateful application using
> python datastream API but can't find any example of how to use states
> in python in flink 1.12 documentation.
> Is states supported in the python datastream API?And if so, how can I
> use it?
>
> Thanks in advance!


Reply | Threaded
Open this post in threaded view
|

Re: Is working with states supported in pyflink1.12?

Nadia Mostafa
Thanks for your quick response

On Wed, Dec 16, 2020, 4:01 AM Xingbo Huang <[hidden email]> wrote:
Hi,

As Chesnay said, PyFlink has already supported Python DataStream stateless APIs so that users are able to perform some basic data transformations, but doesn't provide state access support yet in release-1.12. The proposal[1] of enhancing the API with state access has been made and related discussion[2] has been initiated on the dev mailing list. According to the plan, this feature will be supported in release-1.13.


[1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-153%3A+Support+state+access+in+Python+DataStream+API
[2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-153-Support-state-access-in-Python-DataStream-API-tt47127.html

Best,
Xingbo

Chesnay Schepler <[hidden email]> 于2020年12月16日周三 上午3:54写道:
It is currently not possible to access state with the Python API.

A proposal has recently been made to enhance the API with state access
(under FLIP-152), but at this time I cannot provide a prediction for
when it might be released.

On 12/15/2020 7:55 PM, Nadia Mostafa wrote:
> Hello,
>
> I'm new to flink and trying to build a stateful application using
> python datastream API but can't find any example of how to use states
> in python in flink 1.12 documentation.
> Is states supported in the python datastream API?And if so, how can I
> use it?
>
> Thanks in advance!