Firing timers on ProcessWindowFunction

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Firing timers on ProcessWindowFunction

avilevi
Hi,
Is there a way to fire timer in a ProcessWindowFunction ? I would like to mutate the global state on a timely basis.

Reply | Threaded
Open this post in threaded view
|

Re: Firing timers on ProcessWindowFunction

vino yang
Hi Avi,

Firstly, let's clarify that the "timer" you said is the timer of the window? Or a timer you want to register to trigger some action?

Best,
Vino


Avi Levi <[hidden email]> 于2019年12月2日周一 下午4:11写道:
Hi,
Is there a way to fire timer in a ProcessWindowFunction ? I would like to mutate the global state on a timely basis.

Reply | Threaded
Open this post in threaded view
|

Re: Firing timers on ProcessWindowFunction

avilevi
Hi Vino,
I have a global state that I need to mutate every X hours (e.g clean that state or update its value) . I thought that there might be an option to set a timer user the timerService with it's own time interval detached from the window interval interval .

On Mon, Dec 2, 2019 at 10:59 AM vino yang <[hidden email]> wrote:
This Message originated outside your organization.

Hi Avi,

Firstly, let's clarify that the "timer" you said is the timer of the window? Or a timer you want to register to trigger some action?

Best,
Vino


Avi Levi <[hidden email]> 于2019年12月2日周一 下午4:11写道:
Hi,
Is there a way to fire timer in a ProcessWindowFunction ? I would like to mutate the global state on a timely basis.

Reply | Threaded
Open this post in threaded view
|

Re: Firing timers on ProcessWindowFunction

avilevi
I think the only way to do this is to add keyed operator down the stream that will hold the global state. not ideal but I don't see any other option

On Mon, Dec 2, 2019 at 1:43 PM Avi Levi <[hidden email]> wrote:
Hi Vino,
I have a global state that I need to mutate every X hours (e.g clean that state or update its value) . I thought that there might be an option to set a timer user the timerService with it's own time interval detached from the window interval interval .

On Mon, Dec 2, 2019 at 10:59 AM vino yang <[hidden email]> wrote:
This Message originated outside your organization.

Hi Avi,

Firstly, let's clarify that the "timer" you said is the timer of the window? Or a timer you want to register to trigger some action?

Best,
Vino


Avi Levi <[hidden email]> 于2019年12月2日周一 下午4:11写道:
Hi,
Is there a way to fire timer in a ProcessWindowFunction ? I would like to mutate the global state on a timely basis.

Reply | Threaded
Open this post in threaded view
|

Re: Firing timers on ProcessWindowFunction

avilevi
Thanks Alexander,
Will do.

Cheers

On Mon, Dec 2, 2019 at 3:23 PM Alexander Fedulov <[hidden email]> wrote:
This Message originated outside your organization.

Hi Avi,

In this situation I would propose to step back and use a lower level API -  ProcessFunction. You can put your window elements into the Flink-managed List state and handle clean-up/triggering and periodic state mutations exactly as needed by implementing some additional timers logic.

Best regards,

--

Alexander Fedulov | Solutions Architect

+49 1514 6265796



Follow us @VervericaData

--

Join Flink Forward - The Apache Flink Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--

Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Tony) Cheng




On Mon, Dec 2, 2019 at 1:16 PM Avi Levi <[hidden email]> wrote:
I think the only way to do this is to add keyed operator down the stream that will hold the global state. not ideal but I don't see any other option

On Mon, Dec 2, 2019 at 1:43 PM Avi Levi <[hidden email]> wrote:
Hi Vino,
I have a global state that I need to mutate every X hours (e.g clean that state or update its value) . I thought that there might be an option to set a timer user the timerService with it's own time interval detached from the window interval interval .

On Mon, Dec 2, 2019 at 10:59 AM vino yang <[hidden email]> wrote:
This Message originated outside your organization.

Hi Avi,

Firstly, let's clarify that the "timer" you said is the timer of the window? Or a timer you want to register to trigger some action?

Best,
Vino


Avi Levi <[hidden email]> 于2019年12月2日周一 下午4:11写道:
Hi,
Is there a way to fire timer in a ProcessWindowFunction ? I would like to mutate the global state on a timely basis.