Trigger evaluate

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

Trigger evaluate

Alberto Ramón
Hello, 1 doubt:

By default, when Trigger is launch to evaluate data of window ?
 - New element in window?
 - When a watermark arrive?
 - When the window is moved?

Thanks , Alb
Reply | Threaded
Open this post in threaded view
|

Re: Trigger evaluate

Aljoscha Krettek
Hi,
this depends on the Trigger you're using. For example, EventTimeTrigger will trigger when the watermark passes the end of a window.

Cheers,
Aljoscha

On Mon, 24 Oct 2016 at 17:10 Alberto Ramón <[hidden email]> wrote:
Hello, 1 doubt:

By default, when Trigger is launch to evaluate data of window ?
 - New element in window?
 - When a watermark arrive?
 - When the window is moved?

Thanks , Alb
Reply | Threaded
Open this post in threaded view
|

Re: Trigger evaluate

Alberto Ramón
I mean about default Trigger, when you only put this:
 .timeWindow(Time.minutes(1), Time.seconds(30))
  .sum(1)

When data window is evaluated ?
this is related?


2016-10-24 19:39 GMT+02:00 Aljoscha Krettek <[hidden email]>:
Hi,
this depends on the Trigger you're using. For example, EventTimeTrigger will trigger when the watermark passes the end of a window.

Cheers,
Aljoscha

On Mon, 24 Oct 2016 at 17:10 Alberto Ramón <[hidden email]> wrote:
Hello, 1 doubt:

By default, when Trigger is launch to evaluate data of window ?
 - New element in window?
 - When a watermark arrive?
 - When the window is moved?

Thanks , Alb

Reply | Threaded
Open this post in threaded view
|

Re: Trigger evaluate

Fabian Hueske-2
The window is evaluated when a watermark arrives that is behind the window's end time.

For instance, give the window in your example there are windows that end at 1:00:00, 1:00:30, 1:01:00, 1:01:30, ... (every 30 seconds).
given the windows above, the window from 00:59:00 to 1:00:00 will be evaluated, when a watermark of 1:00:00 or later is received. It might also happen that multiple windows are evaluated if watermarks are more than 30 seconds apart.

Best, Fabian

2016-10-24 20:38 GMT+02:00 Alberto Ramón <[hidden email]>:
I mean about default Trigger, when you only put this:
 .timeWindow(Time.minutes(1), Time.seconds(30))
  .sum(1)

When data window is evaluated ?
this is related?


2016-10-24 19:39 GMT+02:00 Aljoscha Krettek <[hidden email]>:
Hi,
this depends on the Trigger you're using. For example, EventTimeTrigger will trigger when the watermark passes the end of a window.

Cheers,
Aljoscha

On Mon, 24 Oct 2016 at 17:10 Alberto Ramón <[hidden email]> wrote:
Hello, 1 doubt:

By default, when Trigger is launch to evaluate data of window ?
 - New element in window?
 - When a watermark arrive?
 - When the window is moved?

Thanks , Alb


Reply | Threaded
Open this post in threaded view
|

Re: Trigger evaluate

Alberto Ramón


this is a mistake ?

"The trigger is called for each element that is inserted into the window and when a previously registered timer times out"


Thanks !!

2016-10-24 20:45 GMT+02:00 Fabian Hueske <[hidden email]>:
The window is evaluated when a watermark arrives that is behind the window's end time.

For instance, give the window in your example there are windows that end at 1:00:00, 1:00:30, 1:01:00, 1:01:30, ... (every 30 seconds).
given the windows above, the window from 00:59:00 to 1:00:00 will be evaluated, when a watermark of 1:00:00 or later is received. It might also happen that multiple windows are evaluated if watermarks are more than 30 seconds apart.

Best, Fabian

2016-10-24 20:38 GMT+02:00 Alberto Ramón <[hidden email]>:
I mean about default Trigger, when you only put this:
 .timeWindow(Time.minutes(1), Time.seconds(30))
  .sum(1)

When data window is evaluated ?
this is related?


2016-10-24 19:39 GMT+02:00 Aljoscha Krettek <[hidden email]>:
Hi,
this depends on the Trigger you're using. For example, EventTimeTrigger will trigger when the watermark passes the end of a window.

Cheers,
Aljoscha

On Mon, 24 Oct 2016 at 17:10 Alberto Ramón <[hidden email]> wrote:
Hello, 1 doubt:

By default, when Trigger is launch to evaluate data of window ?
 - New element in window?
 - When a watermark arrive?
 - When the window is moved?

Thanks , Alb



Reply | Threaded
Open this post in threaded view
|

Re: Trigger evaluate

Fabian Hueske-2
No, this is correct. It describes how a Trigger is called, i.e., Flink calls for each element that is inserted into a window the Trigger.onElement() method.
The default trigger of a TimeWindow does not fire on new elements. However, a custom trigger might fire when onElement() is called.

2016-10-24 21:37 GMT+02:00 Alberto Ramón <[hidden email]>:


this is a mistake ?

"The trigger is called for each element that is inserted into the window and when a previously registered timer times out"


Thanks !!

2016-10-24 20:45 GMT+02:00 Fabian Hueske <[hidden email]>:
The window is evaluated when a watermark arrives that is behind the window's end time.

For instance, give the window in your example there are windows that end at 1:00:00, 1:00:30, 1:01:00, 1:01:30, ... (every 30 seconds).
given the windows above, the window from 00:59:00 to 1:00:00 will be evaluated, when a watermark of 1:00:00 or later is received. It might also happen that multiple windows are evaluated if watermarks are more than 30 seconds apart.

Best, Fabian

2016-10-24 20:38 GMT+02:00 Alberto Ramón <[hidden email]>:
I mean about default Trigger, when you only put this:
 .timeWindow(Time.minutes(1), Time.seconds(30))
  .sum(1)

When data window is evaluated ?
this is related?


2016-10-24 19:39 GMT+02:00 Aljoscha Krettek <[hidden email]>:
Hi,
this depends on the Trigger you're using. For example, EventTimeTrigger will trigger when the watermark passes the end of a window.

Cheers,
Aljoscha

On Mon, 24 Oct 2016 at 17:10 Alberto Ramón <[hidden email]> wrote:
Hello, 1 doubt:

By default, when Trigger is launch to evaluate data of window ?
 - New element in window?
 - When a watermark arrive?
 - When the window is moved?

Thanks , Alb