Custom Window Assigner With Lateness

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Custom Window Assigner With Lateness

swiesman

Is it possible in a custom window assigner to determine if an object has appeared after the watermark has passed? I want to have a standard event time tumbling window but custom logic for late data. From what I can tell there is no way from within the WindowAssigner interface to determine if an element arrived after the watermark. Is this currently possible to do in flink?

 

Thank you,

 

Seth Wiesman

Reply | Threaded
Open this post in threaded view
|

Re: Custom Window Assigner With Lateness

Aljoscha Krettek
Hi,
this is not possible in the current implementation. Lateness is determined at the WindowOperator and within a Trigger you can actually check the current watermark and therefore determine if a window is late or not.

Cheers,
Aljoscha

On Tue, 8 Nov 2016 at 17:19 Seth Wiesman <[hidden email]> wrote:

Is it possible in a custom window assigner to determine if an object has appeared after the watermark has passed? I want to have a standard event time tumbling window but custom logic for late data. From what I can tell there is no way from within the WindowAssigner interface to determine if an element arrived after the watermark. Is this currently possible to do in flink?

 

Thank you,

 

Seth Wiesman