Triggers in Flink CEP

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Triggers in Flink CEP

Shailesh Jain
Hi,

Similar to the way it is exposed in Windows operator, is it possible to use Triggers inside the Pattern Operator to fire partially matched patterns (when certain events are very late and we want some level of controlled early evaluation)?

I assume that Windows are used internally to implement the CEP library, so wanted to know how much of a work will it be to extend the library to expose this functionality.

Thanks,
Shailesh
Reply | Threaded
Open this post in threaded view
|

Re: Triggers in Flink CEP

Kostas Kloudas
Hi Shailesh,

The pattern operator does not use Flink’s windowing mechanism internally.
Conceptually you may think that there are windows in both, and this is true, but there
are significant differences that prevent using Flink windowing for CEP.

The above implies also that using triggers for early firing is not supported and is far from
trivial to implement.

Thanks,
Kostas

> On Dec 19, 2017, at 5:27 PM, Shailesh Jain <[hidden email]> wrote:
>
> Hi,
>
> Similar to the way it is exposed in Windows operator, is it possible to use Triggers inside the Pattern Operator to fire partially matched patterns (when certain events are very late and we want some level of controlled early evaluation)?
>
> I assume that Windows are used internally to implement the CEP library, so wanted to know how much of a work will it be to extend the library to expose this functionality.
>
> Thanks,
> Shailesh

Reply | Threaded
Open this post in threaded view
|

Re: Triggers in Flink CEP

Shailesh Jain
Thanks, Kostas.

On Tue, Dec 19, 2017 at 10:13 PM, Kostas Kloudas <[hidden email]> wrote:
Hi Shailesh,

The pattern operator does not use Flink’s windowing mechanism internally.
Conceptually you may think that there are windows in both, and this is true, but there
are significant differences that prevent using Flink windowing for CEP.

The above implies also that using triggers for early firing is not supported and is far from
trivial to implement.

Thanks,
Kostas

> On Dec 19, 2017, at 5:27 PM, Shailesh Jain <[hidden email]> wrote:
>
> Hi,
>
> Similar to the way it is exposed in Windows operator, is it possible to use Triggers inside the Pattern Operator to fire partially matched patterns (when certain events are very late and we want some level of controlled early evaluation)?
>
> I assume that Windows are used internally to implement the CEP library, so wanted to know how much of a work will it be to extend the library to expose this functionality.
>
> Thanks,
> Shailesh