(DEPRECATED) Apache Flink User Mailing List archive.

FlinkCEP and scientific papers ?

Classic

List

Threaded

9 messages Options

Esa Heikkinen

FlinkCEP and scientific papers ?

I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?

I know Flink is based to Stratosphere, but how is it FlinkCEP ?

BR Esa

vino yang

Re: FlinkCEP and scientific papers ?

Hi Esa,

AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:

1. NFA-b model on event stream

2. a shared versioned match buffer which is a optimized data structure

To Till and Chesnay:

Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.

[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf

Thanks, vino.

2018-07-17 22:01 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?

I know Flink is based to Stratosphere, but how is it FlinkCEP ?

BR Esa

Till Rohrmann

Re: FlinkCEP and scientific papers ?

You are right Vino,

the initial implementation was based on the above mentioned paper.

Cheers,

Till

On Tue, Jul 17, 2018 at 5:34 PM vino yang <[hidden email]> wrote:

Hi Esa,

AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:

1. NFA-b model on event stream
2. a shared versioned match buffer which is a optimized data structure

To Till and Chesnay:

Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.

[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf

Thanks, vino.

2018-07-17 22:01 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?

I know Flink is based to Stratosphere, but how is it FlinkCEP ?

BR Esa

Esa Heikkinen

RE: FlinkCEP and scientific papers ?

Thank you. This was very good paper for me J

How much current FlinkCEP works like this (the paper was written 2008) ?

Are there exist newer papers related to current FlinkCEP ?

BR Esa

From: Till Rohrmann <[hidden email]>
Sent: Wednesday, July 18, 2018 9:38 AM
To: vino yang <[hidden email]>
Cc: Esa Heikkinen <[hidden email]>; Chesnay Schepler <[hidden email]>; user <[hidden email]>
Subject: Re: FlinkCEP and scientific papers ?

You are right Vino,

the initial implementation was based on the above mentioned paper.

Cheers,

Till

On Tue, Jul 17, 2018 at 5:34 PM vino yang <[hidden email]> wrote:

Hi Esa,

AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:

1. NFA-b model on event stream

2. a shared versioned match buffer which is a optimized data structure

To Till and Chesnay:

Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.

[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf

Thanks, vino.

2018-07-17 22:01 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?

I know Flink is based to Stratosphere, but how is it FlinkCEP ?

BR Esa

vino yang

Re: FlinkCEP and scientific papers ?

Hi Esa,

I think the core implementation pattern is still based that paper, there is a package named "nfa"[1] contains the main thought.

The latest CEP module added more features and enhanced the old versio. What's more, there is a FLIP-20 which has been accepted, it described how to integrate with SQL and CEP.[2]

I think there is no newer paper related to current Flink CEP.

[1]: https://github.com/apache/flink/tree/master/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa

[2]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP

Thanks, vino.

2018-07-23 16:05 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

Thank you. This was very good paper for me J

How much current FlinkCEP works like this (the paper was written 2008) ?

Are there exist newer papers related to current FlinkCEP ?

BR Esa

From: Till Rohrmann <[hidden email]>
Sent: Wednesday, July 18, 2018 9:38 AM
To: vino yang <[hidden email]>
Cc: Esa Heikkinen <[hidden email]>; Chesnay Schepler <[hidden email]>; user <[hidden email]>
Subject: Re: FlinkCEP and scientific papers ?

You are right Vino,

the initial implementation was based on the above mentioned paper.

Cheers,

Till

On Tue, Jul 17, 2018 at 5:34 PM vino yang <[hidden email]> wrote:

Hi Esa,

AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:

1. NFA-b model on event stream

2. a shared versioned match buffer which is a optimized data structure

To Till and Chesnay:

Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.

[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf

Thanks, vino.

2018-07-17 22:01 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?

I know Flink is based to Stratosphere, but how is it FlinkCEP ?

BR Esa

Esa Heikkinen

RE: FlinkCEP and scientific papers ?

There was one good example of pattern query in the paper made by SASE+ language (in attachment).

Could you easily say how to do that FlickCEP with Scala ? Or is it possible ?

That SQL and CEP would also be very interesting, but when it is ready to use ?

BR Esa

From: vino yang <[hidden email]>
Sent: Monday, July 23, 2018 3:00 PM
To: Esa Heikkinen <[hidden email]>
Cc: Till Rohrmann <[hidden email]>; Chesnay Schepler <[hidden email]>; user <[hidden email]>
Subject: Re: FlinkCEP and scientific papers ?

Hi Esa,

I think the core implementation pattern is still based that paper, there is a package named "nfa"[1] contains the main thought.

The latest CEP module added more features and enhanced the old versio. What's more, there is a FLIP-20 which has been accepted, it described how to integrate with SQL and CEP.[2]

I think there is no newer paper related to current Flink CEP.

[1]: https://github.com/apache/flink/tree/master/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa

[2]: <a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP">https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP

Thanks, vino.

2018-07-23 16:05 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

Thank you. This was very good paper for me J

How much current FlinkCEP works like this (the paper was written 2008) ?

Are there exist newer papers related to current FlinkCEP ?

BR Esa

From: Till Rohrmann <[hidden email]>
Sent: Wednesday, July 18, 2018 9:38 AM
To: vino yang <[hidden email]>
Cc: Esa Heikkinen <[hidden email]>; Chesnay Schepler <[hidden email]>; user <[hidden email]>
Subject: Re: FlinkCEP and scientific papers ?

You are right Vino,

the initial implementation was based on the above mentioned paper.

Cheers,

Till

On Tue, Jul 17, 2018 at 5:34 PM vino yang <[hidden email]> wrote:

Hi Esa,

AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:

1. NFA-b model on event stream

2. a shared versioned match buffer which is a optimized data structure

To Till and Chesnay:

Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.

[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf

Thanks, vino.

2018-07-17 22:01 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?

I know Flink is based to Stratosphere, but how is it FlinkCEP ?

BR Esa

SASE example query 3.PNG (40K) Download Attachment

Timo Walther

Re: FlinkCEP and scientific papers ?

Hi Esa,

the SQL/CEP integration might be part of Flink 1.7. The discussion has just been started again [1].

Regards,
Timo

[1] https://issues.apache.org/jira/browse/FLINK-6935

Am 07.08.18 um 15:36 schrieb Esa Heikkinen:

There was one good example of pattern query in the paper made by SASE+ language (in attachment).

Could you easily say how to do that FlickCEP with Scala ? Or is it possible ?

That SQL and CEP would also be very interesting, but when it is ready to use ?

BR Esa

From: vino yang [hidden email]
Sent: Monday, July 23, 2018 3:00 PM
To: Esa Heikkinen [hidden email]
Cc: Till Rohrmann [hidden email]; Chesnay Schepler [hidden email]; user [hidden email]
Subject: Re: FlinkCEP and scientific papers ?

Hi Esa,

I think the core implementation pattern is still based that paper, there is a package named "nfa"[1] contains the main thought.

The latest CEP module added more features and enhanced the old versio. What's more, there is a FLIP-20 which has been accepted, it described how to integrate with SQL and CEP.[2]

I think there is no newer paper related to current Flink CEP.

[1]: https://github.com/apache/flink/tree/master/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa

[2]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP

Thanks, vino.

2018-07-23 16:05 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

Thank you. This was very good paper for me J

How much current FlinkCEP works like this (the paper was written 2008) ?

Are there exist newer papers related to current FlinkCEP ?

BR Esa

From: Till Rohrmann <[hidden email]>
Sent: Wednesday, July 18, 2018 9:38 AM
To: vino yang <[hidden email]>
Cc: Esa Heikkinen <[hidden email]>; Chesnay Schepler <[hidden email]>; user <[hidden email]>
Subject: Re: FlinkCEP and scientific papers ?

You are right Vino,

the initial implementation was based on the above mentioned paper.

Cheers,

Till

On Tue, Jul 17, 2018 at 5:34 PM vino yang <[hidden email]> wrote:

Hi Esa,

AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:

1. NFA-b model on event stream

2. a shared versioned match buffer which is a optimized data structure

To Till and Chesnay:

Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.

[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf

Thanks, vino.

2018-07-17 22:01 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?

I know Flink is based to Stratosphere, but how is it FlinkCEP ?

BR Esa

Esa Heikkinen

RE: FlinkCEP and scientific papers ?

What is the situation of SQL/CEP ?

Flink 1.7 is coming soon, but what about SQL/CEP ?

Whether it already exists documentation of SQL/CEP ?

Event better if there were scientific papers about it ?

BR Esa

From: Timo Walther <[hidden email]>
Sent: Tuesday, August 7, 2018 4:52 PM
To: [hidden email]
Subject: Re: FlinkCEP and scientific papers ?

There was one good example of pattern query in the paper made by SASE+ language (in attachment).

Could you easily say how to do that FlickCEP with Scala ? Or is it possible ?

That SQL and CEP would also be very interesting, but when it is ready to use ?

BR Esa

From: vino yang [hidden email]
Sent: Monday, July 23, 2018 3:00 PM
To: Esa Heikkinen [hidden email]
Cc: Till Rohrmann [hidden email]; Chesnay Schepler [hidden email]; user [hidden email]
Subject: Re: FlinkCEP and scientific papers ?

Hi Esa,

I think the core implementation pattern is still based that paper, there is a package named "nfa"[1] contains the main thought.

The latest CEP module added more features and enhanced the old versio. What's more, there is a FLIP-20 which has been accepted, it described how to integrate with SQL and CEP.[2]

I think there is no newer paper related to current Flink CEP.

[1]: https://github.com/apache/flink/tree/master/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa

[2]: <a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP">https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP

Thanks, vino.

2018-07-23 16:05 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

Thank you. This was very good paper for me J

How much current FlinkCEP works like this (the paper was written 2008) ?

Are there exist newer papers related to current FlinkCEP ?

BR Esa

From: Till Rohrmann <[hidden email]>
Sent: Wednesday, July 18, 2018 9:38 AM
To: vino yang <[hidden email]>
Cc: Esa Heikkinen <[hidden email]>; Chesnay Schepler <[hidden email]>; user <[hidden email]>
Subject: Re: FlinkCEP and scientific papers ?

You are right Vino,

the initial implementation was based on the above mentioned paper.

Cheers,

Till

On Tue, Jul 17, 2018 at 5:34 PM vino yang <[hidden email]> wrote:

Hi Esa,

AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:

1. NFA-b model on event stream

2. a shared versioned match buffer which is a optimized data structure

To Till and Chesnay:

Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.

[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf

Thanks, vino.

2018-07-17 22:01 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?

I know Flink is based to Stratosphere, but how is it FlinkCEP ?

BR Esa

Dawid Wysakowicz-2

Re: FlinkCEP and scientific papers ?

Hi Esa,

Flink 1.7 will come with an initial support for MATCH_RECOGNIZE clause which integrates Flink CEP library with SQL.

You can find the documentation for that feature in the SNAPSHOT docs: https://ci.apache.org/projects/flink/flink-docs-master/dev/table/streaming/match_recognize.html

Best,

Dawid

On 28/11/2018 10:06, Esa Heikkinen wrote:

Hi

What is the situation of SQL/CEP ?

Flink 1.7 is coming soon, but what about SQL/CEP ?

Whether it already exists documentation of SQL/CEP ?

Event better if there were scientific papers about it ?

BR Esa

From: Timo Walther [hidden email]
Sent: Tuesday, August 7, 2018 4:52 PM
To: [hidden email]
Subject: Re: FlinkCEP and scientific papers ?

Hi Esa,

the SQL/CEP integration might be part of Flink 1.7. The discussion has just been started again [1].

Regards,
Timo

[1] https://issues.apache.org/jira/browse/FLINK-6935

Am 07.08.18 um 15:36 schrieb Esa Heikkinen:

There was one good example of pattern query in the paper made by SASE+ language (in attachment).

Could you easily say how to do that FlickCEP with Scala ? Or is it possible ?

That SQL and CEP would also be very interesting, but when it is ready to use ?

BR Esa

From: vino yang [hidden email]
Sent: Monday, July 23, 2018 3:00 PM
To: Esa Heikkinen [hidden email]
Cc: Till Rohrmann [hidden email]; Chesnay Schepler [hidden email]; user [hidden email]
Subject: Re: FlinkCEP and scientific papers ?

Hi Esa,

I think the core implementation pattern is still based that paper, there is a package named "nfa"[1] contains the main thought.

The latest CEP module added more features and enhanced the old versio. What's more, there is a FLIP-20 which has been accepted, it described how to integrate with SQL and CEP.[2]

I think there is no newer paper related to current Flink CEP.

[1]: https://github.com/apache/flink/tree/master/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa

[2]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP

Thanks, vino.

2018-07-23 16:05 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

Thank you. This was very good paper for me J

How much current FlinkCEP works like this (the paper was written 2008) ?

Are there exist newer papers related to current FlinkCEP ?

BR Esa

From: Till Rohrmann <[hidden email]>
Sent: Wednesday, July 18, 2018 9:38 AM
To: vino yang <[hidden email]>
Cc: Esa Heikkinen <[hidden email]>; Chesnay Schepler <[hidden email]>; user <[hidden email]>
Subject: Re: FlinkCEP and scientific papers ?

You are right Vino,

the initial implementation was based on the above mentioned paper.

Cheers,

Till

On Tue, Jul 17, 2018 at 5:34 PM vino yang <[hidden email]> wrote:

Hi Esa,

AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:

1. NFA-b model on event stream

2. a shared versioned match buffer which is a optimized data structure

To Till and Chesnay:

Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.

[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf

Thanks, vino.

2018-07-17 22:01 GMT+08:00 Esa Heikkinen <[hidden email]>:

Hi

I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?

I know Flink is based to Stratosphere, but how is it FlinkCEP ?

BR Esa

signature.asc (849 bytes) Download Attachment