(DEPRECATED) Apache Flink User Mailing List archive.

FlinkCEP and SQL?

classic Classic list List threaded Threaded
♦
♦
 10 messages Options
Esa Heikkinen (TAU)
Reply | Threaded
Open this post in threaded view
♦
♦
|

FlinkCEP and SQL?

Esa Heikkinen (TAU)

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa

 
jincheng sun
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: FlinkCEP and SQL?

jincheng sun
Hi BR Esa,
Best,
Jincheng

Esa Heikkinen (TAU) <[hidden email]> 于2019年4月4日周四 下午4:44写道：

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa

 
Esa Heikkinen (TAU)
Reply | Threaded
Open this post in threaded view
♦
♦
|

RE: FlinkCEP and SQL?

Esa Heikkinen (TAU)

Hi

 

Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP?

 

BR Esa

 

From: jincheng sun <[hidden email]>
Sent: Thursday, April 4, 2019 1:05 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi BR Esa,

Best,

Jincheng

 

Esa Heikkinen (TAU) <[hidden email]> 于2019年4月4日周四 下午4:44写道：

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa

 
Dian Fu
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: FlinkCEP and SQL?

Dian Fu
Should the all sources be combined into one big table before operations with SQL CEP?

Yes, you should combine them into one table/stream.

Regards,
Dian

在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) <[hidden email]> 写道：

Hi
 
Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP?
 
BR Esa
 
From: jincheng sun <[hidden email]> 
Sent: Thursday, April 4, 2019 1:05 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: [hidden email]
Subject: Re: FlinkCEP and SQL?
 
Hi BR Esa,
Best,
Jincheng
 
Esa Heikkinen (TAU) <[hidden email]> 于2019年4月4日周四 下午4:44写道：

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa
Esa Heikkinen (TAU)
Reply | Threaded
Open this post in threaded view
♦
♦
|

RE: FlinkCEP and SQL?

Esa Heikkinen (TAU)

Hi

 

Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP completely separate ?

 

BR Esa

 

From: Dian Fu <[hidden email]>
Sent: Thursday, April 4, 2019 2:37 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: jincheng sun <[hidden email]>; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Should the all sources be combined into one big table before operations with SQL CEP?

 

Yes, you should combine them into one table/stream.

 

Regards,

Dian

 

在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) <[hidden email]> 写道：

 

Hi

 

Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP?

 

BR Esa

 

From: jincheng sun <[hidden email]> 
Sent: Thursday, April 4, 2019 1:05 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi BR Esa,

Best,

Jincheng

 

Esa Heikkinen (TAU) <[hidden email]> 于2019年4月4日周四 下午4:44写道：

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa

 
Fabian Hueske-2
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: FlinkCEP and SQL?

Fabian Hueske-2
Hi Esa,

Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP library, i.e., they share the same implementation.

Best, Fabian

Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) <[hidden email]>:

Hi

 

Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP completely separate ?

 

BR Esa

 

From: Dian Fu <[hidden email]>
Sent: Thursday, April 4, 2019 2:37 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: jincheng sun <[hidden email]>; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Should the all sources be combined into one big table before operations with SQL CEP?

 

Yes, you should combine them into one table/stream.

 

Regards,

Dian

 

在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) <[hidden email]> 写道：

 

Hi

 

Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP?

 

BR Esa

 

From: jincheng sun <[hidden email]> 
Sent: Thursday, April 4, 2019 1:05 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi BR Esa,

Best,

Jincheng

 

Esa Heikkinen (TAU) <[hidden email]> 于2019年4月4日周四 下午4:44写道：

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa

 
Esa Heikkinen (TAU)
Reply | Threaded
Open this post in threaded view
♦
♦
|

RE: FlinkCEP and SQL?

Esa Heikkinen (TAU)

Hi

 

Is there any good scientific papers about using SQL MATCH_RECOGNIZE in Flink and CEP ?

 

The only one good paper about Flink and CEP that I have received was “Efficient Pattern Matching over Event Streams” (SIGMOD 2008). Its SASE+ Event Pattern Language (EPL) is best I have met. I have been told that FlinkCEP is based on this.

 

BR Esa

 

From: Fabian Hueske <[hidden email]>
Sent: Thursday, April 11, 2019 11:33 AM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: Dian Fu <[hidden email]>; jincheng sun <[hidden email]>; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi Esa,

 

Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP library, i.e., they share the same implementation.

 

Best, Fabian

 

Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) <[hidden email]>:

Hi

 

Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP completely separate ?

 

BR Esa

 

From: Dian Fu <[hidden email]>
Sent: Thursday, April 4, 2019 2:37 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: jincheng sun <[hidden email]>; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Should the all sources be combined into one big table before operations with SQL CEP?

 

Yes, you should combine them into one table/stream.

 

Regards,

Dian

 

在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) <[hidden email]> 写道：

 

Hi

 

Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP?

 

BR Esa

 

From: jincheng sun <[hidden email]> 
Sent: Thursday, April 4, 2019 1:05 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi BR Esa,

Best,

Jincheng

 

Esa Heikkinen (TAU) <[hidden email]> 于2019年4月4日周四 下午4:44写道：

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa

 
Dawid Wysakowicz-2
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: FlinkCEP and SQL?

Dawid Wysakowicz-2

Hi Esa,

Have you checked out the flink documentation for this topic[1]? Is there something you are missing from there? Also the MATCH_RECOGNIZE is described in the SQL:2016 standard[2].

For the Flink CEP library, yes it is inspired by the paper you mentioned.

Best,

Dawid


[1] https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/table/streaming/match_recognize.html

[2] https://standards.iso.org/ittf/PubliclyAvailableStandards/c065143_ISO_IEC_TR_19075-5_2016.zip

On 11/04/2019 10:52, Esa Heikkinen (TAU) wrote:

Hi

 

Is there any good scientific papers about using SQL MATCH_RECOGNIZE in Flink and CEP ?

 

The only one good paper about Flink and CEP that I have received was “Efficient Pattern Matching over Event Streams” (SIGMOD 2008). Its SASE+ Event Pattern Language (EPL) is best I have met. I have been told that FlinkCEP is based on this.

 

BR Esa

 

From: Fabian Hueske [hidden email]
Sent: Thursday, April 11, 2019 11:33 AM
To: Esa Heikkinen (TAU) [hidden email]
Cc: Dian Fu [hidden email]; jincheng sun [hidden email]; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi Esa,

 

Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP library, i.e., they share the same implementation.

 

Best, Fabian

 

Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) <[hidden email]>:

Hi

 

Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP completely separate ?

 

BR Esa

 

From: Dian Fu <[hidden email]>
Sent: Thursday, April 4, 2019 2:37 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: jincheng sun <[hidden email]>; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Should the all sources be combined into one big table before operations with SQL CEP?

 

Yes, you should combine them into one table/stream.

 

Regards,

Dian

 

在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) <[hidden email]> 写道：

 

Hi

 

Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP?

 

BR Esa

 

From: jincheng sun <[hidden email]> 
Sent: Thursday, April 4, 2019 1:05 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi BR Esa,

Best,

Jincheng

 

Esa Heikkinen (TAU) <[hidden email]> 于2019年4月4日周四 下午4:44写道：

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa

 


signature.asc (849 bytes) Download Attachment
Esa Heikkinen (TAU)
Reply | Threaded
Open this post in threaded view
♦
♦
|

RE: FlinkCEP and SQL?

Esa Heikkinen (TAU)

Hi

 

Thank you. I need to read them. Does this all work in Flink 1.8 now ?

 

BR Esa

 

From: Dawid Wysakowicz <[hidden email]>
Sent: Thursday, April 11, 2019 12:59 PM
To: Esa Heikkinen (TAU) <[hidden email]>; Fabian Hueske <[hidden email]>
Cc: Dian Fu <[hidden email]>; jincheng sun <[hidden email]>; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi Esa,

Have you checked out the flink documentation for this topic[1]? Is there something you are missing from there? Also the MATCH_RECOGNIZE is described in the SQL:2016 standard[2].

For the Flink CEP library, yes it is inspired by the paper you mentioned.

Best,

Dawid

 

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/table/streaming/match_recognize.html

[2] https://standards.iso.org/ittf/PubliclyAvailableStandards/c065143_ISO_IEC_TR_19075-5_2016.zip

On 11/04/2019 10:52, Esa Heikkinen (TAU) wrote:

Hi

 

Is there any good scientific papers about using SQL MATCH_RECOGNIZE in Flink and CEP ?

 

The only one good paper about Flink and CEP that I have received was “Efficient Pattern Matching over Event Streams” (SIGMOD 2008). Its SASE+ Event Pattern Language (EPL) is best I have met. I have been told that FlinkCEP is based on this.

 

BR Esa

 

From: Fabian Hueske [hidden email]
Sent: Thursday, April 11, 2019 11:33 AM
To: Esa Heikkinen (TAU) [hidden email]
Cc: Dian Fu [hidden email]; jincheng sun [hidden email]; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi Esa,

 

Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP library, i.e., they share the same implementation.

 

Best, Fabian

 

Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) <[hidden email]>:

Hi

 

Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP completely separate ?

 

BR Esa

 

From: Dian Fu <[hidden email]>
Sent: Thursday, April 4, 2019 2:37 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: jincheng sun <[hidden email]>; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Should the all sources be combined into one big table before operations with SQL CEP?

 

Yes, you should combine them into one table/stream.

 

Regards,

Dian

 

在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) <[hidden email]> 写道：

 

Hi

 

Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP?

 

BR Esa

 

From: jincheng sun <[hidden email]> 
Sent: Thursday, April 4, 2019 1:05 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi BR Esa,

Best,

Jincheng

 

Esa Heikkinen (TAU) <[hidden email]> 于2019年4月4日周四 下午4:44写道：

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa

 
Dawid Wysakowicz-2
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: FlinkCEP and SQL?

Dawid Wysakowicz-2

The documentation should say which parts are supported and which are not. I would say the majority of important features works.

Best,

Dawid

On 11/04/2019 12:40, Esa Heikkinen (TAU) wrote:

Hi

 

Thank you. I need to read them. Does this all work in Flink 1.8 now ?

 

BR Esa

 

From: Dawid Wysakowicz [hidden email]
Sent: Thursday, April 11, 2019 12:59 PM
To: Esa Heikkinen (TAU) [hidden email]; Fabian Hueske [hidden email]
Cc: Dian Fu [hidden email]; jincheng sun [hidden email]; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi Esa,

Have you checked out the flink documentation for this topic[1]? Is there something you are missing from there? Also the MATCH_RECOGNIZE is described in the SQL:2016 standard[2].

For the Flink CEP library, yes it is inspired by the paper you mentioned.

Best,

Dawid

 

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/table/streaming/match_recognize.html

[2] https://standards.iso.org/ittf/PubliclyAvailableStandards/c065143_ISO_IEC_TR_19075-5_2016.zip

On 11/04/2019 10:52, Esa Heikkinen (TAU) wrote:

Hi

 

Is there any good scientific papers about using SQL MATCH_RECOGNIZE in Flink and CEP ?

 

The only one good paper about Flink and CEP that I have received was “Efficient Pattern Matching over Event Streams” (SIGMOD 2008). Its SASE+ Event Pattern Language (EPL) is best I have met. I have been told that FlinkCEP is based on this.

 

BR Esa

 

From: Fabian Hueske [hidden email]
Sent: Thursday, April 11, 2019 11:33 AM
To: Esa Heikkinen (TAU) [hidden email]
Cc: Dian Fu [hidden email]; jincheng sun [hidden email]; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi Esa,

 

Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP library, i.e., they share the same implementation.

 

Best, Fabian

 

Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) <[hidden email]>:

Hi

 

Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP completely separate ?

 

BR Esa

 

From: Dian Fu <[hidden email]>
Sent: Thursday, April 4, 2019 2:37 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: jincheng sun <[hidden email]>; [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Should the all sources be combined into one big table before operations with SQL CEP?

 

Yes, you should combine them into one table/stream.

 

Regards,

Dian

 

在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) <[hidden email]> 写道：

 

Hi

 

Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP?

 

BR Esa

 

From: jincheng sun <[hidden email]> 
Sent: Thursday, April 4, 2019 1:05 PM
To: Esa Heikkinen (TAU) <[hidden email]>
Cc: [hidden email]
Subject: Re: FlinkCEP and SQL?

 

Hi BR Esa,

Best,

Jincheng

 

Esa Heikkinen (TAU) <[hidden email]> 于2019年4月4日周四 下午4:44写道：

Hi

 

What is the situation of FlinkCEP and SQL?

 

Is it already possible to use SQL in CEP?

 

Is there any example cases where SQL is used in CEP?

 

BR Esa

 


signature.asc (849 bytes) Download Attachment
Free forum by Nabble Edit this page