Simple CEP pattern

[Esa Heikkinen]

What would be the simplest working CEP (Scala) pattern ?

I want to test if my CEP application works at all.

 

Best, Esa

[Kostas Kloudas]

Hi Esa,

You could try the examples either from the documentation or from the training.

http://training.data-artisans.com/exercises/CEP.html

Kostas

On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <[hidden email]> wrote:

What would be the simplest working CEP (Scala) pattern ?

I want to test if my CEP application works at all.

 

Best, Esa

[Esa Heikkinen]

Hi

 

I have tried this CEP example of Data-artisans and it works. It is also only fully working example I have found, but it little bit too complex for my purpose. I have also tried to read the documentation, but I have not found about simple “Hello World” type example about Flink’s CEP.

 

It is surprisingly difficult to form correct Pattern, because there are many operators and how to combine them by correct way..

It looks like very simple, but in practice it has not been for me, but this maybe because I am new with FlinkCEP.

 

Often I don’t know is it problem with “pattern” or “select”, because no results.. Is there any way to debug CEP’s operations ?

 

Best, Esa

 

From: Kostas Kloudas [mailto:[hidden email]]
Sent: Wednesday, March 7, 2018 2:54 PM
To: Esa Heikkinen <[hidden email]>
Cc: [hidden email]
Subject: Re: Simple CEP pattern

 

Hi Esa,

 

You could try the examples either from the documentation or from the training.

http://training.data-artisans.com/exercises/CEP.html

 

Kostas

On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <[hidden email]> wrote:

 

What would be the simplest working CEP (Scala) pattern ?

I want to test if my CEP application works at all.

 

Best, Esa

 

[Kostas Kloudas]

Hi Esa,

You can always test your pattern in isolation.
For an example on how to do that, if you have access to the flink source code, 

you can check the UntilConditionITCase or any other ITCase in the same package.

It can also be found here: https://github.com/apache/flink/blob/master/flink-libraries/flink-cep/src/test/java/org/apache/flink/cep/nfa/UntilConditionITCase.java

Kostas

On Mar 7, 2018, at 2:43 PM, Esa Heikkinen <[hidden email]> wrote:

Hi
 
I have tried this CEP example of Data-artisans and it works. It is also only fully working example I have found, but it little bit too complex for my purpose. I have also tried to read the documentation, but I have not found about simple “Hello World” type example about Flink’s CEP.
 
It is surprisingly difficult to form correct Pattern, because there are many operators and how to combine them by correct way..
It looks like very simple, but in practice it has not been for me, but this maybe because I am new with FlinkCEP.
 
Often I don’t know is it problem with “pattern” or “select”, because no results.. Is there any way to debug CEP’s operations ? 
 
Best, Esa
 
From: Kostas Kloudas [[hidden email]] 
Sent: Wednesday, March 7, 2018 2:54 PM
To: Esa Heikkinen <[hidden email]>
Cc: [hidden email]
Subject: Re: Simple CEP pattern
 
Hi Esa,
 
You could try the examples either from the documentation or from the training.
http://training.data-artisans.com/exercises/CEP.html
 
Kostas


On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <[hidden email]> wrote:
 
What would be the simplest working CEP (Scala) pattern ?

I want to test if my CEP application works at all.
 
Best, Esa

[Esa Heikkinen]

Hi

 

Yes I have access to the flink source code, but could you explain little bit more what to do with it in this case ?

 

Best, Esa

 

From: Kostas Kloudas [mailto:[hidden email]]
Sent: Wednesday, March 7, 2018 3:51 PM
To: Esa Heikkinen <[hidden email]>
Cc: [hidden email]
Subject: Re: Simple CEP pattern

 

Hi Esa,

You can always test your pattern in isolation.
For an example on how to do that, if you have access to the flink source code, 

you can check the UntilConditionITCase or any other ITCase in the same package.

 

It can also be found here: https://github.com/apache/flink/blob/master/flink-libraries/flink-cep/src/test/java/org/apache/flink/cep/nfa/UntilConditionITCase.java

Kostas

On Mar 7, 2018, at 2:43 PM, Esa Heikkinen <[hidden email]> wrote:

Hi
 
I have tried this CEP example of Data-artisans and it works. It is also only fully working example I have found, but it little bit too complex for my purpose. I have also tried to read the documentation, but I have not found about simple “Hello World” type example about Flink’s CEP.
 
It is surprisingly difficult to form correct Pattern, because there are many operators and how to combine them by correct way..
It looks like very simple, but in practice it has not been for me, but this maybe because I am new with FlinkCEP.
 
Often I don’t know is it problem with “pattern” or “select”, because no results.. Is there any way to debug CEP’s operations ? 
 
Best, Esa
 
From: Kostas Kloudas [[hidden email]] 
Sent: Wednesday, March 7, 2018 2:54 PM
To: Esa Heikkinen <[hidden email]>
Cc: [hidden email]
Subject: Re: Simple CEP pattern
 
Hi Esa,
 
You could try the examples either from the documentation or from the training.
http://training.data-artisans.com/exercises/CEP.html
 
Kostas


On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <[hidden email]> wrote:
 
What would be the simplest working CEP (Scala) pattern ?

I want to test if my CEP application works at all.
 
Best, Esa

 

[Kostas Kloudas]

Hi,

You can adjust it to see if your pattern works. 

I thought that this is what you want to do.

If you want to run it on a cluster or run a full job, then 

the best way is actually do that. Write the job using the quickstart,

launch a cluster locally using the start-cluster.sh script, submit the job,

and check out its progress though the webmonitor.

There you also have access to the individual TaskManager and JobManager

logs, in case something goes wrong.

Cheers,

Kostas

On Mar 7, 2018, at 3:44 PM, Esa Heikkinen <[hidden email]> wrote:

Hi

 

Yes I have access to the flink source code, but could you explain little bit more what to do with it in this case ?

 

Best, Esa

 

From: Kostas Kloudas [[hidden email]] 
Sent: Wednesday, March 7, 2018 3:51 PM
To: Esa Heikkinen <[hidden email]>
Cc: [hidden email]
Subject: Re: Simple CEP pattern

 

Hi Esa,

You can always test your pattern in isolation.
For an example on how to do that, if you have access to the flink source code, 

you can check the UntilConditionITCase or any other ITCase in the same package.

 

It can also be found here: https://github.com/apache/flink/blob/master/flink-libraries/flink-cep/src/test/java/org/apache/flink/cep/nfa/UntilConditionITCase.java

Kostas

On Mar 7, 2018, at 2:43 PM, Esa Heikkinen <[hidden email]> wrote:

Hi
 
I have tried this CEP example of Data-artisans and it works. It is also only fully working example I have found, but it little bit too complex for my purpose. I have also tried to read the documentation, but I have not found about simple “Hello World” type example about Flink’s CEP.
 
It is surprisingly difficult to form correct Pattern, because there are many operators and how to combine them by correct way..
It looks like very simple, but in practice it has not been for me, but this maybe because I am new with FlinkCEP.
 
Often I don’t know is it problem with “pattern” or “select”, because no results.. Is there any way to debug CEP’s operations ? 
 
Best, Esa
 
From: Kostas Kloudas [[hidden email]] 
Sent: Wednesday, March 7, 2018 2:54 PM
To: Esa Heikkinen <[hidden email]>
Cc: [hidden email]
Subject: Re: Simple CEP pattern
 
Hi Esa,
 
You could try the examples either from the documentation or from the training.
http://training.data-artisans.com/exercises/CEP.html
 
Kostas


On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <[hidden email]> wrote:
 
What would be the simplest working CEP (Scala) pattern ?

I want to test if my CEP application works at all.
 
Best, Esa