How to create User Notifications/Reminder ?

[shyla deshpande]

I need to create User Notification/Reminder when I don’t see a specific event (high volume) from that user for more than 2 weeks.

Should I be using windowing or CEP or  ProcessFunction?

I am pretty new to Flink. Can anyone please advise me what is the best way to solve this?

Thank you for your time.

[Hequn Cheng]

Hi shyla,

There is a same question[1] asked two days ago. Maybe it is helpful for you. Let me know if you have any other concern.

Best, Hequn

[1] http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-trigger-a-function-on-the-state-periodically-td21311.html 

On Thu, Jul 12, 2018 at 4:50 AM, shyla deshpande <[hidden email]> wrote:

I need to create User Notification/Reminder when I don’t see a specific event (high volume) from that user for more than 2 weeks.

Should I be using windowing or CEP or  ProcessFunction?

I am pretty new to Flink. Can anyone please advise me what is the best way to solve this?

Thank you for your time.

[shyla deshpande]

Hi Hequen,

I was more interested in solving using CEP. 

I want to have a window of 2 weeks and in the Timeout Handler I want to create Notification/Reminder.

Is this doable in Flink 1.4.2.?

Thanks 

On Wed, Jul 11, 2018 at 6:14 PM, Hequn Cheng <[hidden email]> wrote:

Hi shyla,

There is a same question[1] asked two days ago. Maybe it is helpful for you. Let me know if you have any other concern.

Best, Hequn

[1] http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-trigger-a-function-on-the-state-periodically-td21311.html 

On Thu, Jul 12, 2018 at 4:50 AM, shyla deshpande <[hidden email]> wrote:

I need to create User Notification/Reminder when I don’t see a specific event (high volume) from that user for more than 2 weeks.

Should I be using windowing or CEP or  ProcessFunction?

I am pretty new to Flink. Can anyone please advise me what is the best way to solve this?

Thank you for your time.

[Hequn Cheng]

Hi shyla,

Considering window, I think it is not very convenient. Two weeks window is used to process data in the recent 2 weeks while you want to process data beyond 2 weeks.

I'm not familiar with CEP, but it sounds like a good idea.

Best, Hequn

 

On Thu, Jul 12, 2018 at 10:56 AM, shyla deshpande <[hidden email]> wrote:

Hi Hequen,

I was more interested in solving using CEP. 

I want to have a window of 2 weeks and in the Timeout Handler I want to create Notification/Reminder.

Is this doable in Flink 1.4.2.?

Thanks 

On Wed, Jul 11, 2018 at 6:14 PM, Hequn Cheng <[hidden email]> wrote:

Hi shyla,

There is a same question[1] asked two days ago. Maybe it is helpful for you. Let me know if you have any other concern.

Best, Hequn

[1] http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-trigger-a-function-on-the-state-periodically-td21311.html 

On Thu, Jul 12, 2018 at 4:50 AM, shyla deshpande <[hidden email]> wrote:

I need to create User Notification/Reminder when I don’t see a specific event (high volume) from that user for more than 2 weeks.

Should I be using windowing or CEP or  ProcessFunction?

I am pretty new to Flink. Can anyone please advise me what is the best way to solve this?

Thank you for your time.

[Dawid Wysakowicz]

Hi shyla,

It should be doable with CEP. You can create pattern like: Pattern.begin("start").next/followedBy("end").where(...).within(/* two weeks*/) and subscribe for timed out events. You can check very similar example here[1].

Best,

Dawid

[1] https://github.com/dataArtisans/flink-training-exercises/blob/master/src/main/java/com/dataartisans/flinktraining/exercises/datastream_java/cep/LongRidesExercise.java

On 12/07/18 14:26, Hequn Cheng wrote:

Hi shyla,

Considering window, I think it is not very convenient. Two weeks window is used to process data in the recent 2 weeks while you want to process data beyond 2 weeks.

I'm not familiar with CEP, but it sounds like a good idea.

Best, Hequn

 

On Thu, Jul 12, 2018 at 10:56 AM, shyla deshpande <[hidden email]> wrote:

Hi Hequen,

I was more interested in solving using CEP. 

I want to have a window of 2 weeks and in the Timeout Handler I want to create Notification/Reminder.

Is this doable in Flink 1.4.2.?

Thanks 

On Wed, Jul 11, 2018 at 6:14 PM, Hequn Cheng <[hidden email]> wrote:

Hi shyla,

There is a same question[1] asked two days ago. Maybe it is helpful for you. Let me know if you have any other concern.

Best, Hequn

[1] http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-trigger-a-function-on-the-state-periodically-td21311.html 

On Thu, Jul 12, 2018 at 4:50 AM, shyla deshpande <[hidden email]> wrote:

I need to create User Notification/Reminder when I don’t see a specific event (high volume) from that user for more than 2 weeks.

Should I be using windowing or CEP or  ProcessFunction?

I am pretty new to Flink. Can anyone please advise me what is the best way to solve this?

Thank you for your time.

[anna stax]

Thanks Hequn and Dawid for your input.  Thanks Dawid for the link.  Great help!

On Thu, Jul 12, 2018 at 5:59 AM, Dawid Wysakowicz <[hidden email]> wrote:

Hi shyla,

It should be doable with CEP. You can create pattern like: Pattern.begin("start").next/followedBy("end").where(...).within(/* two weeks*/) and subscribe for timed out events. You can check very similar example here[1].

Best,

Dawid

[1] https://github.com/dataArtisans/flink-training-exercises/blob/master/src/main/java/com/dataartisans/flinktraining/exercises/datastream_java/cep/LongRidesExercise.java

On 12/07/18 14:26, Hequn Cheng wrote:

Hi shyla,

Considering window, I think it is not very convenient. Two weeks window is used to process data in the recent 2 weeks while you want to process data beyond 2 weeks.

I'm not familiar with CEP, but it sounds like a good idea.

Best, Hequn

 

On Thu, Jul 12, 2018 at 10:56 AM, shyla deshpande <[hidden email]> wrote:

Hi Hequen,

I was more interested in solving using CEP. 

I want to have a window of 2 weeks and in the Timeout Handler I want to create Notification/Reminder.

Is this doable in Flink 1.4.2.?

Thanks 

On Wed, Jul 11, 2018 at 6:14 PM, Hequn Cheng <[hidden email]> wrote:

Hi shyla,

There is a same question[1] asked two days ago. Maybe it is helpful for you. Let me know if you have any other concern.

Best, Hequn

[1] http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-trigger-a-function-on-the-state-periodically-td21311.html 

On Thu, Jul 12, 2018 at 4:50 AM, shyla deshpande <[hidden email]> wrote:

I need to create User Notification/Reminder when I don’t see a specific event (high volume) from that user for more than 2 weeks.

Should I be using windowing or CEP or  ProcessFunction?

I am pretty new to Flink. Can anyone please advise me what is the best way to solve this?

Thank you for your time.

[shyla deshpande]

Thanks a lot Dawid and Hequn. Dawid, the link you provided is very useful. 

Thanks

shyla

On Thu, Jul 12, 2018 at 5:59 AM, Dawid Wysakowicz <[hidden email]> wrote:

Hi shyla,

It should be doable with CEP. You can create pattern like: Pattern.begin("start").next/followedBy("end").where(...).within(/* two weeks*/) and subscribe for timed out events. You can check very similar example here[1].

Best,

Dawid

[1] https://github.com/dataArtisans/flink-training-exercises/blob/master/src/main/java/com/dataartisans/flinktraining/exercises/datastream_java/cep/LongRidesExercise.java

On 12/07/18 14:26, Hequn Cheng wrote:

Hi shyla,

Considering window, I think it is not very convenient. Two weeks window is used to process data in the recent 2 weeks while you want to process data beyond 2 weeks.

I'm not familiar with CEP, but it sounds like a good idea.

Best, Hequn

 

On Thu, Jul 12, 2018 at 10:56 AM, shyla deshpande <[hidden email]> wrote:

Hi Hequen,

I was more interested in solving using CEP. 

I want to have a window of 2 weeks and in the Timeout Handler I want to create Notification/Reminder.

Is this doable in Flink 1.4.2.?

Thanks 

On Wed, Jul 11, 2018 at 6:14 PM, Hequn Cheng <[hidden email]> wrote:

Hi shyla,

There is a same question[1] asked two days ago. Maybe it is helpful for you. Let me know if you have any other concern.

Best, Hequn

[1] http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-trigger-a-function-on-the-state-periodically-td21311.html 

On Thu, Jul 12, 2018 at 4:50 AM, shyla deshpande <[hidden email]> wrote:

I need to create User Notification/Reminder when I don’t see a specific event (high volume) from that user for more than 2 weeks.

Should I be using windowing or CEP or  ProcessFunction?

I am pretty new to Flink. Can anyone please advise me what is the best way to solve this?

Thank you for your time.