working with flink Session Windows

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

working with flink Session Windows

Antonio Saldivar Lezama
Hello

I am building an app but for this UC I want to test with session windows and I am not sure if this will be expensive for the compute resources because the gap will be 10 mins, 20 mins 60 mins because I want to trigger an alert if the element reaches some thresholds within those periods of time.

flink version 1.4.2

Thank you
Best Regards
Antonio Saldivar
Reply | Threaded
Open this post in threaded view
|

Re: working with flink Session Windows

Hequn Cheng
Hi antonio,

I think it worth a try to test the performance in your scenario, since job performance can be affected by a number of factors(say your WindowFunction).

Best, Hequn

On Sat, Jul 21, 2018 at 2:59 AM, antonio saldivar <[hidden email]> wrote:
Hello

I am building an app but for this UC I want to test with session windows and I am not sure if this will be expensive for the compute resources because the gap will be 10 mins, 20 mins 60 mins because I want to trigger an alert if the element reaches some thresholds within those periods of time.

flink version 1.4.2

Thank you
Best Regards
Antonio Saldivar

Reply | Threaded
Open this post in threaded view
|

Re: working with flink Session Windows

Antonio Saldivar Lezama
Hello

Actually I evaluate my WindowFunction with a trigger alert, having something like below code (testing with 2 different windows), expecting 5K elements per second arriving 


SingleOutputStreamOperator<String> windowedElem = element

.keyBy("id")

.timeWindow(Time.seconds(120))

//     .window(EventTimeSessionWindows.withGap(Time.minutes(20)))

.trigger(new AlertTrigger(env.getStreamTimeCharacteristic())

.aggregate(new EleAggregator(), new EleWindowFn())



El vie., 20 jul. 2018 a las 21:23, Hequn Cheng (<[hidden email]>) escribió:
Hi antonio,

I think it worth a try to test the performance in your scenario, since job performance can be affected by a number of factors(say your WindowFunction).

Best, Hequn

On Sat, Jul 21, 2018 at 2:59 AM, antonio saldivar <[hidden email]> wrote:
Hello

I am building an app but for this UC I want to test with session windows and I am not sure if this will be expensive for the compute resources because the gap will be 10 mins, 20 mins 60 mins because I want to trigger an alert if the element reaches some thresholds within those periods of time.

flink version 1.4.2

Thank you
Best Regards
Antonio Saldivar