Re: processWindowFunction
Posted by
Antonio Saldivar Lezama on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/processWindowFunction-tp22366p22407.html
hi Vino
it is possible to use global window, then set the trigger onElement comparing the element that has arrived with for example 10 mins, 20 mins and 60 mins of data?
I have rules evaluating sum of amount for 10,20 or 60 mins for the same keyed element if the same id sum like $200 total within those thresholds and count more or equals to 3 I need to be able to set some values to the object if the object does not reach those thresholds i do not set the values and keep sending the output with or without those value.
just processing the object on the fly and send output
El vie., 17 ago. 2018 a las 22:14, vino yang (<
[hidden email]>) escribió:
Hi antonio,
Yes, ProcessWindowFunction is a very low level window function.
It allows you to access the data in the window and allows you to customize the output of the window.
So if you use it, while giving you flexibility, you need to think about other things, which may require you to write more processing logic.
Generally speaking, sliding windows usually have some data that is repeated, but a common mode is to apply a reduce function on it to get your calculation results.
If you only send data, there will definitely be some duplication.
Thanks, vino.
Hi Vino
thank you for the information, actually I am using a trigger alert and processWindowFunction to send my results, but when my window slides or ends it sends again the objects and I an getting duplicated data
El jue., 16 ago. 2018 a las 22:05, vino yang (<
[hidden email]>) escribió:
Hi Antonio,
What results do not you want to get when creating each window?
Examples of the use of ProcessWindowFunction are included in many test files in Flink's project, such as SideOutputITCase.scala or WindowTranslationTest.scala.
For more information on ProcessWindowFunction, you can refer to the official website.[1]
Thanks, vino.
Hello
I am implementing a data stream where I use sliding windows but I am stuck because I need to set values to my object based on some if statements in my process function and send the object to the next step but I don't want results every time a window is creating
if anyone has a good example on this that can help me