Thank you fro the references I have now my processFunction and getting the state but now how can i do for the threshold times to group the elements and also as this is a global window, how to purge because if going to keep increasing
El dom., 19 ago. 2018 a las 8:57, vino yang (<yanghua1...@gmail.com>) escribió: > Hi antonio, > > Regarding your scenario, I think maybe you can consider using the > ProcessFunction (or keyed ProcessFunction) function directly on the Stream. > [1] > It can handle each of your elements with a Timer, and you can combine > Flink's state API[2] to store your data. > > [1]: > https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/process_function.html#process-function-low-level-operations > [2]: > https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/stream/state/state.html#working-with-state > > Thanks, vino. > > antonio saldivar <ansal...@gmail.com> 于2018年8月19日周日 上午10:18写道： > >> hi Vino >> >> it is possible to use global window, then set the trigger onElement >> comparing the element that has arrived with for example 10 mins, 20 mins >> and 60 mins of data? >> >> I have rules evaluating sum of amount for 10,20 or 60 mins for the same >> keyed element if the same id sum like $200 total within those thresholds >> and count more or equals to 3 I need to be able to set some values to the >> object if the object does not reach those thresholds i do not set the >> values and keep sending the output with or without those value. >> >> just processing the object on the fly and send output >> >> >> >> >> >> >> >> El vie., 17 ago. 2018 a las 22:14, vino yang (<yanghua1...@gmail.com>) >> escribió: >> >>> Hi antonio, >>> >>> Yes, ProcessWindowFunction is a very low level window function. >>> It allows you to access the data in the window and allows you to >>> customize the output of the window. >>> So if you use it, while giving you flexibility, you need to think about >>> other things, which may require you to write more processing logic. >>> >>> Generally speaking, sliding windows usually have some data that is >>> repeated, but a common mode is to apply a reduce function on it to get your >>> calculation results. >>> If you only send data, there will definitely be some duplication. >>> >>> Thanks, vino. >>> >>> antonio saldivar <ansal...@gmail.com> 于2018年8月17日周五 下午12:01写道： >>> >>>> Hi Vino >>>> thank you for the information, actually I am using a trigger alert and >>>> processWindowFunction to send my results, but when my window slides or ends >>>> it sends again the objects and I an getting duplicated data >>>> >>>> El jue., 16 ago. 2018 a las 22:05, vino yang (<yanghua1...@gmail.com>) >>>> escribió: >>>> >>>>> Hi Antonio, >>>>> >>>>> What results do not you want to get when creating each window? >>>>> Examples of the use of ProcessWindowFunction are included in many test >>>>> files in Flink's project, such as SideOutputITCase.scala or >>>>> WindowTranslationTest.scala. >>>>> >>>>> For more information on ProcessWindowFunction, you can refer to the >>>>> official website.[1] >>>>> >>>>> [1]: >>>>> https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/stream/operators/windows.html#processwindowfunction >>>>> >>>>> Thanks, vino. >>>>> >>>>> antonio saldivar <ansal...@gmail.com> 于2018年8月17日周五 上午6:24写道： >>>>> >>>>>> Hello >>>>>> >>>>>> I am implementing a data stream where I use sliding windows but I am >>>>>> stuck because I need to set values to my object based on some if >>>>>> statements >>>>>> in my process function and send the object to the next step but I don't >>>>>> want results every time a window is creating >>>>>> >>>>>> if anyone has a good example on this that can help me >>>>>> >>>>>
