Yes, I thought it should only count things generated by Join --Srinath
On Mon, Sep 30, 2013 at 1:02 PM, Rajeev Sampath <[email protected]> wrote: > On Mon, Sep 30, 2013 at 12:17 PM, Srinath Perera <[email protected]> wrote: > >> Hi Suho, >> >> Could you explain why? Is it a bug or did we screw up something in the >> language? >> >> I could not figure why we need "*all-events*" and I guess same for most >> users. >> >> > Hi Suho, Srinath, > > As far as I understood: > > The right side window contains 2 events when the join happens. Since this > is a unidirectional join, events arrive thru the second stream doesn't > trigger the join. > > When the first trigger event arrives: > it (i.e. the 'current-event') creates 2 events in the join. First event's > count is 1. > Second one's count is 2 (the output aggregator accumulates). > There are no 'expired-events' at the moment since by this time left window > is empty. > > Then the second trigger event arrives: > The 'current-event' creates 2 events in the join. First one's count is 3. > (accumulated with previous one). Second one's count is 4. (again > accumulated with previous) > > Then this also emits an expired-event (coz left window size is 1). > Due to this expired-event another 2 events created in the join operation. > First one has count 3 (subtracted from accumulated values due to event > type) > The second one results in a count of 2 (subtracted again) > > As I noticed, the count output aggregator keeps incrementing and > decrementing its value depending on event type. > Pls correct if I'm wrong. > > I was initially thinking that count() will just count the number of rows > the join operation will create. > Is this the expected behaviour? > > > Thanks > Rajeev > > --Srinath >> >> >> On Mon, Sep 30, 2013 at 11:51 AM, Sriskandarajah Suhothayan < >> [email protected]> wrote: >> >>> >>> make the output to be all-events/ expired-events in the query as below, >>> then you will be able to get the expected value. >>> >>> siddhiManager1.addQuery("from StratosHealth#window.length(1) as t >>> unidirectional join InstanceHealth#window.length(2) as h " >>> +" on h.domain == t.domain " >>> +" select count(h.ip) as instanceCount, ip, connections >>> insert into outStream for *all-events*"); >>> >>> Regards >>> Suho >>> >>> >>> On Fri, Sep 27, 2013 at 6:16 AM, Sriskandarajah Suhothayan < >>> [email protected]> wrote: >>> >>>> Srinath can you send the query and the input please I'll go through >>>> >>>> Suho >>>> On Sep 27, 2013 3:45 AM, "Srinath Perera" <[email protected]> wrote: >>>> >>>>> Thanks Rajeev, pls note this is bit urgent. >>>>> >>>>> --Srinath >>>>> >>>>> >>>>> On Fri, Sep 27, 2013 at 11:05 AM, Rajeev Sampath <[email protected]>wrote: >>>>> >>>>>> Hi Suho, >>>>>> >>>>>> Re attaching Srinath's test case for your reference. >>>>>> >>>>>> >>>>>> Thanks >>>>>> Rajeev >>>>>> >>>>>> >>>>>> On Thu, Sep 26, 2013 at 9:03 PM, Sriskandarajah Suhothayan < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> please write a test case in siddhi and give a patch >>>>>>> so I/We can run and see and verify >>>>>>> >>>>>>> Suho >>>>>>> >>>>>>> >>>>>>> On Thu, Sep 26, 2013 at 12:45 AM, Rajeev Sampath >>>>>>> <[email protected]>wrote: >>>>>>> >>>>>>>> >>>>>>>> Copying dev list. >>>>>>>> >>>>>>>> ---------- Forwarded message ---------- >>>>>>>> From: Rajeev Sampath <[email protected]> >>>>>>>> Date: Thu, Sep 26, 2013 at 1:12 PM >>>>>>>> Subject: Re: CEP sample >>>>>>>> To: Srinath Perera <[email protected]> >>>>>>>> >>>>>>>> >>>>>>>> It seems all aggregation functions over joins (including window >>>>>>>> joins) are not functioning properly. They keep accumulating everything >>>>>>>> over >>>>>>>> time. I'll look into this. >>>>>>>> >>>>>>>> For array index out of bounds, the delete query can be fixed as >>>>>>>> follows: >>>>>>>> >>>>>>>> from InstanceHealth[action=='down'] >>>>>>>> delete liveInstances >>>>>>>> on ip==liveInstances.ip >>>>>>>> >>>>>>>> >>>>>>>> Thanks >>>>>>>> >>>>>>>> >>>>>>>> On Thu, Sep 26, 2013 at 6:46 AM, Srinath Perera >>>>>>>> <[email protected]>wrote: >>>>>>>> >>>>>>>>> Hi Rajeev, >>>>>>>>> >>>>>>>>> If I remove the following line, it still shows as 2 even with >>>>>>>>> group by. >>>>>>>>> >>>>>>>>> stream1Handle1.send(new Object[]{"qsb", >>>>>>>>> System.currentTimeMillis(), "up", "192.121.0.2"}); >>>>>>>>> >>>>>>>>> Also do you find why array index outof bound happend when I >>>>>>>>> uncomment >>>>>>>>> >>>>>>>>> //stream1Handle1.send(new Object[]{"qsb", >>>>>>>>> System.currentTimeMillis(), "down", "192.121.0.1"}); >>>>>>>>> >>>>>>>>> --Srinath >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Thu, Sep 26, 2013 at 12:02 AM, Rajeev Sampath <[email protected] >>>>>>>>> > wrote: >>>>>>>>> >>>>>>>>>> Seems this is because group by is not used in the query. >>>>>>>>>> >>>>>>>>>> from StratosHealth as h unidirectional join liveInstances as ls >>>>>>>>>> on h.domain==ls.domain >>>>>>>>>> select count(ls.ip) as instanceCount, h.connections as >>>>>>>>>> connections >>>>>>>>>> group by ls.ip >>>>>>>>>> insert into AutoscaleData >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> Again, this can still result in duplicate events since siddhi >>>>>>>>>> will emit the events in the resulting joined table instead of one >>>>>>>>>> event. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, Sep 25, 2013 at 4:02 PM, Srinath Perera <[email protected] >>>>>>>>>> > wrote: >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> ============================ >>>>>>>>>>> Srinath Perera, Ph.D. >>>>>>>>>>> Director, Research, WSO2 Inc. >>>>>>>>>>> Visiting Faculty, University of Moratuwa >>>>>>>>>>> Member, Apache Software Foundation >>>>>>>>>>> Research Scientist, Lanka Software Foundation >>>>>>>>>>> Blog: http://srinathsview.blogspot.com/ >>>>>>>>>>> Photos: http://www.flickr.com/photos/hemapani/ >>>>>>>>>>> Phone: 0772360902 >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Rajeev Sampath >>>>>>>>>> Senior Software Engineer >>>>>>>>>> WSO2, Inc.; http://www.wso2.com. >>>>>>>>>> >>>>>>>>>> Mobile:* +94716265766 >>>>>>>>>> * >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> ============================ >>>>>>>>> Srinath Perera, Ph.D. >>>>>>>>> Director, Research, WSO2 Inc. >>>>>>>>> Visiting Faculty, University of Moratuwa >>>>>>>>> Member, Apache Software Foundation >>>>>>>>> Research Scientist, Lanka Software Foundation >>>>>>>>> Blog: http://srinathsview.blogspot.com/ >>>>>>>>> Photos: http://www.flickr.com/photos/hemapani/ >>>>>>>>> Phone: 0772360902 >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Rajeev Sampath >>>>>>>> Senior Software Engineer >>>>>>>> WSO2, Inc.; http://www.wso2.com. >>>>>>>> >>>>>>>> Mobile:* +94716265766 >>>>>>>> * >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Rajeev Sampath >>>>>>>> Senior Software Engineer >>>>>>>> WSO2, Inc.; http://www.wso2.com. >>>>>>>> >>>>>>>> Mobile:* +94716265766 >>>>>>>> * >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *S. Suhothayan >>>>>>> * >>>>>>> Associate Technical Lead, >>>>>>> *WSO2 Inc. *http://wso2.com * >>>>>>> <http://wso2.com/>* >>>>>>> lean . enterprise . middleware >>>>>>> >>>>>>> *cell: (+94) 779 756 757 | blog: http://suhothayan.blogspot.com/ >>>>>>> twitter: http://twitter.com/suhothayan | linked-in: >>>>>>> http://lk.linkedin.com/in/suhothayan* >>>>>>> * >>>>>>> * >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Rajeev Sampath >>>>>> Senior Software Engineer >>>>>> WSO2, Inc.; http://www.wso2.com. >>>>>> >>>>>> Mobile:* +94716265766 >>>>>> * >>>>>> >>>>>> _______________________________________________ >>>>>> Dev mailing list >>>>>> [email protected] >>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> ============================ >>>>> Srinath Perera, Ph.D. >>>>> Director, Research, WSO2 Inc. >>>>> Visiting Faculty, University of Moratuwa >>>>> Member, Apache Software Foundation >>>>> Research Scientist, Lanka Software Foundation >>>>> Blog: http://srinathsview.blogspot.com/ >>>>> Photos: http://www.flickr.com/photos/hemapani/ >>>>> Phone: 0772360902 >>>>> >>>> >>> >>> >>> -- >>> *S. Suhothayan >>> * >>> Associate Technical Lead, >>> *WSO2 Inc. *http://wso2.com * >>> <http://wso2.com/>* >>> lean . enterprise . middleware >>> >>> *cell: (+94) 779 756 757 | blog: http://suhothayan.blogspot.com/ >>> twitter: http://twitter.com/suhothayan | linked-in: >>> http://lk.linkedin.com/in/suhothayan* >>> * >>> * >>> >> >> >> >> -- >> ============================ >> Srinath Perera, Ph.D. >> Director, Research, WSO2 Inc. >> Visiting Faculty, University of Moratuwa >> Member, Apache Software Foundation >> Research Scientist, Lanka Software Foundation >> Blog: http://srinathsview.blogspot.com/ >> Photos: http://www.flickr.com/photos/hemapani/ >> Phone: 0772360902 >> > > > > -- > Rajeev Sampath > Senior Software Engineer > WSO2, Inc.; http://www.wso2.com. > > Mobile:* +94716265766 > * > -- ============================ Srinath Perera, Ph.D. Director, Research, WSO2 Inc. Visiting Faculty, University of Moratuwa Member, Apache Software Foundation Research Scientist, Lanka Software Foundation Blog: http://srinathsview.blogspot.com/ Photos: http://www.flickr.com/photos/hemapani/ Phone: 0772360902
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
