HI Gihan , They are lost randomly.
Thanks On Wed, Oct 22, 2014 at 9:00 AM, Gihan Anuruddha <[email protected]> wrote: > Hi Lakshman, > > How many records did you send to BAM and how many events are lost? > > Regards, > Gihan > > On Wed, Oct 22, 2014 at 8:18 AM, Lakshman Udayakantha <[email protected]> > wrote: > >> Hi Gihan, >> >> These data in cassandra database are summarised by a hive script and >> insert into a relational database. I checked that relational database table >> also. Number of records in cassandra database and relational database table >> are same. Then it should not be a problem with cassandra explorer. >> >> Thanks >> >> On Wed, Oct 22, 2014 at 7:53 AM, Manoj Gunawardena <[email protected]> >> wrote: >> >>> Hi, >>> >>> This can be an issue for other products as well. ES, AS and EMM also >>> publishing data to BAM. In ES we are using load balancing data publisher. I >>> also notice if we call stop method, sometimes data not get publish to BAM. >>> We changed this to initiate data publisher at the first event and call data >>> publishers stop method in the bundle activator's stop method. >>> Need to test with load. >>> >>> Thanks >>> >>> >>> On Tue, Oct 21, 2014 at 10:07 PM, Gihan Anuruddha <[email protected]> >>> wrote: >>> >>>> Hi Lakshman, >>>> >>>> It should be in Cassandra if publishEvent method executes. How do you >>>> validate the data loss in Cassandra side? BAM embedded Cassandra >>>> explorer is a not good tool for that. Can you please verify that with >>>> tool like CQL or cassandra-cli? >>>> >>>> Regards, >>>> Gihan >>>> >>>> On Tue, Oct 21, 2014 at 9:18 PM, Lakshman Udayakantha < >>>> [email protected]> wrote: >>>> >>>>> Hi All, >>>>> >>>>> I am working on https://wso2.org/jira/browse/APIMANAGER-2064. >>>>> >>>>> By looking at the Cassandra database on BAM, I could figure out some >>>>> requests publish to Cassandra database and some do not when I invoke the >>>>> api. That is the reason for the missing requests in statistics dashboard. >>>>> >>>>> I tried debugging the APIMgtUsageDataBridgeDataPublisher class since >>>>> it has publishEvent method to publish data. >>>>> APIMgtUsageDataBridgeDataPublisher class uses LoadBalancingDataPublisher >>>>> as >>>>> the dataPublisher in this case. >>>>> >>>>> I found that every time when I invoke the api via rest client, this >>>>> method will execute. but randomly some requests are not publishing in >>>>> Cassandra database. I used the >>>>> latest org.wso2.carbon.databridge.agent.thrift jar. but the problem is >>>>> still there. >>>>> >>>>> if requests come to publishEvent method, should they publish in >>>>> Cassandra database?and is there any known reason for data get not >>>>> published >>>>> in cassendra database. if not where I can find the data publisher to >>>>> cassendra in BAM from API Manager. >>>>> >>>>> Thanks >>>>> -- >>>>> Lakshman Udayakantha >>>>> WSO2 Inc. www.wso2.com >>>>> lean.enterprise.middleware >>>>> Mobile: *0711241005 <0711241005>* >>>>> >>>>> >>>>> _______________________________________________ >>>>> Dev mailing list >>>>> [email protected] >>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>> >>>>> >>>> >>>> >>>> -- >>>> W.G. Gihan Anuruddha >>>> Senior Software Engineer | WSO2, Inc. >>>> M: +94772272595 >>>> >>>> _______________________________________________ >>>> Dev mailing list >>>> [email protected] >>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>> >>>> >>> >>> >>> -- >>> Manoj Gunawardena >>> Tech Lead >>> WSO2, Inc.: http://wso2.com >>> lean.enterprise.middleware >>> Mobile : +94 77 2291643 >>> >> >> >> >> -- >> Lakshman Udayakantha >> WSO2 Inc. www.wso2.com >> lean.enterprise.middleware >> Mobile: *0711241005 <0711241005>* >> >> > > > -- > W.G. Gihan Anuruddha > Senior Software Engineer | WSO2, Inc. > M: +94772272595 > -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005*
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
