Hi Inosh, data in cassandra database are summized to a relational database. records in cassandra database and this relational table is same. so I think there is no problem with cassandra explorer.
Thanks On Wed, Oct 22, 2014 at 9:14 AM, Inosh Goonewardena <[email protected]> wrote: > Hi Lakshman, > > You mean data is therw in cassandra and cassandra explorer doesn't show > these data? Did you compare by using cassandra CLI tool? > > On Wednesday, October 22, 2014, Lakshman Udayakantha <[email protected]> > wrote: > >> HI Gihan , >> >> They are lost randomly. >> >> Thanks >> >> On Wed, Oct 22, 2014 at 9:00 AM, Gihan Anuruddha <[email protected]> wrote: >> >>> Hi Lakshman, >>> >>> How many records did you send to BAM and how many events are lost? >>> >>> Regards, >>> Gihan >>> >>> On Wed, Oct 22, 2014 at 8:18 AM, Lakshman Udayakantha < >>> [email protected]> wrote: >>> >>>> Hi Gihan, >>>> >>>> These data in cassandra database are summarised by a hive script and >>>> insert into a relational database. I checked that relational database table >>>> also. Number of records in cassandra database and relational database table >>>> are same. Then it should not be a problem with cassandra explorer. >>>> >>>> Thanks >>>> >>>> On Wed, Oct 22, 2014 at 7:53 AM, Manoj Gunawardena <[email protected]> >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> This can be an issue for other products as well. ES, AS and EMM also >>>>> publishing data to BAM. In ES we are using load balancing data publisher. >>>>> I >>>>> also notice if we call stop method, sometimes data not get publish to BAM. >>>>> We changed this to initiate data publisher at the first event and call >>>>> data >>>>> publishers stop method in the bundle activator's stop method. >>>>> Need to test with load. >>>>> >>>>> Thanks >>>>> >>>>> >>>>> On Tue, Oct 21, 2014 at 10:07 PM, Gihan Anuruddha <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi Lakshman, >>>>>> >>>>>> It should be in Cassandra if publishEvent method executes. How do >>>>>> you validate the data loss in Cassandra side? BAM embedded Cassandra >>>>>> explorer is a not good tool for that. Can you please verify that >>>>>> with tool like CQL or cassandra-cli? >>>>>> >>>>>> Regards, >>>>>> Gihan >>>>>> >>>>>> On Tue, Oct 21, 2014 at 9:18 PM, Lakshman Udayakantha < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi All, >>>>>>> >>>>>>> I am working on https://wso2.org/jira/browse/APIMANAGER-2064. >>>>>>> >>>>>>> By looking at the Cassandra database on BAM, I could figure out some >>>>>>> requests publish to Cassandra database and some do not when I invoke the >>>>>>> api. That is the reason for the missing requests in statistics >>>>>>> dashboard. >>>>>>> >>>>>>> I tried debugging the APIMgtUsageDataBridgeDataPublisher class since >>>>>>> it has publishEvent method to publish data. >>>>>>> APIMgtUsageDataBridgeDataPublisher class uses >>>>>>> LoadBalancingDataPublisher as >>>>>>> the dataPublisher in this case. >>>>>>> >>>>>>> I found that every time when I invoke the api via rest client, this >>>>>>> method will execute. but randomly some requests are not publishing in >>>>>>> Cassandra database. I used the >>>>>>> latest org.wso2.carbon.databridge.agent.thrift jar. but the problem is >>>>>>> still there. >>>>>>> >>>>>>> if requests come to publishEvent method, should they publish in >>>>>>> Cassandra database?and is there any known reason for data get not >>>>>>> published >>>>>>> in cassendra database. if not where I can find the data publisher to >>>>>>> cassendra in BAM from API Manager. >>>>>>> >>>>>>> Thanks >>>>>>> -- >>>>>>> Lakshman Udayakantha >>>>>>> WSO2 Inc. www.wso2.com >>>>>>> lean.enterprise.middleware >>>>>>> Mobile: *0711241005 <0711241005>* >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Dev mailing list >>>>>>> [email protected] >>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> W.G. Gihan Anuruddha >>>>>> Senior Software Engineer | WSO2, Inc. >>>>>> M: +94772272595 >>>>>> >>>>>> _______________________________________________ >>>>>> Dev mailing list >>>>>> [email protected] >>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Manoj Gunawardena >>>>> Tech Lead >>>>> WSO2, Inc.: http://wso2.com >>>>> lean.enterprise.middleware >>>>> Mobile : +94 77 2291643 >>>>> >>>> >>>> >>>> >>>> -- >>>> Lakshman Udayakantha >>>> WSO2 Inc. www.wso2.com >>>> lean.enterprise.middleware >>>> Mobile: *0711241005 <0711241005>* >>>> >>>> >>> >>> >>> -- >>> W.G. Gihan Anuruddha >>> Senior Software Engineer | WSO2, Inc. >>> M: +94772272595 >>> >> >> >> >> -- >> Lakshman Udayakantha >> WSO2 Inc. www.wso2.com >> lean.enterprise.middleware >> Mobile: *0711241005* >> >> > > -- > Regards, > > Inosh Goonewardena > Associate Technical Lead- WSO2 Inc. > Mobile: +94779966317 > > -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005*
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
