Hi, On Wednesday, October 22, 2014, Lakshman Udayakantha <[email protected]> wrote:
> Hi Inosh, > > data in cassandra database are summized to a relational database. records > in cassandra database and this relational table is same. so I think there > is no problem with cassandra explorer. > Ok understood. I have misread your previous email. > > Thanks > > On Wed, Oct 22, 2014 at 9:14 AM, Inosh Goonewardena <[email protected] > <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >> Hi Lakshman, >> >> You mean data is therw in cassandra and cassandra explorer doesn't show >> these data? Did you compare by using cassandra CLI tool? >> >> On Wednesday, October 22, 2014, Lakshman Udayakantha <[email protected] >> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: >> >>> HI Gihan , >>> >>> They are lost randomly. >>> >>> Thanks >>> >>> On Wed, Oct 22, 2014 at 9:00 AM, Gihan Anuruddha <[email protected]> wrote: >>> >>>> Hi Lakshman, >>>> >>>> How many records did you send to BAM and how many events are lost? >>>> >>>> Regards, >>>> Gihan >>>> >>>> On Wed, Oct 22, 2014 at 8:18 AM, Lakshman Udayakantha < >>>> [email protected]> wrote: >>>> >>>>> Hi Gihan, >>>>> >>>>> These data in cassandra database are summarised by a hive script and >>>>> insert into a relational database. I checked that relational database >>>>> table >>>>> also. Number of records in cassandra database and relational database >>>>> table >>>>> are same. Then it should not be a problem with cassandra explorer. >>>>> >>>>> Thanks >>>>> >>>>> On Wed, Oct 22, 2014 at 7:53 AM, Manoj Gunawardena <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> This can be an issue for other products as well. ES, AS and EMM also >>>>>> publishing data to BAM. In ES we are using load balancing data >>>>>> publisher. I >>>>>> also notice if we call stop method, sometimes data not get publish to >>>>>> BAM. >>>>>> We changed this to initiate data publisher at the first event and call >>>>>> data >>>>>> publishers stop method in the bundle activator's stop method. >>>>>> Need to test with load. >>>>>> >>>>>> Thanks >>>>>> >>>>>> >>>>>> On Tue, Oct 21, 2014 at 10:07 PM, Gihan Anuruddha <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> Hi Lakshman, >>>>>>> >>>>>>> It should be in Cassandra if publishEvent method executes. How do >>>>>>> you validate the data loss in Cassandra side? BAM embedded >>>>>>> Cassandra explorer is a not good tool for that. Can you please >>>>>>> verify that with tool like CQL or cassandra-cli? >>>>>>> >>>>>>> Regards, >>>>>>> Gihan >>>>>>> >>>>>>> On Tue, Oct 21, 2014 at 9:18 PM, Lakshman Udayakantha < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Hi All, >>>>>>>> >>>>>>>> I am working on https://wso2.org/jira/browse/APIMANAGER-2064. >>>>>>>> >>>>>>>> By looking at the Cassandra database on BAM, I could figure out >>>>>>>> some requests publish to Cassandra database and some do not when I >>>>>>>> invoke >>>>>>>> the api. That is the reason for the missing requests in statistics >>>>>>>> dashboard. >>>>>>>> >>>>>>>> I tried debugging the APIMgtUsageDataBridgeDataPublisher class >>>>>>>> since it has publishEvent method to publish data. >>>>>>>> APIMgtUsageDataBridgeDataPublisher class uses >>>>>>>> LoadBalancingDataPublisher as >>>>>>>> the dataPublisher in this case. >>>>>>>> >>>>>>>> I found that every time when I invoke the api via rest client, this >>>>>>>> method will execute. but randomly some requests are not publishing in >>>>>>>> Cassandra database. I used the >>>>>>>> latest org.wso2.carbon.databridge.agent.thrift jar. but the problem is >>>>>>>> still there. >>>>>>>> >>>>>>>> if requests come to publishEvent method, should they publish in >>>>>>>> Cassandra database?and is there any known reason for data get not >>>>>>>> published >>>>>>>> in cassendra database. if not where I can find the data publisher to >>>>>>>> cassendra in BAM from API Manager. >>>>>>>> >>>>>>>> Thanks >>>>>>>> -- >>>>>>>> Lakshman Udayakantha >>>>>>>> WSO2 Inc. www.wso2.com >>>>>>>> lean.enterprise.middleware >>>>>>>> Mobile: *0711241005 <0711241005>* >>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Dev mailing list >>>>>>>> [email protected] >>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> W.G. Gihan Anuruddha >>>>>>> Senior Software Engineer | WSO2, Inc. >>>>>>> M: +94772272595 >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Dev mailing list >>>>>>> [email protected] >>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Manoj Gunawardena >>>>>> Tech Lead >>>>>> WSO2, Inc.: http://wso2.com >>>>>> lean.enterprise.middleware >>>>>> Mobile : +94 77 2291643 >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Lakshman Udayakantha >>>>> WSO2 Inc. www.wso2.com >>>>> lean.enterprise.middleware >>>>> Mobile: *0711241005 <0711241005>* >>>>> >>>>> >>>> >>>> >>>> -- >>>> W.G. Gihan Anuruddha >>>> Senior Software Engineer | WSO2, Inc. >>>> M: +94772272595 >>>> >>> >>> >>> >>> -- >>> Lakshman Udayakantha >>> WSO2 Inc. www.wso2.com >>> lean.enterprise.middleware >>> Mobile: *0711241005* >>> >>> >> >> -- >> Regards, >> >> Inosh Goonewardena >> Associate Technical Lead- WSO2 Inc. >> Mobile: +94779966317 >> >> > > > -- > Lakshman Udayakantha > WSO2 Inc. www.wso2.com > lean.enterprise.middleware > Mobile: *0711241005* > > -- Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
