Hi Hasitha, Usage agent component [1] is responsible for publishing tenant usage events to BAM. carbon.tomcat.patch component in kernel [2] collects stats and usage agent publishes them.
Stat publishing is done only if EnableMetering property in carbon.xml is set to true. NOTE: This approach of collecting stats via tomcat.patch does not work for ESB due to the difference in transport and we dont have a mechanism to meter ESB stats at the moment. [1] https://svn.wso2.org/repos/wso2/carbon/platform/trunk/components/stratos/usage/org.wso2.carbon.usage.agent/ [2] https://svn.wso2.org/repos/wso2/carbon/kernel/trunk/core/org.wso2.carbon.tomcat.patch Regards, AmilaM. On Tue, Jun 18, 2013 at 3:49 AM, Hasitha Hiranya <[email protected]> wrote: > Hi, > > And also I want to know in Stratos environment how to publish tenant-wise > data to BAM. > Is there any docs in that space how to configure this up? > > Thanks > > > On Mon, Jun 17, 2013 at 1:05 PM, Hasitha Hiranya <[email protected]>wrote: > >> CC ing to Dev. >> >> Hi, >> >> I need to know the following on BAM tenancy aspect. >> >> 1. When using BAM in tenancy environment we use RSS (now SS) to gain >> multi-tenancy when writing to MySQL. >> 2. We edit etc/rss-config.xml accordingly. >> 4. When we write a hive script should it have some tenancy configuration >> too? Or does BAM handle it internally? Or is it "same script for every >> tenant, but when we invoke we say get data specific to this tenant" ? >> 5. If some configuration as above exists, summery data writing should be >> happen via SS server right? Summery data can differ from one tenant to >> another. Editing $BAM_HOME/repository/conf/advanced/hive-site.xml we tell >> hive to write summery data to MySQL. Does this have some SS configuration >> so that summery data is written tenancy-wise? >> 6. Also when publishing, they publish as tenants. How do we separate >> tenant-wise data in Cassandra level (some internal details please, >> different rows, or columns or use some flag?)? >> >> Thanks. >> >> >> >> On Sun, Jun 16, 2013 at 12:07 PM, Hasitha Hiranya <[email protected]>wrote: >> >>> Hi, >>> >>> Do we have tenant support in BAM 2.0.1 ? >>> In new version I find rich documents on the subject, but are they >>> relevant to 2.0.1 version? >>> >>> Thanks. >>> >>> >>> On Fri, Jun 14, 2013 at 10:04 PM, Sinthuja Ragendran >>> <[email protected]>wrote: >>> >>>> >>>> >>>> >>>> On Fri, Jun 14, 2013 at 9:51 PM, Hasitha Hiranya <[email protected]>wrote: >>>> >>>>> Can you explain this syntax? >>>>> >>>>> analyzers.scripts.webapp.cron=0 0/2 * * * ? >>>>> >>>>> It is for scheduling the BAM analytic script, right? >>>>> >>>> yes. It'll deploy the hive script with scheduling. >>>> >>>>> Does this say how often it is running? >>>>> >>>> >>>> It will run the scrip every 2 mins. For Eg: 1:00, 1:02, 1:04, and so >>>> on.. >>>> >>>>> >>>>> >>>>> On Thu, Jun 13, 2013 at 12:53 PM, Maninda Edirisooriya < >>>>> [email protected]> wrote: >>>>> >>>>>> Attached the article HTML as a compressed zip. >>>>>> >>>>>> * >>>>>> Maninda Edirisooriya* >>>>>> Software Engineer >>>>>> *WSO2, Inc. >>>>>> *lean.enterprise.middleware. >>>>>> >>>>>> *Blog* : http://maninda.blogspot.com/ >>>>>> *Phone* : +94 777603226 >>>>>> >>>>>> >>>>>> On Thu, Jun 13, 2013 at 12:18 PM, Hasitha Hiranya >>>>>> <[email protected]>wrote: >>>>>> >>>>>>> Thank you very much people. It is more clearer now. >>>>>>> Anyway, Maninda if you can see the document somehow, save it as a >>>>>>> .html and attach to the mail. >>>>>>> >>>>>>> Thanks again. >>>>>>> >>>>>>> >>>>>>> On Thu, Jun 13, 2013 at 11:02 AM, Maninda Edirisooriya < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Ah! yes. I just saw it. Anyway similar content may still available >>>>>>>> in the doc as well. >>>>>>>> >>>>>>>> * >>>>>>>> Maninda Edirisooriya* >>>>>>>> Software Engineer >>>>>>>> *WSO2, Inc. >>>>>>>> *lean.enterprise.middleware. >>>>>>>> >>>>>>>> *Blog* : http://maninda.blogspot.com/ >>>>>>>> *Phone* : +94 777603226 >>>>>>>> >>>>>>>> >>>>>>>> On Thu, Jun 13, 2013 at 10:43 AM, Sinthuja Ragendran < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> Hi maninda, >>>>>>>>> >>>>>>>>> On Thu, Jun 13, 2013 at 10:31 AM, Maninda Edirisooriya < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Hi Hasitha, >>>>>>>>>> >>>>>>>>>> All the explanations related to Activity Monitoring Hive script >>>>>>>>>> is there in >>>>>>>>>> http://wso2.org/library/articles/2013/03/getting-started-hive-analytics-wso2-bamwhich >>>>>>>>>> was used to create the doc pointed by Sinthuja. >>>>>>>>>> >>>>>>>>> >>>>>>>>> I can't view this link. :( >>>>>>>>> I think it didn't get published yet isn't it? If so we can't see >>>>>>>>> that until it's published. >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> sinthuja. >>>>>>>>> >>>>>>>>> >>>>>>>>>> >>>>>>>>>> For the UI design, you will have to go through an existing >>>>>>>>>> toolbox for the Jaggery implementation. The easy way is hacking an >>>>>>>>>> existing >>>>>>>>>> dashboard. >>>>>>>>>> >>>>>>>>>> * >>>>>>>>>> Maninda Edirisooriya* >>>>>>>>>> Software Engineer >>>>>>>>>> *WSO2, Inc. >>>>>>>>>> *lean.enterprise.middleware. >>>>>>>>>> >>>>>>>>>> *Blog* : http://maninda.blogspot.com/ >>>>>>>>>> *Phone* : +94 777603226 >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Thu, Jun 13, 2013 at 7:32 AM, Hasitha Hiranya < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Hi Maninda/Kasun, >>>>>>>>>>> >>>>>>>>>>> Can you please point me to some documents to learn hive queries? >>>>>>>>>>> Also I want a end-to-end scenario like >>>>>>>>>>> >>>>>>>>>>> 1. define stream definition >>>>>>>>>>> 2. how stream definition match with hive query >>>>>>>>>>> >>>>>>>>>>> 3. Actually what does this mean step by step >>>>>>>>>>> >>>>>>>>>>> CREATE EXTERNAL TABLE IF NOT EXISTS ActivityDataTable >>>>>>>>>>> (messageID STRING, sentTimestamp BIGINT, activityID STRING, >>>>>>>>>>> version STRING, soapHeader STRING, soapBody STRING, host STRING) >>>>>>>>>>> STORED BY >>>>>>>>>>> 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' >>>>>>>>>>> WITH SERDEPROPERTIES ( >>>>>>>>>>> "cassandra.host" = "127.0.0.1" , >>>>>>>>>>> "cassandra.port" = "9160" , >>>>>>>>>>> "cassandra.ks.name" = "EVENT_KS" , >>>>>>>>>>> "cassandra.ks.username" = "admin" , >>>>>>>>>>> "cassandra.ks.password" = "admin" , >>>>>>>>>>> "cassandra.cf.name" = "org_wso2_bam_activity_monitoring" , >>>>>>>>>>> "cassandra.columns.mapping" = >>>>>>>>>>> ":key, payload_timestamp, correlation_bam_activity_id, >>>>>>>>>>> Version, payload_SOAPHeader, payload_SOAPBody, meta_host" ); >>>>>>>>>>> >>>>>>>>>>> CREATE EXTERNAL TABLE IF NOT EXISTS ActivitySummaryTable( >>>>>>>>>>> messageRowID STRING, sentTimestamp BIGINT, bamActivityID >>>>>>>>>>> STRING, soapHeader STRING, soapBody STRING, host STRING) >>>>>>>>>>> STORED BY >>>>>>>>>>> 'org.wso2.carbon.hadoop.hive.jdbc.storage.JDBCStorageHandler' >>>>>>>>>>> TBLPROPERTIES ( >>>>>>>>>>> 'wso2.carbon.datasource.name'='WSO2BAM_DATASOURCE', >>>>>>>>>>> 'hive.jdbc.update.on.duplicate' = 'true' , >>>>>>>>>>> 'hive.jdbc.primary.key.fields' = 'messageRowID' , >>>>>>>>>>> 'hive.jdbc.table.create.query' = >>>>>>>>>>> 'CREATE TABLE ActivitySummary (messageRowID VARCHAR(100) NOT >>>>>>>>>>> NULL PRIMARY KEY, >>>>>>>>>>> sentTimestamp BIGINT, bamActivityID VARCHAR(40), soapHeader >>>>>>>>>>> TEXT, soapBody TEXT, host VARCHAR(25))' ); >>>>>>>>>>> >>>>>>>>>>> insert overwrite table ActivitySummaryTable >>>>>>>>>>> select messageID, sentTimestamp, activityID, soapHeader, >>>>>>>>>>> soapBody, host >>>>>>>>>>> from ActivityDataTable >>>>>>>>>>> where version= "1.0.0"; >>>>>>>>>>> >>>>>>>>>>> 4. How to write a toolBox step by step to show what I want. (how >>>>>>>>>>> to design the UI to show what I want) >>>>>>>>>>> >>>>>>>>>>> And is there a way to debug hive queries? >>>>>>>>>>> >>>>>>>>>>> For following I get an error while executing query. >>>>>>>>>>> >>>>>>>>>>> CREATE EXTERNAL TABLE IF NOT EXISTS ActivityDataTable >>>>>>>>>>> (messageID STRING, sentTimestamp BIGINT, activityID STRING, >>>>>>>>>>> version STRING, soapHeader STRING, soapBody STRING, host STRING) >>>>>>>>>>> STORED BY >>>>>>>>>>> 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' >>>>>>>>>>> WITH SERDEPROPERTIES ( >>>>>>>>>>> "cassandra.host" = "127.0.0.1" , >>>>>>>>>>> "cassandra.port" = "9160" , >>>>>>>>>>> "cassandra.ks.name" = "EVENT_KS" , >>>>>>>>>>> "cassandra.ks.username" = "admin" , >>>>>>>>>>> "cassandra.ks.password" = "admin" , >>>>>>>>>>> "cassandra.cf.name" = "stream_1" , >>>>>>>>>>> "cassandra.columns.mapping" = >>>>>>>>>>> ":key, payload_timestamp, correlation_bam_activity_id, >>>>>>>>>>> Version, payload_SOAPHeader, payload_SOAPBody, meta_host" ); >>>>>>>>>>> >>>>>>>>>>> CREATE EXTERNAL TABLE IF NOT EXISTS ActivitySummaryTable( >>>>>>>>>>> messageRowID STRING, sentTimestamp BIGINT, bamActivityID >>>>>>>>>>> STRING, soapHeader STRING, soapBody STRING, host STRING) >>>>>>>>>>> STORED BY >>>>>>>>>>> 'org.wso2.carbon.hadoop.hive.jdbc.storage.JDBCStorageHandler' >>>>>>>>>>> TBLPROPERTIES ( >>>>>>>>>>> 'wso2.carbon.datasource.name'='WSO2BAM_DATASOURCE', >>>>>>>>>>> 'hive.jdbc.update.on.duplicate' = 'true' , >>>>>>>>>>> 'hive.jdbc.primary.key.fields' = 'messageRowID' , >>>>>>>>>>> 'hive.jdbc.table.create.query' = >>>>>>>>>>> 'CREATE TABLE ActivitySummary (messageRowID VARCHAR(100) NOT >>>>>>>>>>> NULL PRIMARY KEY, >>>>>>>>>>> sentTimestamp BIGINT, bamActivityID VARCHAR(40), soapHeader >>>>>>>>>>> TEXT, soapBody TEXT, host VARCHAR(25))' ); >>>>>>>>>>> >>>>>>>>>>> insert overwrite table ActivitySummaryTable >>>>>>>>>>> select messageID, sentTimestamp, activityID, soapHeader, >>>>>>>>>>> soapBody, host >>>>>>>>>>> from ActivityDataTable >>>>>>>>>>> where version= "1.0.0"; >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> * ERROR: Error while executing Hive script.Query returned >>>>>>>>>>> non-zero code: 9, cause: FAILED: Execution Error, return code 2 from >>>>>>>>>>> org.apache.hadoop.hive.ql.exec.MapRedTask * >>>>>>>>>>> >>>>>>>>>>> Docs seems not have answers :( >>>>>>>>>>> >>>>>>>>>>> Thank You. >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> *Hasitha Abeykoon* >>>>>>>>>>> Software Engineer; WSO2, Inc.; http://wso2.com >>>>>>>>>>> *cell:* *+94 719363063* >>>>>>>>>>> *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* >>>>>>>>>>> * >>>>>>>>>>> * >>>>>>>>>>> * >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> *Sinthuja Rajendran* >>>>>>>>> >>>>>>>>> Software Engineer <http://wso2.com/> >>>>>>>>> WSO2, Inc.:http://wso2.com >>>>>>>>> >>>>>>>>> Blog: http://sinthu-rajan.blogspot.com/ >>>>>>>>> Mobile: +94774273955 >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Hasitha Abeykoon* >>>>>>> Software Engineer; WSO2, Inc.; http://wso2.com >>>>>>> *cell:* *+94 719363063* >>>>>>> *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * >>>>>>> * >>>>>>> * >>>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> *Hasitha Abeykoon* >>>>> Software Engineer; WSO2, Inc.; http://wso2.com >>>>> *cell:* *+94 719363063* >>>>> *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * >>>>> * >>>>> * >>>>> >>>> >>>> >>>> >>>> -- >>>> *Sinthuja Rajendran* >>>> Software Engineer <http://wso2.com/> >>>> WSO2, Inc.:http://wso2.com >>>> >>>> Blog: http://sinthu-rajan.blogspot.com/ >>>> Mobile: +94774273955 >>>> >>>> >>>> >>> >>> >>> -- >>> *Hasitha Abeykoon* >>> Software Engineer; WSO2, Inc.; http://wso2.com >>> *cell:* *+94 719363063* >>> *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * >>> * >>> * >>> >> >> >> >> -- >> *Hasitha Abeykoon* >> Software Engineer; WSO2, Inc.; http://wso2.com >> *cell:* *+94 719363063* >> *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * >> * >> * >> > > > > -- > *Hasitha Abeykoon* > Software Engineer; WSO2, Inc.; http://wso2.com > *cell:* *+94 719363063* > *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * > * > * > > _______________________________________________ > Dev mailing list > [email protected] > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- *Amila Maharachchi* Senior Technical Lead WSO2, Inc.; http://wso2.com Blog: http://maharachchi.blogspot.com Mobile: +94719371446
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
