CC ing to Dev. Hi,
I need to know the following on BAM tenancy aspect. 1. When using BAM in tenancy environment we use RSS (now SS) to gain multi-tenancy when writing to MySQL. 2. We edit etc/rss-config.xml accordingly. 4. When we write a hive script should it have some tenancy configuration too? Or does BAM handle it internally? Or is it "same script for every tenant, but when we invoke we say get data specific to this tenant" ? 5. If some configuration as above exists, summery data writing should be happen via SS server right? Summery data can differ from one tenant to another. Editing $BAM_HOME/repository/conf/advanced/hive-site.xml we tell hive to write summery data to MySQL. Does this have some SS configuration so that summery data is written tenancy-wise? 6. Also when publishing, they publish as tenants. How do we separate tenant-wise data in Cassandra level (some internal details please, different rows, or columns or use some flag?)? Thanks. On Sun, Jun 16, 2013 at 12:07 PM, Hasitha Hiranya <[email protected]> wrote: > Hi, > > Do we have tenant support in BAM 2.0.1 ? > In new version I find rich documents on the subject, but are they relevant > to 2.0.1 version? > > Thanks. > > > On Fri, Jun 14, 2013 at 10:04 PM, Sinthuja Ragendran <[email protected]>wrote: > >> >> >> >> On Fri, Jun 14, 2013 at 9:51 PM, Hasitha Hiranya <[email protected]>wrote: >> >>> Can you explain this syntax? >>> >>> analyzers.scripts.webapp.cron=0 0/2 * * * ? >>> >>> It is for scheduling the BAM analytic script, right? >>> >> yes. It'll deploy the hive script with scheduling. >> >>> Does this say how often it is running? >>> >> >> It will run the scrip every 2 mins. For Eg: 1:00, 1:02, 1:04, and so on.. >> >>> >>> >>> On Thu, Jun 13, 2013 at 12:53 PM, Maninda Edirisooriya <[email protected] >>> > wrote: >>> >>>> Attached the article HTML as a compressed zip. >>>> >>>> * >>>> Maninda Edirisooriya* >>>> Software Engineer >>>> *WSO2, Inc. >>>> *lean.enterprise.middleware. >>>> >>>> *Blog* : http://maninda.blogspot.com/ >>>> *Phone* : +94 777603226 >>>> >>>> >>>> On Thu, Jun 13, 2013 at 12:18 PM, Hasitha Hiranya <[email protected]>wrote: >>>> >>>>> Thank you very much people. It is more clearer now. >>>>> Anyway, Maninda if you can see the document somehow, save it as a >>>>> .html and attach to the mail. >>>>> >>>>> Thanks again. >>>>> >>>>> >>>>> On Thu, Jun 13, 2013 at 11:02 AM, Maninda Edirisooriya < >>>>> [email protected]> wrote: >>>>> >>>>>> Ah! yes. I just saw it. Anyway similar content may still available in >>>>>> the doc as well. >>>>>> >>>>>> * >>>>>> Maninda Edirisooriya* >>>>>> Software Engineer >>>>>> *WSO2, Inc. >>>>>> *lean.enterprise.middleware. >>>>>> >>>>>> *Blog* : http://maninda.blogspot.com/ >>>>>> *Phone* : +94 777603226 >>>>>> >>>>>> >>>>>> On Thu, Jun 13, 2013 at 10:43 AM, Sinthuja Ragendran < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> >>>>>>> Hi maninda, >>>>>>> >>>>>>> On Thu, Jun 13, 2013 at 10:31 AM, Maninda Edirisooriya < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Hi Hasitha, >>>>>>>> >>>>>>>> All the explanations related to Activity Monitoring Hive script is >>>>>>>> there in >>>>>>>> http://wso2.org/library/articles/2013/03/getting-started-hive-analytics-wso2-bamwhich >>>>>>>> was used to create the doc pointed by Sinthuja. >>>>>>>> >>>>>>> >>>>>>> I can't view this link. :( >>>>>>> I think it didn't get published yet isn't it? If so we can't see >>>>>>> that until it's published. >>>>>>> >>>>>>> Thanks, >>>>>>> sinthuja. >>>>>>> >>>>>>> >>>>>>>> >>>>>>>> For the UI design, you will have to go through an existing toolbox >>>>>>>> for the Jaggery implementation. The easy way is hacking an existing >>>>>>>> dashboard. >>>>>>>> >>>>>>>> * >>>>>>>> Maninda Edirisooriya* >>>>>>>> Software Engineer >>>>>>>> *WSO2, Inc. >>>>>>>> *lean.enterprise.middleware. >>>>>>>> >>>>>>>> *Blog* : http://maninda.blogspot.com/ >>>>>>>> *Phone* : +94 777603226 >>>>>>>> >>>>>>>> >>>>>>>> On Thu, Jun 13, 2013 at 7:32 AM, Hasitha Hiranya <[email protected] >>>>>>>> > wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> Hi Maninda/Kasun, >>>>>>>>> >>>>>>>>> Can you please point me to some documents to learn hive queries? >>>>>>>>> Also I want a end-to-end scenario like >>>>>>>>> >>>>>>>>> 1. define stream definition >>>>>>>>> 2. how stream definition match with hive query >>>>>>>>> >>>>>>>>> 3. Actually what does this mean step by step >>>>>>>>> >>>>>>>>> CREATE EXTERNAL TABLE IF NOT EXISTS ActivityDataTable >>>>>>>>> (messageID STRING, sentTimestamp BIGINT, activityID STRING, >>>>>>>>> version STRING, soapHeader STRING, soapBody STRING, host STRING) >>>>>>>>> STORED BY >>>>>>>>> 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' >>>>>>>>> WITH SERDEPROPERTIES ( >>>>>>>>> "cassandra.host" = "127.0.0.1" , >>>>>>>>> "cassandra.port" = "9160" , >>>>>>>>> "cassandra.ks.name" = "EVENT_KS" , >>>>>>>>> "cassandra.ks.username" = "admin" , >>>>>>>>> "cassandra.ks.password" = "admin" , >>>>>>>>> "cassandra.cf.name" = "org_wso2_bam_activity_monitoring" , >>>>>>>>> "cassandra.columns.mapping" = >>>>>>>>> ":key, payload_timestamp, correlation_bam_activity_id, Version, >>>>>>>>> payload_SOAPHeader, payload_SOAPBody, meta_host" ); >>>>>>>>> >>>>>>>>> CREATE EXTERNAL TABLE IF NOT EXISTS ActivitySummaryTable( >>>>>>>>> messageRowID STRING, sentTimestamp BIGINT, bamActivityID STRING, >>>>>>>>> soapHeader STRING, soapBody STRING, host STRING) >>>>>>>>> STORED BY >>>>>>>>> 'org.wso2.carbon.hadoop.hive.jdbc.storage.JDBCStorageHandler' >>>>>>>>> TBLPROPERTIES ( >>>>>>>>> 'wso2.carbon.datasource.name'='WSO2BAM_DATASOURCE', >>>>>>>>> 'hive.jdbc.update.on.duplicate' = 'true' , >>>>>>>>> 'hive.jdbc.primary.key.fields' = 'messageRowID' , >>>>>>>>> 'hive.jdbc.table.create.query' = >>>>>>>>> 'CREATE TABLE ActivitySummary (messageRowID VARCHAR(100) NOT NULL >>>>>>>>> PRIMARY KEY, >>>>>>>>> sentTimestamp BIGINT, bamActivityID VARCHAR(40), soapHeader >>>>>>>>> TEXT, soapBody TEXT, host VARCHAR(25))' ); >>>>>>>>> >>>>>>>>> insert overwrite table ActivitySummaryTable >>>>>>>>> select messageID, sentTimestamp, activityID, soapHeader, >>>>>>>>> soapBody, host >>>>>>>>> from ActivityDataTable >>>>>>>>> where version= "1.0.0"; >>>>>>>>> >>>>>>>>> 4. How to write a toolBox step by step to show what I want. (how >>>>>>>>> to design the UI to show what I want) >>>>>>>>> >>>>>>>>> And is there a way to debug hive queries? >>>>>>>>> >>>>>>>>> For following I get an error while executing query. >>>>>>>>> >>>>>>>>> CREATE EXTERNAL TABLE IF NOT EXISTS ActivityDataTable >>>>>>>>> (messageID STRING, sentTimestamp BIGINT, activityID STRING, >>>>>>>>> version STRING, soapHeader STRING, soapBody STRING, host STRING) >>>>>>>>> STORED BY >>>>>>>>> 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' >>>>>>>>> WITH SERDEPROPERTIES ( >>>>>>>>> "cassandra.host" = "127.0.0.1" , >>>>>>>>> "cassandra.port" = "9160" , >>>>>>>>> "cassandra.ks.name" = "EVENT_KS" , >>>>>>>>> "cassandra.ks.username" = "admin" , >>>>>>>>> "cassandra.ks.password" = "admin" , >>>>>>>>> "cassandra.cf.name" = "stream_1" , >>>>>>>>> "cassandra.columns.mapping" = >>>>>>>>> ":key, payload_timestamp, correlation_bam_activity_id, Version, >>>>>>>>> payload_SOAPHeader, payload_SOAPBody, meta_host" ); >>>>>>>>> >>>>>>>>> CREATE EXTERNAL TABLE IF NOT EXISTS ActivitySummaryTable( >>>>>>>>> messageRowID STRING, sentTimestamp BIGINT, bamActivityID STRING, >>>>>>>>> soapHeader STRING, soapBody STRING, host STRING) >>>>>>>>> STORED BY >>>>>>>>> 'org.wso2.carbon.hadoop.hive.jdbc.storage.JDBCStorageHandler' >>>>>>>>> TBLPROPERTIES ( >>>>>>>>> 'wso2.carbon.datasource.name'='WSO2BAM_DATASOURCE', >>>>>>>>> 'hive.jdbc.update.on.duplicate' = 'true' , >>>>>>>>> 'hive.jdbc.primary.key.fields' = 'messageRowID' , >>>>>>>>> 'hive.jdbc.table.create.query' = >>>>>>>>> 'CREATE TABLE ActivitySummary (messageRowID VARCHAR(100) NOT NULL >>>>>>>>> PRIMARY KEY, >>>>>>>>> sentTimestamp BIGINT, bamActivityID VARCHAR(40), soapHeader >>>>>>>>> TEXT, soapBody TEXT, host VARCHAR(25))' ); >>>>>>>>> >>>>>>>>> insert overwrite table ActivitySummaryTable >>>>>>>>> select messageID, sentTimestamp, activityID, soapHeader, >>>>>>>>> soapBody, host >>>>>>>>> from ActivityDataTable >>>>>>>>> where version= "1.0.0"; >>>>>>>>> >>>>>>>>> >>>>>>>>> * ERROR: Error while executing Hive script.Query returned >>>>>>>>> non-zero code: 9, cause: FAILED: Execution Error, return code 2 from >>>>>>>>> org.apache.hadoop.hive.ql.exec.MapRedTask * >>>>>>>>> >>>>>>>>> Docs seems not have answers :( >>>>>>>>> >>>>>>>>> Thank You. >>>>>>>>> >>>>>>>>> -- >>>>>>>>> *Hasitha Abeykoon* >>>>>>>>> Software Engineer; WSO2, Inc.; http://wso2.com >>>>>>>>> *cell:* *+94 719363063* >>>>>>>>> *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * >>>>>>>>> * >>>>>>>>> * >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Sinthuja Rajendran* >>>>>>> >>>>>>> Software Engineer <http://wso2.com/> >>>>>>> WSO2, Inc.:http://wso2.com >>>>>>> >>>>>>> Blog: http://sinthu-rajan.blogspot.com/ >>>>>>> Mobile: +94774273955 >>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> *Hasitha Abeykoon* >>>>> Software Engineer; WSO2, Inc.; http://wso2.com >>>>> *cell:* *+94 719363063* >>>>> *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * >>>>> * >>>>> * >>>>> >>>> >>>> >>> >>> >>> -- >>> *Hasitha Abeykoon* >>> Software Engineer; WSO2, Inc.; http://wso2.com >>> *cell:* *+94 719363063* >>> *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * >>> * >>> * >>> >> >> >> >> -- >> *Sinthuja Rajendran* >> Software Engineer <http://wso2.com/> >> WSO2, Inc.:http://wso2.com >> >> Blog: http://sinthu-rajan.blogspot.com/ >> Mobile: +94774273955 >> >> >> > > > -- > *Hasitha Abeykoon* > Software Engineer; WSO2, Inc.; http://wso2.com > *cell:* *+94 719363063* > *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * > * > * > -- *Hasitha Abeykoon* Software Engineer; WSO2, Inc.; http://wso2.com *cell:* *+94 719363063* *blog: **abeykoon.blogspot.com* <http://abeykoon.blogspot.com>* * * *
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
