Hi Dunith I have reported the following two puppet related jira for now https://wso2.org/jira/browse/BAM-1861 https://wso2.org/jira/browse/BAM-1862
will update the other issues and update this mail thread Shavantha Weerasinghe Senior Software Engineer QA WSO2, Inc. lean.enterprise.middleware. http://wso2.com http://wso2.org Tel : 94 11 214 5345 Fax :94 11 2145300 On Tue, Nov 4, 2014 at 11:11 PM, Dunith Dhanushka <[email protected]> wrote: > Hi Shavantha, > > You'll only need above configurations when incremental processing is > enabled. However you don't need to edit those values by hand, instead > puppet should automatically configure it for you. > > Please raise a JIRA for this. Will fix it. > > Regards, > Dunith > > > > On Tue, Nov 4, 2014 at 10:40 PM, Dunith Dhanushka <[email protected]> wrote: > >> Hi Aparna, >> >> Issue 1 - Failed in in the first time and succeeded in the 2nd attempt. >> >> Puppet script uses wget command to fetch Cassandra distribution from the >> specified remote location. This operation might take some time depending on >> the network. Above situation could happen if the Cassandra distribution was >> not fully downloaded and Puppet script tries to continue with partially >> downloaded distribution. Not sure this is specific to our research cloud >> environment. I'll check on this further. >> >> *Issue 2* - Temporarily copied files >> This might be due to issue #1, partial download of a distribution file. >> >> Yes, I'll make a note about user 'kurumba' in the documentation. >> >> Regards, >> Dunith >> >> >> >> >> On Tue, Nov 4, 2014 at 9:38 PM, Shavantha Weerasinghe <[email protected] >> > wrote: >> >>> Hi Dunith >>> >>> within the puppet scrips for receive/analyzer nodes hive-site.xml are we >>> to change the user name/password and host values >>> >>> <property> >>> >>> <name>hive.incremental.processing.intermediate.results.cassandra.hosts</name> >>> <value>localhost:9160</value> >>> </property> >>> >>> <property> >>> >>> <name>hive.incremental.processing.intermediate.results.cassandra.userName</name> >>> <value>admin</value> >>> </property> >>> >>> <property> >>> >>> <name>hive.incremental.processing.intermediate.results.cassandra.password</name> >>> <value>admin</value> >>> </property> >>> >>> >>> Shavantha Weerasinghe >>> Senior Software Engineer QA >>> WSO2, Inc. >>> lean.enterprise.middleware. >>> http://wso2.com >>> http://wso2.org >>> Tel : 94 11 214 5345 >>> Fax :94 11 2145300 >>> >>> >>> On Mon, Nov 3, 2014 at 6:12 PM, Dunith Dhanushka <[email protected]> >>> wrote: >>> >>>> Hi , >>>> >>>> Please note that when setting this up in the research cloud, turn off >>>> the iptables by '*sudo service iptables stop*'. Otherwise it'll block >>>> internode communications. >>>> >>>> Regards, >>>> Dunith >>>> >>>> On Mon, Nov 3, 2014 at 11:53 AM, Dunith Dhanushka <[email protected]> >>>> wrote: >>>> >>>>> Hi Aparna, >>>>> >>>>> I have completed the puppet script upgrade for puppet version 3.7 and >>>>> tested them on a Centos cluster. Please find the attached guide for setup >>>>> instructions. >>>>> >>>>> >>>>> Regards, >>>>> Dunith >>>>> >>>>> BAM 2.5.0 Distributed Setup with Puppet 3.7 >>>>> <https://docs.google.com/a/wso2.com/document/d/1-BfLkgk6xDD-sd11xBbW5I0ZQodwUE1WuUUEl1nwAK4/edit?usp=drive_web> >>>>> >>>>> >>>>> On Wed, Oct 29, 2014 at 11:58 AM, Dunith Dhanushka <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi Aparna, >>>>>> >>>>>> I have completed the scripts for BAM and Cassandra nodes. But still >>>>>> need to work on Hadoop scripts. I have started testing them on the centos >>>>>> cluster created in the research cloud. >>>>>> >>>>>> Hopefully by today EOD I'll be able to finish testing with full BAM >>>>>> cluster. >>>>>> >>>>>> >>>>>> Regards, >>>>>> Dunith >>>>>> >>>>>> >>>>>> On Wed, Oct 29, 2014 at 11:40 AM, Aparna Karunarathna < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi Dunith, >>>>>>> >>>>>>> Any update on puppet scripts? >>>>>>> >>>>>>> Regards, >>>>>>> Aparna. >>>>>>> >>>>>>> On Mon, Oct 27, 2014 at 10:42 AM, Sewmini Jayaweera < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Hi Aparna, >>>>>>>> >>>>>>>> I tested following issues, >>>>>>>> >>>>>>>> [1] https://wso2.org/jira/browse/BAM-1611 >>>>>>>> [2] https://wso2.org/jira/browse/BAM-1515 >>>>>>>> [3] https://redmine.wso2.com/issues/3186 >>>>>>>> >>>>>>>> Issue [1] and [2] were fixed. >>>>>>>> >>>>>>>> in order to test issue [3] I created an email adaptor and when >>>>>>>> sending a email contains text as e-mail body got following error >>>>>>>> >>>>>>>> [2014-10-27 10:23:36,317] INFO >>>>>>>> {org.apache.axis2.builder.BuilderUtil} - OMException in getSOAPBuilder >>>>>>>> org.apache.axiom.om.OMException: >>>>>>>> com.ctc.wstx.exc.WstxUnexpectedCharException: Unexpected character 'm' >>>>>>>> (code 109) in prolog; expected '<' >>>>>>>> at [row,col {unknown-source}]: [1,1] >>>>>>>> at >>>>>>>> org.apache.axiom.om.impl.builder.StAXOMBuilder.next(StAXOMBuilder.java:296) >>>>>>>> at >>>>>>>> org.apache.axiom.soap.impl.builder.StAXSOAPModelBuilder.getSOAPEnvelope(StAXSOAPModelBuilder.java:204) >>>>>>>> at java.lang.Thread.run(Thread.java:745) >>>>>>>> >>>>>>>> Similar issue is being reported by Shavantha - >>>>>>>> https://wso2.org/jira/browse/BAM-1830 >>>>>>>> >>>>>>>> Thank You. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> Sewmini Jayaweera >>>>>>>> *Software Engineer - QA Team* >>>>>>>> Mobile: +94 (0) 773 381 250 >>>>>>>> [email protected] >>>>>>>> >>>>>>>> On Fri, Oct 24, 2014 at 5:52 PM, Shavantha Weerasinghe < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Hi Inosh >>>>>>>>> >>>>>>>>> When we create a stream the payload is generated in xml format as >>>>>>>>> below[1] however, when the email is sent with this in the body the BAM >>>>>>>>> throws an exception "INFO {org.apache.axis2.builder.BuilderUtil} - >>>>>>>>> OMException in getSOAPBuilder >>>>>>>>> org.apache.axiom.soap.SOAPProcessingException: First Element must >>>>>>>>> contain the local name, Envelope , but found events". If we send the >>>>>>>>> payload on email as [2] the exception is not thrown. Is this the >>>>>>>>> expected >>>>>>>>> behaviour >>>>>>>>> >>>>>>>>> [1] system generated payload >>>>>>>>> <events> >>>>>>>>> <event> >>>>>>>>> <metaData> >>>>>>>>> <tenant_id>45</tenant_id> >>>>>>>>> <http_method>data1</http_method> >>>>>>>>> <character_set_encoding>data4</character_set_encoding> >>>>>>>>> <remote_address>data4</remote_address> >>>>>>>>> <transport_in_url>data2</transport_in_url> >>>>>>>>> <message_type>data3</message_type> >>>>>>>>> <remote_host>data1</remote_host> >>>>>>>>> <service_prefix>data3</service_prefix> >>>>>>>>> <host>data2</host> >>>>>>>>> </metaData> >>>>>>>>> <correlationData> >>>>>>>>> <activity_id>data5</activity_id> >>>>>>>>> </correlationData> >>>>>>>>> <payloadData> >>>>>>>>> <message_direction>data5</message_direction> >>>>>>>>> <service_name>data3</service_name> >>>>>>>>> <operation_name>data4</operation_name> >>>>>>>>> <message_id>data1</message_id> >>>>>>>>> <timestamp>645565</timestamp> >>>>>>>>> </payloadData> >>>>>>>>> </event> >>>>>>>>> </events> >>>>>>>>> >>>>>>>>> [2] with soap envelope >>>>>>>>> <soap:Envelope xmlns:soap="http://www.w3.org/2003/05/soap-envelope >>>>>>>>> " >>>>>>>>> xmlns:ser="http://services.samples" >>>>>>>>> xmlns:xsd="http://services.samples/xsd"> >>>>>>>>> <soap:Header/> >>>>>>>>> <soap:Body> >>>>>>>>> <events> >>>>>>>>> <event> >>>>>>>>> <metaData> >>>>>>>>> <tenant_id>100</tenant_id> >>>>>>>>> <http_method>data3</http_ >>>>>>>>> method> >>>>>>>>> <character_set_encoding>data5< >>>>>>>>> /character_set_encoding> >>>>>>>>> <remote_address>data5</remote_ >>>>>>>>> address> >>>>>>>>> <transport_in_url>data3</transport_in_url> >>>>>>>>> <message_type>data1</message_type> >>>>>>>>> <remote_host>data2</remote_host> >>>>>>>>> <service_prefix>data4</service_prefix> >>>>>>>>> <host>data1</host> >>>>>>>>> </metaData> >>>>>>>>> <correlationData> >>>>>>>>> <activity_id>data2</activity_id> >>>>>>>>> </correlationData> >>>>>>>>> <payloadData> >>>>>>>>> <message_direction>data3</message_direction> >>>>>>>>> <service_name>data1</service_name> >>>>>>>>> <operation_name>data1</operation_name> >>>>>>>>> <message_id>data4</message_id> >>>>>>>>> <timestamp>323232</timestamp> >>>>>>>>> </payloadData> >>>>>>>>> </event> >>>>>>>>> </events> >>>>>>>>> </soap:Body> >>>>>>>>> </soap:Envelope> >>>>>>>>> >>>>>>>>> >>>>>>>>> Shavantha Weerasinghe >>>>>>>>> Senior Software Engineer QA >>>>>>>>> WSO2, Inc. >>>>>>>>> lean.enterprise.middleware. >>>>>>>>> http://wso2.com >>>>>>>>> http://wso2.org >>>>>>>>> Tel : 94 11 214 5345 >>>>>>>>> Fax :94 11 2145300 >>>>>>>>> >>>>>>>>> >>>>>>>>> On Thu, Oct 23, 2014 at 2:10 PM, Shavantha Weerasinghe < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Hi Aparna/Asanthi >>>>>>>>>> >>>>>>>>>> Hi Guys >>>>>>>>>> >>>>>>>>>> The attachment on google drive has all that is needed to try MQTT >>>>>>>>>> flow >>>>>>>>>> >>>>>>>>>> regards, >>>>>>>>>> mqttex.zip >>>>>>>>>> <https://docs.google.com/a/wso2.com/file/d/0B3pVKBDCKX9lYTgxcXM2QlFDMEE/edit?usp=drive_web> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> Shavantha Weerasinghe >>>>>>>>>> Senior Software Engineer QA >>>>>>>>>> WSO2, Inc. >>>>>>>>>> lean.enterprise.middleware. >>>>>>>>>> http://wso2.com >>>>>>>>>> http://wso2.org >>>>>>>>>> Tel : 94 11 214 5345 >>>>>>>>>> Fax :94 11 2145300 >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, Oct 22, 2014 at 3:12 PM, Anjana Fernando <[email protected] >>>>>>>>>> > wrote: >>>>>>>>>> >>>>>>>>>>> Hi Aparna, >>>>>>>>>>> >>>>>>>>>>> First, use the versions by default mentioned in the puppet >>>>>>>>>>> setup. Then after that, you can move into Apache Cassandra 2.0.x >>>>>>>>>>> and DSE >>>>>>>>>>> Cassandra 2.0 based one. Hadoop use the same mentioned in the >>>>>>>>>>> puppet setup, >>>>>>>>>>> that is the stable v1 version. >>>>>>>>>>> >>>>>>>>>>> Cheers, >>>>>>>>>>> Anjana. >>>>>>>>>>> >>>>>>>>>>> On Wed, Oct 22, 2014 at 11:40 AM, Aparna Karunarathna < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Anjana, >>>>>>>>>>>> >>>>>>>>>>>> As we discussed(Anjana, Evanthika & myself), due to the limited >>>>>>>>>>>> time frame we have to prioritize the testing scope. BAM Cluster >>>>>>>>>>>> should be >>>>>>>>>>>> configured using puppet scripts. Therefore can you please specify >>>>>>>>>>>> the exact >>>>>>>>>>>> Cassandra & hadoop versions to test. >>>>>>>>>>>> >>>>>>>>>>>> Regards, >>>>>>>>>>>> Aparna. >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Oct 22, 2014 at 11:26 AM, Asanthi Kulasinghe < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi, >>>>>>>>>>>>> >>>>>>>>>>>>> Can we please have a p2 repo to be used for this? >>>>>>>>>>>>> >>>>>>>>>>>>> Regards >>>>>>>>>>>>> Asanthi >>>>>>>>>>>>> >>>>>>>>>>>>> On Tue, Oct 21, 2014 at 8:39 PM, Shavantha Weerasinghe < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi Aparna >>>>>>>>>>>>>> >>>>>>>>>>>>>> I have started work on the test scenarios for feature ID#3186 >>>>>>>>>>>>>> related to Multiple Transport/Data Format Support in BAM >>>>>>>>>>>>>> >>>>>>>>>>>>>> regards, >>>>>>>>>>>>>> >>>>>>>>>>>>>> Shavantha Weerasinghe >>>>>>>>>>>>>> Senior Software Engineer QA >>>>>>>>>>>>>> WSO2, Inc. >>>>>>>>>>>>>> lean.enterprise.middleware. >>>>>>>>>>>>>> http://wso2.com >>>>>>>>>>>>>> http://wso2.org >>>>>>>>>>>>>> Tel : 94 11 214 5345 >>>>>>>>>>>>>> Fax :94 11 2145300 >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Tue, Oct 21, 2014 at 2:24 PM, Yasith Tharindu < >>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Given access to the nominated people. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Mon, Oct 20, 2014 at 5:19 PM, Evanthika Amarasiri < >>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi Yasith, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> It would be great if we you can grant us access to the QA >>>>>>>>>>>>>>>> cloud asap since we need to start setting up the environments >>>>>>>>>>>>>>>> and start >>>>>>>>>>>>>>>> testing the products. The release is on the 24th (Oct). >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Regards, >>>>>>>>>>>>>>>> Evanthika >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Mon, Oct 20, 2014 at 5:15 PM, Rasanjaya Subasinghe < >>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Hi, >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> The new setup is almost configured and linux bases images >>>>>>>>>>>>>>>>> are already uploaded and tested.And newly system can be >>>>>>>>>>>>>>>>> accessible by OT >>>>>>>>>>>>>>>>> credentials. But before gain access to the private cloud you >>>>>>>>>>>>>>>>> need to ask >>>>>>>>>>>>>>>>> yasith to enable the user credentials. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Thank you. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>> ~Thanks >>>>>>>>>>>>>>> Yasith Tharindu,*WSO2 Inc,* >>>>>>>>>>>>>>> Blog : http://www.yasith.info >>>>>>>>>>>>>>> Twitter : http://twitter.com/yasithnd >>>>>>>>>>>>>>> LinkedIn : http://www.linkedin.com/in/yasithnd >>>>>>>>>>>>>>> GPG ID : *57CEE66E* >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *US : +1 (408) 754-7388 <%28408%29%20754-7388> - 51926* >>>>>>>>>>>>>>> *LK : +94 (011) 214 5345 - 1005739* >>>>>>>>>>>>>>> "' lean "' enterprise '" middleware '" http://wso2.com >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> *Asanthi Kulasinghe* >>>>>>>>>>>>> WSO2 Inc; http://www.wso2.com/. >>>>>>>>>>>>> Mobile: +94777355522 >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> *Aparna Karunarathna.* >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> *Senior Software Engineer - QAWSO2 Inc.Mobile: 0714002533 >>>>>>>>>>>> <0714002533>* >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> *Anjana Fernando* >>>>>>>>>>> Senior Technical Lead >>>>>>>>>>> WSO2 Inc. | http://wso2.com >>>>>>>>>>> lean . enterprise . middleware >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Aparna Karunarathna.* >>>>>>> >>>>>>> >>>>>>> *Senior Software Engineer - QAWSO2 Inc.Mobile: 0714002533* >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Regards, >>>>>> >>>>>> Dunith Dhanushka, >>>>>> Senior Software Engineer - BAM, >>>>>> WSO2 Inc, >>>>>> >>>>>> Mobile - +94 71 8615744 >>>>>> Blog - dunithd.wordpress.com <http://blog.dunith.com> >>>>>> Twitter - @dunithd <http://twitter.com/dunithd> >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Regards, >>>>> >>>>> Dunith Dhanushka, >>>>> Senior Software Engineer - BAM, >>>>> WSO2 Inc, >>>>> >>>>> Mobile - +94 71 8615744 >>>>> Blog - dunithd.wordpress.com <http://blog.dunith.com> >>>>> Twitter - @dunithd <http://twitter.com/dunithd> >>>>> >>>> >>>> >>>> >>>> -- >>>> Regards, >>>> >>>> Dunith Dhanushka, >>>> Senior Software Engineer - BAM, >>>> WSO2 Inc, >>>> >>>> Mobile - +94 71 8615744 >>>> Blog - dunithd.wordpress.com <http://blog.dunith.com> >>>> Twitter - @dunithd <http://twitter.com/dunithd> >>>> >>> >>> >> >> >> -- >> Regards, >> >> Dunith Dhanushka, >> Senior Software Engineer - BAM, >> WSO2 Inc, >> >> Mobile - +94 71 8615744 >> Blog - dunithd.wordpress.com <http://blog.dunith.com> >> Twitter - @dunithd <http://twitter.com/dunithd> >> > > > > -- > Regards, > > Dunith Dhanushka, > Senior Software Engineer - BAM, > WSO2 Inc, > > Mobile - +94 71 8615744 > Blog - dunithd.wordpress.com <http://blog.dunith.com> > Twitter - @dunithd <http://twitter.com/dunithd> >
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
