[Dev] wso2 ESB created API not working
Hi all,
I have created a API using soap service which is hosted in another wso2 ESB.
But when I trying to access the service, it gives below error every time(used
soapui rest service tester).
soapenv:Reason xmlns:soapenv=http://www.w3.org/2003/05/soap-envelope;
soapenv:Text xml:lang=en-USThe service cannot be found for the endpoint
reference (EPR)
/browns/send?UN=xxamp;PW=amp;dest_number=xxamp;message=xx/soapenv:Text
/soapenv:Reason
Api URL is below,
http://xxx.xxx.xxx.xxx:8282/browns/send?UN=xxxPW=xxxdest_number=message=x
below is the errorlog when I trying to access created API,
TID: [0] [ESB] [2015-08-14 15:57:14,314] ERROR
{org.apache.axis2.engine.AxisEngine} - The service cannot be found for the
endpoint reference (EPR)
/browns/send?user=pass=xxxreci=msg=xxx
{org.apache.axis2.engine.AxisEngine}
org.apache.axis2.AxisFault: The service cannot be found for the endpoint
reference (EPR)
/browns/send?user=xxpass=reci=msg=x
at
org.apache.axis2.engine.DispatchPhase.validateTransport(DispatchPhase.java:251)
at
org.apache.axis2.engine.DispatchPhase.checkPostConditions(DispatchPhase.java:109)
at org.apache.axis2.engine.Phase.invoke(Phase.java:329)
at org.apache.axis2.engine.AxisEngine.invoke(AxisEngine.java:261)
at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:167)
at
org.apache.synapse.transport.passthru.ServerWorker.processNonEntityEnclosingRESTHandler(ServerWorker.java:344)
at
org.apache.synapse.transport.passthru.ServerWorker.run(ServerWorker.java:168)
at
org.apache.axis2.transport.base.threads.NativeWorkerPool$1.run(NativeWorkerPool.java:172)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
But when I create same API in another ESB server with same settings it works
fine without any problems.
Also I have attached the axis2.xml for more information regarding axis settings
I used.
I spend whole day to solve this but still I can't understand why this is
happening.
Regards,
Akila Rathnayake
This message (including any attachments) is intended only for
the use of the individual or entity to which it is addressed and
may contain information that is non-public, proprietary,
privileged, confidential, and exempt from disclosure under
applicable law or may constitute as attorney work product.
If you are not the intended recipient, you are hereby notified
that any use, dissemination, distribution, or copying of this
communication is strictly prohibited. If you have received this
communication in error, notify us immediately by telephone and
(i) destroy this message if a facsimile or (ii) delete this message
immediately if this is an electronic communication.
Thank you.
?xml version=1.0 encoding=ISO-8859-1?
!--
~ Copyright (c) 2005-2010, WSO2 Inc. (http://wso2.com) All Rights Reserved.
~
~ WSO2 Inc. licenses this file to you under the Apache License,
~ Version 2.0 (the License); you may not use this file except
~ in compliance with the License.
~ You may obtain a copy of the License at
~
~http://www.apache.org/licenses/LICENSE-2.0
~
~ Unless required by applicable law or agreed to in writing,
~ software distributed under the License is distributed on an
~ AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
~ KIND, either express or implied. See the License for the
~ specific language governing permissions and limitations
~ under the License.
--
axisconfig name=AxisJava2.0
!-- = --
!-- Parameters --
!-- = --
!-- Change this to true if you want to enable hot deployment of services --
parameter name=hotdeployment locked=falsetrue/parameter
!-- Change this to true if you want to enable hot update of services --
parameter name=hotupdate locked=falsetrue/parameter
!-- Change this to true if you want to enable MTOM --
parameter name=enableMTOM locked=falsefalse/parameter
!-- Change this to true if you want to enable SwA --
parameter name=enableSwA locked=falsefalse/parameter
!-- If you want to enable file caching for attachments change this to true --
parameter name=cacheAttachments locked=falsefalse/parameter
!-- Attachment file caching location relative to CARBON_HOME --
parameter name=attachmentDIR locked=falsework/mtom/parameter
!-- Attachment file cache threshold size --
parameter name=sizeThreshold locked=false4000/parameter
!-- Completely disable REST handling in Axis2/Synapse if the value is true --
parameter name=disableREST
[Dev] Error while using EJB mediator
Hi, I'm trying EJB sample given in [1], [2]. But getting following exception while invoking the proxy. Found this [3] which is reported earlier, but for me issue comes continuously not intermittent. Also [4] seems to be related. but not sure how to set this property with ESB. Appreciate any help to sort this. [1] http://wso2.com/library/articles/2012/06/ejb-mediator-action-wso2-esb-450/ [2] http://www.dushantech.com/2012/06/syntaxhighlighter.html [3] https://wso2.org/jira/browse/ESBJAVA-1487 [4] http://stackoverflow.com/questions/11975396/no-ejb-receiver-available-for-handling Regards, Dinusha. -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Error while using EJB mediator
Forgot to send the exception org.apache.synapse.SynapseException: Error while invoking 'getClosestStore' method via reflection. at org.apache.synapse.mediators.bean.BeanUtils.invokeInstanceMethod(BeanUtils.java:79) at org.apache.synapse.mediators.bean.enterprise.EJBMediator.mediate(EJBMediator.java:132) at org.apache.synapse.mediators.AbstractListMediator.mediate(AbstractListMediator.java:77) at org.apache.synapse.mediators.AbstractListMediator.mediate(AbstractListMediator.java:47) at org.apache.synapse.mediators.base.SequenceMediator.mediate(SequenceMediator.java:131) at org.apache.synapse.core.axis2.ProxyServiceMessageReceiver.receive(ProxyServiceMessageReceiver.java:166) at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180) at org.apache.synapse.transport.passthru.ServerWorker.processEntityEnclosingRequest(ServerWorker.java:411) at org.apache.synapse.transport.passthru.ServerWorker.run(ServerWorker.java:183) at org.apache.axis2.transport.base.threads.NativeWorkerPool$1.run(NativeWorkerPool.java:172) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.synapse.mediators.bean.BeanUtils.invokeInstanceMethod(BeanUtils.java:74) ... 12 more Caused by: java.lang.IllegalStateException: No EJB receiver available for handling [appName:,modulename:EJBDemo,distinctname:] combination for invocation context org.jboss.ejb.client.EJBClientInvocationContext@5d5f1834 at org.jboss.ejb.client.EJBClientContext.requireEJBReceiver(EJBClientContext.java:584) at org.jboss.ejb.client.ReceiverInterceptor.handleInvocation(ReceiverInterceptor.java:119) at org.jboss.ejb.client.EJBClientInvocationContext.sendRequest(EJBClientInvocationContext.java:181) at org.jboss.ejb.client.EJBInvocationHandler.doInvoke(EJBInvocationHandler.java:136) at org.jboss.ejb.client.EJBInvocationHandler.doInvoke(EJBInvocationHandler.java:121) at org.jboss.ejb.client.EJBInvocationHandler.invoke(EJBInvocationHandler.java:104) at $Proxy17.getClosestStore(Unknown Source) On Fri, Aug 14, 2015 at 5:14 PM, Dinusha Senanayaka dinu...@wso2.com wrote: Hi, I'm trying EJB sample given in [1], [2]. But getting following exception while invoking the proxy. Found this [3] which is reported earlier, but for me issue comes continuously not intermittent. Also [4] seems to be related. but not sure how to set this property with ESB. Appreciate any help to sort this. [1] http://wso2.com/library/articles/2012/06/ejb-mediator-action-wso2-esb-450/ [2] http://www.dushantech.com/2012/06/syntaxhighlighter.html [3] https://wso2.org/jira/browse/ESBJAVA-1487 [4] http://stackoverflow.com/questions/11975396/no-ejb-receiver-available-for-handling Regards, Dinusha. -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/ -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [CARBON-15265][IDENTITY-3423][MB-1128] is reproducible in kernal 4.4.1
$subject. Could we have a look? -- Ramith Jayasinghe Technical Lead WSO2 Inc., http://wso2.com lean.enterprise.middleware E: ram...@wso2.com P: +94 777542851 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [CARBON-15265][IDENTITY-3423][MB-1128] is reproducible in kernal 4.4.1
Hi Ramith, It seems this is not the exact same issue reported in [1]. For investigating further can you connect to mysql database from terminal/mysql client and run the following command and share the output with us. We should be able to see the database level errors caused from the output of this command [2]. *SHOW ENGINE INNODB STATUS;* [1] https://wso2.org/jira/browse/CARBON-15265 [2] https://dev.mysql.com/doc/refman/5.5/en/show-engine.html Thanks, TharinduE On Fri, Aug 14, 2015 at 12:44 PM, Ramith Jayasinghe ram...@wso2.com wrote: $subject. Could we have a look? -- Ramith Jayasinghe Technical Lead WSO2 Inc., http://wso2.com lean.enterprise.middleware E: ram...@wso2.com P: +94 777542851 -- Tharindu Edirisinghe Software Engineer | WSO2 Inc Identity Server Team Blog : tharindue.blogspot.com mobile : +94 775 181586 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [PR] Instagram Connector Changes
Hi Malaka, Please find the pull request for $subject [1]. Connector tested with ESB-Beta. [1]. https://github.com/wso2/esb-connectors/pull/267 Thanks, -- dev-requ...@wso2.org Keerthika Mahendralingam Associate Software Engineer Mobile :+94 (0) 776 121144 keerth...@wso2.com WSO2, Inc. lean . enterprise . middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [GSoC-2015] Data Wrangler extension for WSO2 Machine Learner
Hi Nirmal, I have changed the structure so that operations could be recorded at one point using the javascript and then executed later by executing a method in Wrangler class. public void test(JavaRDDString[] data,String scriptPath) public JavaRDDString[] executeOperations(JavaSparkContext jsc,JavaRDD String[] data) Please check above mentioned functions in [1] and let me know if that is fine. I have some issues with saving the javascript into a file. Will send you the details if I cannot figure it out. [1] - https://github.com/danula/wso2-ml-wrangler-integration/blob/master/src/Wrangler/Wrangler.java Danula On Fri, Aug 14, 2015 at 9:52 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, How is it coming along? On Tue, Aug 11, 2015 at 1:51 AM, Danula Eranjith hmdanu...@gmail.com wrote: Hi Supun, Following points were discussed in the meeting *Integration to ML* We decided to add the wrangler interface as the first step considering the current ML implementation. So the steps from a users perspective would be as follows - A sample from the dataset will be sent to wrangler interface. - User can apply desired operations in the wrangler interface - User can return to ML by clicking an button in the interface. - Viewing the script will be optional for the user. - When returned to ML, spark transformations are automatically generated and applied to the dataset. *Spark Transformations* I have implemented all the wrangler transformations by extending a single abstract class. These operations are invoked by parsing the javascript code generated by wrangler. However since ML spark transformations are applied all together at the end of the process, I have to persist all the parameters and keep operations as a list which can be invoked later. Nirmal pointed out that this could be achieved by using chain of responsibility design pattern. I am currently changing the implementation accordingly. I will get back to you and Nirmal when automation process is completed to start the integration. Regards, Danula On Mon, Aug 10, 2015 at 9:29 PM, Supun Sethunga sup...@wso2.com wrote: Any update? On Fri, Aug 7, 2015 at 10:13 AM, Supun Sethunga sup...@wso2.com wrote: Hi Danula, Sorry I couldn't join the meeting. Can you please share the meeting/review notes? Also the progress on the suggestions and what is left to be done in overall? Thanks, Supun On Wed, Aug 5, 2015 at 3:47 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, It should be a JavaRDDString[], where each row represents the feature vector as a string[]. On Tue, Aug 4, 2015 at 11:51 AM, Danula Eranjith hmdanu...@gmail.com wrote: In other words, What would be the preferred output type for a dataset which is pre-processed by wrangler? As I have observed different algorithms use different JavaRDD types as input ( JavaRDDString, JavaRDDVector etc ) On Tue, Aug 4, 2015 at 11:48 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, On Tue, Aug 4, 2015 at 11:47 AM, Danula Eranjith hmdanu...@gmail.com wrote: Hi Nirmal, In ML, what is the preferred way of keeping data in a single row of JavaRDD? I didn't quite get your question. Can you elaborate please? As I have figured it depends on the algorithm being used. Danula On Thu, Jul 30, 2015 at 9:14 AM, Nirmal Fernando nir...@wso2.com wrote: Thanks Danula, I'll send an invite. On Wed, Jul 29, 2015 at 10:24 PM, Danula Eranjith hmdanu...@gmail.com wrote: Hi Nirmal, I am available after 1.30pm on Tuesday, Wednesday and Thursday. Danula On Wed, Jul 29, 2015 at 12:10 PM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, Can we arrange a demo/review somewhere next week? Please let me know few time slots. On Thu, Jul 23, 2015 at 11:47 AM, Nirmal Fernando nir...@wso2.com wrote: Thanks Danula. On Thu, Jul 23, 2015 at 11:41 AM, Danula Eranjith hmdanu...@gmail.com wrote: You can find the source at [1] https://github.com/danula/wso2-ml-wrangler-integration. I have to do some refactoring when integrating to ML. [1] - https://github.com/danula/wso2-ml-wrangler-integration On Thu, Jul 23, 2015 at 11:31 AM, Nirmal Fernando nir...@wso2.com wrote: Thanks Danula. Please share the current code, if possible. On Thu, Jul 23, 2015 at 8:41 AM, Danula Eranjith hmdanu...@gmail.com wrote: Hi all, I have succeeded in parsing the operations from wrangler javascript code to spark transformations I have written. Working on automating the process. Last couple of steps would be changing the wrangler interface and integrating it into ML Wizard. Thanks Danula On Wed, Jul 22, 2015 at 9:31 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, Could you please summarize the current status of the project and also the things left to do? On Sun, Jul 19, 2015 at 11:39 PM, Danula Eranjith hmdanu...@gmail.com wrote: Thank you. Will use them. I already have some other kaggle datasets as
Re: [Dev] [ML] Categorical or Numerical column?
Hi all, +1 for a hybrid solution. But still a -1 for using skewness even in the hybrid solution :D One good example why we shouldn't use skenwness is the income distribution graph in [1]. There, regardless of whether Im using the raw data (then its a continuous feature) or whether Im breaking them in to intervals and categorized the income in to several levels, I would get the same shape for the distribution. i.e skewness would be significant. So the point Im trying to make is, categorical features as well as a continuous features can be skewed/symmetric, and we cant really distinguish. [1] https://cdn2.vox-cdn.com/uploads/chorus_asset/file/2930990/Distribution_of_Annual_Household_Income_in_the_United_States_2012.0.png On Fri, Aug 14, 2015 at 1:03 AM, Nirmal Fernando nir...@wso2.com wrote: Thanks Thushan. Good suggestion on the frequency. *solutions* 1. Categorical threshold: if # of distinct values are less than X, it is a categorical feature. 2. Make all features with only integers (no decimals) categorical. 3. Skewness: if skewness of a distribution of a feature is less than X, it is a categorical feature. 4. Gaps between consecutive distinct values 5. Frequency of distinct values - if they repeat enough, then it is a categorical feature. 6. Combined solution So, I guess as suggested by many of you, we need to build a combined solution. On Fri, Aug 14, 2015 at 10:29 AM, Thushan Ganegedara thu...@gmail.com wrote: Moreover, I think a hybrid approach as follows might work well. 1. Select a sample 2. Filter columns by the data type and find potential categorical variables (integer / string) 3. Filter further by checking if same values are repeated multiple times in the dataset. On Fri, Aug 14, 2015 at 2:53 PM, Nirmal Fernando nir...@wso2.com wrote: Thanks for all the input. So let me summarise; *the problem* * We need to determine whether a feature is a categorical one or not, to draw certain graphs to explore a dataset, before a user starts to build analyses (before user input). * We can't get a 100% accuracy, hence it is of course a suggestion that we do. * Question is, what would be the most accurate method. *solutions* 1. Categorical threshold: if # of distinct values are less than X, it is a categorical feature. 2. Make all features with only integers (no decimals) categorical. 3. Skewness: if skewness of a distribution of a feature is less than X, it is a categorical feature. 4. Gaps between consecutive distinct values 5. Combined solution On Fri, Aug 14, 2015 at 9:33 AM, Maheshakya Wijewardena mahesha...@wso2.com wrote: Another approach to distinguish between categorical and numerical features can be elaborated as follows: First, we take out the unique values from the column and sort them. If it's a categorical feature, then the gaps between the elements of this sorted list should be equal. In a numerical feature, this is extremely unlikely to happen. This behavior of valid in most scenarios, but there are a few exceptions as well. eg: when a numerical ID is used as the categorical label - 19933, 19913, 18832, ... This is a very simple hack that can be easily implemented, but not a standard technique. WDYT? On Fri, Aug 14, 2015 at 8:55 AM, Srinath Perera srin...@wso2.com wrote: I mean current approach and skewness? On Fri, Aug 14, 2015 at 8:54 AM, Srinath Perera srin...@wso2.com wrote: Can we use a combination of both? On Thu, Aug 13, 2015 at 8:46 PM, Supun Sethunga sup...@wso2.com wrote: When a dataset is large, in general its said to be approximates to a Normal Distribution. :) True it Hypothetical, but the point they make is, when the datasets are large, then properties of a distribution like skewness, variance and etc. become closer to the properties Normal Distribution in most cases.. On Thu, Aug 13, 2015 at 11:07 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Supun, Thanks for the reply. On Thu, Aug 13, 2015 at 8:09 PM, Supun Sethunga sup...@wso2.com wrote: Hi Nirmal, IMO don't think we would be able to use skewness in this case. Skewness says how symmetric the distribution is. For example, if we consider a numerical/continuous feature (not categorical) which is Normally Distributed, then the skewness would be 0. Also for a categorical (encoded) feature having a systematic distribution, then again the skewness would be 0. What's the probability of you see a normal distribution of a real dataset? IMO it's very less and also since what we're doing here is a suggestion, do you see it as an issue? We did have this concern at the beginning as well, regarding how we could determine whether a feature is categorical or Continuous. Usually this is strictly dependent on the domain of the dataset (i.e. user have to decide this with the knowledge about the data). That was the idea behind letting user change the data type.. But since we needed a default option,
Re: [Dev] [DAS 3.0.0 Beta] No FileSystem for scheme: file
Hi Anuruddha,
Were you able to fix the later issue?
On Mon, Jul 27, 2015 at 11:55 AM, Gokul Balakrishnan go...@wso2.com wrote:
Hi Anuruddha,
This seems to be an issue with the HBase cluster itself rather than an
integration issue. Could you check the HBase logs and see if anything is
reported there? In any case, please also specify the zookeeper quorum
property as well (hbase.zookeeper.quorum and specify the zk nodes)
Thanks,
On 27 July 2015 at 11:45, Anuruddha Liyanarachchi anurudd...@wso2.com
wrote:
Hi Gokul,
Thanks for the reply.
Yes this runs on a HBase cluster. I have added the properties and it
fixed the No FileSystem for scheme: file Error. Now I am getting following
error.
org.wso2.carbon.analytics.datasource.commons.exception.AnalyticsException:
Error checking existence of table __SHARD_INDEX_UPDATE_RECORDS__1 for
tenant -1000
at
org.wso2.carbon.analytics.datasource.hbase.HBaseAnalyticsRecordStore.tableExists(HBaseAnalyticsRecordStore.java:126)
at
org.wso2.carbon.analytics.datasource.hbase.HBaseAnalyticsRecordStore.get(HBaseAnalyticsRecordStore.java:274)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.loadIndexOperationRecords(AnalyticsDataIndexer.java:554)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.loadIndexOperationUpdateRecords(AnalyticsDataIndexer.java:519)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.loadIndexOperationUpdateRecords(AnalyticsDataIndexer.java:515)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.processIndexUpdateOperations(AnalyticsDataIndexer.java:403)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.processIndexOperations(AnalyticsDataIndexer.java:491)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.access$200(AnalyticsDataIndexer.java:118)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer$IndexWorker.run(AnalyticsDataIndexer.java:1744)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException:
Can't get the locations
at
org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:305)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:131)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:56)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
at
org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:287)
at
org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:267)
at
org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:139)
at
org.apache.hadoop.hbase.client.ClientScanner.init(ClientScanner.java:134)
at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:823)
at
org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:601)
at
org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:365)
at
org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:281)
at
org.wso2.carbon.analytics.datasource.hbase.HBaseAnalyticsRecordStore.tableExists(HBaseAnalyticsRecordStore.java:123)
... 11 more
On Mon, Jul 27, 2015 at 10:54 AM, Gokul Balakrishnan go...@wso2.com
wrote:
Hi Anuruddha,
Are you running HBase on a cluster (i.e. on top of HDFS)? If yes, can
you ensure that you have the following in the analytics-datasource.xml for
the HBase datasource?
property
namefs.hdfs.impl/name
valueorg.apache.hadoop.hdfs.DistributedFileSystem/value
/property
property
namefs.file.impl/name
valueorg.apache.hadoop.fs.LocalFileSystem/value
/property
Thanks,
On 27 July 2015 at 10:43, Anuruddha Liyanarachchi anurudd...@wso2.com
wrote:
Hi DAS team,
I have created DAS receiver and analytics cluster as in the diagram
[1].
In the setup DAS receivers are connected to MySQL (FS_DB) and HBase
(EventStore).
I am getting following errors when I start DAS receivers. What could be
the reason for this error ?
I have attached the carbon log as well.
TID: [-1] [] [2015-07-27 04:37:40,838] WARN
{org.apache.hadoop.hbase.util.DynamicClassLoader} - Failed to identify the
fs of dir /opt/wso2das-3.0.0-SNAPSHOT/tmp/hbase-root/hbase/lib, ignored
{org.apac
he.hadoop.hbase.util.DynamicClassLoader}
java.io.IOException: No FileSystem for scheme: file
at
org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
at
Re: [Dev] Next carbon-deployment release is 4.5.0
Thanks. On Fri, Aug 14, 2015 at 1:44 PM, KasunG Gajasinghe kas...@wso2.com wrote: Merged. On Fri, Aug 14, 2015 at 11:02 AM, Priyadarssini Kishokumar priyadarss...@wso2.com wrote: Hi, Please verify merge PR[1] for the improvement [2] [1] https://github.com/wso2/carbon-deployment/pull/104 [2] https://wso2.org/jira/browse/ESBJAVA-3858 Thanks, On Thu, Aug 13, 2015 at 2:47 PM, KasunG Gajasinghe kas...@wso2.com wrote: The release date is this Friday. So, make sure to send all the fixes if any EOD today. Thanks. On Tue, Aug 11, 2015 at 6:40 PM, KasunG Gajasinghe kas...@wso2.com wrote: Hi, This is to update that the next carbon-deployment release is 4.5.0. AS will need a Jaggery release on top of carbon-deployment 4.5.0 for the AS 5.3.0 beta release. Thanks, KasunG -- *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. email: kasung AT spamfree wso2.com linked-in: http://lk.linkedin.com/in/gajasinghe blog: http://kasunbg.org -- *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. email: kasung AT spamfree wso2.com linked-in: http://lk.linkedin.com/in/gajasinghe blog: http://kasunbg.org ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Priya Kishok Software Engineer WSO2, Inc : http://wso2.com Mob : +94774457404 -- *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. email: kasung AT spamfree wso2.com linked-in: http://lk.linkedin.com/in/gajasinghe blog: http://kasunbg.org -- Priya Kishok Software Engineer WSO2, Inc : http://wso2.com Mob : +94774457404 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Next carbon-deployment release is 4.5.0
Merged. On Fri, Aug 14, 2015 at 11:02 AM, Priyadarssini Kishokumar priyadarss...@wso2.com wrote: Hi, Please verify merge PR[1] for the improvement [2] [1] https://github.com/wso2/carbon-deployment/pull/104 [2] https://wso2.org/jira/browse/ESBJAVA-3858 Thanks, On Thu, Aug 13, 2015 at 2:47 PM, KasunG Gajasinghe kas...@wso2.com wrote: The release date is this Friday. So, make sure to send all the fixes if any EOD today. Thanks. On Tue, Aug 11, 2015 at 6:40 PM, KasunG Gajasinghe kas...@wso2.com wrote: Hi, This is to update that the next carbon-deployment release is 4.5.0. AS will need a Jaggery release on top of carbon-deployment 4.5.0 for the AS 5.3.0 beta release. Thanks, KasunG -- *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. email: kasung AT spamfree wso2.com linked-in: http://lk.linkedin.com/in/gajasinghe blog: http://kasunbg.org -- *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. email: kasung AT spamfree wso2.com linked-in: http://lk.linkedin.com/in/gajasinghe blog: http://kasunbg.org ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Priya Kishok Software Engineer WSO2, Inc : http://wso2.com Mob : +94774457404 -- *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. email: kasung AT spamfree wso2.com linked-in: http://lk.linkedin.com/in/gajasinghe blog: http://kasunbg.org ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ESB] Issue after adding basic scenario integrity security to an application.
Below is my client policy. Is there a way I can resolve this issue? Thanks! ?xml version=1.0 encoding=UTF-8? wsp:Policy xmlns:wsp=http://schemas.xmlsoap.org/ws/2004/09/policy; xmlns:wsu= http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd wsu:Id=EncrOnlyAnonymous wsp:ExactlyOne wsp:All sp:SymmetricBinding xmlns:sp= http://schemas.xmlsoap.org/ws/2005/07/securitypolicy; wsp:Policy sp:ProtectionToken wsp:Policy sp:X509Token sp:IncludeToken= http://schemas.xmlsoap.org/ws/2005/07/securitypolicy/IncludeToken/Never; wsp:Policy sp:RequireThumbprintReference/sp:RequireThumbprintReference sp:WssX509V3Token10/sp:WssX509V3Token10 /wsp:Policy /sp:X509Token /wsp:Policy /sp:ProtectionToken sp:AlgorithmSuite wsp:Policy sp:Basic256/sp:Basic256 /wsp:Policy /sp:AlgorithmSuite sp:Layout wsp:Policy sp:Lax/sp:Lax /wsp:Policy /sp:Layout sp:IncludeTimestamp/sp:IncludeTimestamp sp:OnlySignEntireHeadersAndBody/sp:OnlySignEntireHeadersAndBody /wsp:Policy /sp:SymmetricBinding sp:SignedParts xmlns:sp= http://schemas.xmlsoap.org/ws/2005/07/securitypolicy; sp:Body/sp:Body /sp:SignedParts sp:Wss11 xmlns:sp= http://schemas.xmlsoap.org/ws/2005/07/securitypolicy; wsp:Policy sp:MustSupportRefKeyIdentifier/sp:MustSupportRefKeyIdentifier sp:MustSupportRefIssuerSerial/sp:MustSupportRefIssuerSerial sp:MustSupportRefThumbprint/sp:MustSupportRefThumbprint sp:RequireSignatureConfirmation/sp:RequireSignatureConfirmation /wsp:Policy /sp:Wss11 sp:Trust10 xmlns:sp= http://schemas.xmlsoap.org/ws/2005/07/securitypolicy; wsp:Policy sp:RequireClientEntropy/sp:RequireClientEntropy sp:RequireServerEntropy/sp:RequireServerEntropy sp:MustSupportIssuedTokens/sp:MustSupportIssuedTokens /wsp:Policy /sp:Trust10 ramp:RampartConfig xmlns:ramp=http://ws.apache.org/rampart/policy; ramp:encryptionUserservice/ramp:encryptionUser ramp:userclient/ramp:user ramp:passwordCallbackClasscom.wso2.training.orderprocessingclient.PWCBHandler/ramp:passwordCallbackClass ramp:signatureCrypto ramp:crypto provider=org.apache.ws.security.components.crypto.Merlin ramp:property name=org.apache.ws.security.crypto.merlin.keystore.typeJKS/ramp:property ramp:property name=org.apache.ws.security.crypto.merlin.file/home/WSO2/Order Processing Client/cert/client/client.jks/ramp:property ramp:property name=org.apache.ws.security.crypto.merlin.keystore.password12345678/ramp:property /ramp:crypto /ramp:signatureCrypto /ramp:RampartConfig /wsp:All /wsp:ExactlyOne /wsp:Policy On Fri, Aug 14, 2015 at 10:11 AM, Jayanga Kaushalya jayan...@wso2.com wrote: Hi all, I have an unsecured web service which is secured by the ESB basic scenario integrity type security. But when I am receiving responses from the ESB, org.apache.axis2.AxisFault: An invalid security token was provided (Bad TokenType ) exception is occurring on the client side. I have captured the response from the ESB and below is the header. I am using ESB 4.8.1, Axis2 1.6.3 (Client and service) and jdk 1.7.0_79 for ESB. Thanks! ?xml version=1.0 encoding=UTF-8? soapenv:Envelope xmlns:soapenv= http://www.w3.org/2003/05/soap-envelope; soapenv:Header xmlns:wsa=http://www.w3.org/2005/08/addressing; wsse:Security xmlns:wsse= http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd; soapenv:mustUnderstand=true wsu:Timestamp xmlns:wsu= http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd; wsu:Id=Timestamp-4 wsu:Created2015-08-14T04:00:06.049Z/wsu:Created wsu:Expires2015-08-14T04:05:06.049Z/wsu:Expires /wsu:Timestamp wsse11:SignatureConfirmation xmlns:wsse11= http://docs.oasis-open.org/wss/oasis-wss-wssecurity-secext-1.1.xsd; xmlns:wsu= http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd; Value=LTmJ0jPu/DcTGZmN0MIy+twqZB4= wsu:Id=SigConf-5/wsse11:SignatureConfirmation ds:Signature xmlns:ds=http://www.w3.org/2000/09/xmldsig#; Id=Signature-6 ds:SignedInfo ds:CanonicalizationMethod Algorithm= http://www.w3.org/2001/10/xml-exc-c14n#;/ds:CanonicalizationMethod ds:SignatureMethod Algorithm= http://www.w3.org/2000/09/xmldsig#hmac-sha1;/ds:SignatureMethod ds:Reference URI=#Id-2081567383 ds:Transforms ds:Transform
Re: [Dev] [DAS] DAS dashboard table-gadget column order
Hi Thanuja, Is it same with the H2 table or only the HBase analytics table? On Thu, Aug 13, 2015 at 6:50 PM, Thanuja Uruththirakodeeswaran thanu...@wso2.com wrote: Hi, I've persisted a event stream in event store which is a HBase database. Then using the following query I created table in spark environment. Also I used H2 database as processed store. CREATE TEMPORARY TABLE memberinfo USING CarbonAnalytics OPTIONS (tableName MEMBER_INFO); CREATE TEMPORARY TABLE memberdetails USING CarbonAnalytics OPTIONS (tableName MEMBER_DETAILS, schema X STRING, Y STRING, Z STRING); INSERT OVERWRITE TABLE memberdetails select * from memberinfo; Here MEMBER_INFO - HBase database table, MEMBER_DETAILS - H2 database table When I use the Data Explorer to see records in table MEMBER_DETAILS, column order as specified in schema. But when I created a table gadget using the same table and added to dashboard, column order is not as in schema. But I think columns are in the order as in HBase database table. What I have to do to get the columns as in schema order? Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gimantha Bandara Software Engineer WSO2. Inc : http://wso2.com Mobile : +94714961919 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] How to debug BAM NotificationDispatchTask
Hi Folks, I turned this into a JIRA [1] as I figure it may be, at the very least, a doc issue that I couldn't find a way to debug my problem. [1]https://wso2.org/jira/browse/BAM-2163 many thanks, John. John Hawkins Director: Solutions Architecture On Wed, Aug 12, 2015 at 10:34 AM, John Hawkins jo...@wso2.com wrote: Hi Folks, I'm trying to get working bam_notification messages. I can see the cassandra db getting full with my data and I can see the BAM_NOTIFICATION_DISPATCHER_TASK starting in the BAM console. I believe I have the correct columnId in my dataset and yet my stream does not appear to be working. My problem is that I have no idea how to debug this from here.. I tried turning on debug for the BAM notification class (NotificationDispatchTask) but looking at that code - it doesn't appear to have any debug trace in it ? And I don't see any messages. Could someone tell me the next steps on understanding how I can debug what's going wrong here please ? many thanks, John. John Hawkins Director: Solutions Architecture ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [GSoC-2015] Data Wrangler extension for WSO2 Machine Learner
On Fri, Aug 14, 2015 at 1:25 PM, Danula Eranjith hmdanu...@gmail.com wrote: Hi Nirmal, I have changed the structure so that operations could be recorded at one point using the javascript and then executed later by executing a method in Wrangler class. public void test(JavaRDDString[] data,String scriptPath) public JavaRDDString[] executeOperations(JavaSparkContext jsc,JavaRDD String[] data) Please check above mentioned functions in [1] and let me know if that is fine. Above 2 functions look good. I have some issues with saving the javascript into a file. Will send you the details if I cannot figure it out. [1] - https://github.com/danula/wso2-ml-wrangler-integration/blob/master/src/Wrangler/Wrangler.java Danula On Fri, Aug 14, 2015 at 9:52 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, How is it coming along? On Tue, Aug 11, 2015 at 1:51 AM, Danula Eranjith hmdanu...@gmail.com wrote: Hi Supun, Following points were discussed in the meeting *Integration to ML* We decided to add the wrangler interface as the first step considering the current ML implementation. So the steps from a users perspective would be as follows - A sample from the dataset will be sent to wrangler interface. - User can apply desired operations in the wrangler interface - User can return to ML by clicking an button in the interface. - Viewing the script will be optional for the user. - When returned to ML, spark transformations are automatically generated and applied to the dataset. *Spark Transformations* I have implemented all the wrangler transformations by extending a single abstract class. These operations are invoked by parsing the javascript code generated by wrangler. However since ML spark transformations are applied all together at the end of the process, I have to persist all the parameters and keep operations as a list which can be invoked later. Nirmal pointed out that this could be achieved by using chain of responsibility design pattern. I am currently changing the implementation accordingly. I will get back to you and Nirmal when automation process is completed to start the integration. Regards, Danula On Mon, Aug 10, 2015 at 9:29 PM, Supun Sethunga sup...@wso2.com wrote: Any update? On Fri, Aug 7, 2015 at 10:13 AM, Supun Sethunga sup...@wso2.com wrote: Hi Danula, Sorry I couldn't join the meeting. Can you please share the meeting/review notes? Also the progress on the suggestions and what is left to be done in overall? Thanks, Supun On Wed, Aug 5, 2015 at 3:47 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, It should be a JavaRDDString[], where each row represents the feature vector as a string[]. On Tue, Aug 4, 2015 at 11:51 AM, Danula Eranjith hmdanu...@gmail.com wrote: In other words, What would be the preferred output type for a dataset which is pre-processed by wrangler? As I have observed different algorithms use different JavaRDD types as input ( JavaRDDString, JavaRDDVector etc ) On Tue, Aug 4, 2015 at 11:48 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, On Tue, Aug 4, 2015 at 11:47 AM, Danula Eranjith hmdanu...@gmail.com wrote: Hi Nirmal, In ML, what is the preferred way of keeping data in a single row of JavaRDD? I didn't quite get your question. Can you elaborate please? As I have figured it depends on the algorithm being used. Danula On Thu, Jul 30, 2015 at 9:14 AM, Nirmal Fernando nir...@wso2.com wrote: Thanks Danula, I'll send an invite. On Wed, Jul 29, 2015 at 10:24 PM, Danula Eranjith hmdanu...@gmail.com wrote: Hi Nirmal, I am available after 1.30pm on Tuesday, Wednesday and Thursday. Danula On Wed, Jul 29, 2015 at 12:10 PM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, Can we arrange a demo/review somewhere next week? Please let me know few time slots. On Thu, Jul 23, 2015 at 11:47 AM, Nirmal Fernando nir...@wso2.com wrote: Thanks Danula. On Thu, Jul 23, 2015 at 11:41 AM, Danula Eranjith hmdanu...@gmail.com wrote: You can find the source at [1] https://github.com/danula/wso2-ml-wrangler-integration. I have to do some refactoring when integrating to ML. [1] - https://github.com/danula/wso2-ml-wrangler-integration On Thu, Jul 23, 2015 at 11:31 AM, Nirmal Fernando nir...@wso2.com wrote: Thanks Danula. Please share the current code, if possible. On Thu, Jul 23, 2015 at 8:41 AM, Danula Eranjith hmdanu...@gmail.com wrote: Hi all, I have succeeded in parsing the operations from wrangler javascript code to spark transformations I have written. Working on automating the process. Last couple of steps would be changing the wrangler interface and integrating it into ML Wizard. Thanks Danula On Wed, Jul 22, 2015 at 9:31 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Danula, Could you please summarize the current status of the project and also the things left to do? On Sun, Jul 19, 2015 at
Re: [Dev] [DAS] DAS dashboard table-gadget column order
Hi Gimantha, Yes gadget table columns are not in the order as in schema. Data explorer has same column order as in schema. Thanks. On 14 Aug 2015 18:18, Gimantha Bandara giman...@wso2.com wrote: Columns you define in the schema, does not map to RDBMS physical tables' columns. Are you saying that the gadget tables that you create, do not have the column order as it is in the schema? Is it in the same order in the Data explorer? On 8/14/15, Thanuja Uruththirakodeeswaran thanu...@wso2.com wrote: Hi Gimantha, I used external HBase DB and DAS embedded H2 DB. I checked with HBase table and table-gadget column order same as HBase table. I tried with H2 table, but I couldn't see column names as I think it was encrypted or something. How can I check the column names in DAS embedded H2 database? Thanks. On Fri, Aug 14, 2015 at 1:28 PM, Gimantha Bandara giman...@wso2.com wrote: Hi Thanuja, Is it same with the H2 table or only the HBase analytics table? On Thu, Aug 13, 2015 at 6:50 PM, Thanuja Uruththirakodeeswaran thanu...@wso2.com wrote: Hi, I've persisted a event stream in event store which is a HBase database. Then using the following query I created table in spark environment. Also I used H2 database as processed store. CREATE TEMPORARY TABLE memberinfo USING CarbonAnalytics OPTIONS (tableName MEMBER_INFO); CREATE TEMPORARY TABLE memberdetails USING CarbonAnalytics OPTIONS (tableName MEMBER_DETAILS, schema X STRING, Y STRING, Z STRING); INSERT OVERWRITE TABLE memberdetails select * from memberinfo; Here MEMBER_INFO - HBase database table, MEMBER_DETAILS - H2 database table When I use the Data Explorer to see records in table MEMBER_DETAILS, column order as specified in schema. But when I created a table gadget using the same table and added to dashboard, column order is not as in schema. But I think columns are in the order as in HBase database table. What I have to do to get the columns as in schema order? Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gimantha Bandara Software Engineer WSO2. Inc : http://wso2.com Mobile : +94714961919 -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 -- Gimantha Bandara Software Engineer WSO2. Inc : http://wso2.com Mobile : +94714961919 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS 3.0.0 Beta] No FileSystem for scheme: file
Hi Maheshakya,
The problem was with the HBase cluster. If the HBase cluster is not
properly setup you will get the above mentioned Hbase table issues. Check
the status of the HBase cluster by accessing the Hbase shell.
Thank you!
On Fri, Aug 14, 2015 at 7:28 PM, Maheshakya Wijewardena mahesha...@wso2.com
wrote:
Hi Anuruddha,
Were you able to fix the later issue?
On Mon, Jul 27, 2015 at 11:55 AM, Gokul Balakrishnan go...@wso2.com
wrote:
Hi Anuruddha,
This seems to be an issue with the HBase cluster itself rather than an
integration issue. Could you check the HBase logs and see if anything is
reported there? In any case, please also specify the zookeeper quorum
property as well (hbase.zookeeper.quorum and specify the zk nodes)
Thanks,
On 27 July 2015 at 11:45, Anuruddha Liyanarachchi anurudd...@wso2.com
wrote:
Hi Gokul,
Thanks for the reply.
Yes this runs on a HBase cluster. I have added the properties and it
fixed the No FileSystem for scheme: file Error. Now I am getting following
error.
org.wso2.carbon.analytics.datasource.commons.exception.AnalyticsException:
Error checking existence of table __SHARD_INDEX_UPDATE_RECORDS__1 for
tenant -1000
at
org.wso2.carbon.analytics.datasource.hbase.HBaseAnalyticsRecordStore.tableExists(HBaseAnalyticsRecordStore.java:126)
at
org.wso2.carbon.analytics.datasource.hbase.HBaseAnalyticsRecordStore.get(HBaseAnalyticsRecordStore.java:274)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.loadIndexOperationRecords(AnalyticsDataIndexer.java:554)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.loadIndexOperationUpdateRecords(AnalyticsDataIndexer.java:519)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.loadIndexOperationUpdateRecords(AnalyticsDataIndexer.java:515)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.processIndexUpdateOperations(AnalyticsDataIndexer.java:403)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.processIndexOperations(AnalyticsDataIndexer.java:491)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.access$200(AnalyticsDataIndexer.java:118)
at
org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer$IndexWorker.run(AnalyticsDataIndexer.java:1744)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException:
Can't get the locations
at
org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:305)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:131)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:56)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
at
org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:287)
at
org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:267)
at
org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:139)
at
org.apache.hadoop.hbase.client.ClientScanner.init(ClientScanner.java:134)
at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:823)
at
org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:601)
at
org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:365)
at
org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:281)
at
org.wso2.carbon.analytics.datasource.hbase.HBaseAnalyticsRecordStore.tableExists(HBaseAnalyticsRecordStore.java:123)
... 11 more
On Mon, Jul 27, 2015 at 10:54 AM, Gokul Balakrishnan go...@wso2.com
wrote:
Hi Anuruddha,
Are you running HBase on a cluster (i.e. on top of HDFS)? If yes, can
you ensure that you have the following in the analytics-datasource.xml for
the HBase datasource?
property
namefs.hdfs.impl/name
valueorg.apache.hadoop.hdfs.DistributedFileSystem/value
/property
property
namefs.file.impl/name
valueorg.apache.hadoop.fs.LocalFileSystem/value
/property
Thanks,
On 27 July 2015 at 10:43, Anuruddha Liyanarachchi anurudd...@wso2.com
wrote:
Hi DAS team,
I have created DAS receiver and analytics cluster as in the diagram
[1].
In the setup DAS receivers are connected to MySQL (FS_DB) and HBase
(EventStore).
I am getting following errors when I start DAS receivers. What could
be the reason for this error ?
I have attached the carbon log as well.
TID: [-1] [] [2015-07-27 04:37:40,838] WARN
{org.apache.hadoop.hbase.util.DynamicClassLoader} - Failed to identify
the
fs of dir
Re: [Dev] Error while using EJB mediator
Hi Dinusha, Yeah, you could create public JIRA for the improvement also document it. @adding 'Shadsha' as she was struggling to get it connect FYI: Shadsha please communicate with Dinusha to get more details if you still can't connect On Fri, Aug 14, 2015 at 3:00 PM, Dinusha Senanayaka dinu...@wso2.com wrote: Hi Dushan, I was running JBoss with port offset. Reverting back to default port solved the issue. There should be some client property in ESB side to tell the remote connection port of JBoss server. Not sure what it is though. Regards, Dinusha. On Fri, Aug 14, 2015 at 5:45 PM, Dushan Abeyruwan dus...@wso2.com wrote: Hi Dinusha, There has been lot's of class loader issues when comes to EJBMediator connection to JBoss, have shared the artifacts archived [1], we have to have jboss client (osgied) to be placed in ESB, anyway did you check by writing a simple JAVA client to invoke those services ? if with ESB we still getting above mentioned issue, we could try to add following parameter to synapse.properties under bean you have defined synapse.beanstalks.jack.jboss.naming.client.ejb.context=true anyway, shall we first check the java client ? [1] https://drive.google.com/drive/u/0/folders/0BxjKaX2u7UlUZXRaVURnWkxMcHc [2] http://stackoverflow.com/questions/11975396/no-ejb-receiver-available-for-handling On Fri, Aug 14, 2015 at 7:50 AM, Dinusha Senanayaka dinu...@wso2.com wrote: Forgot to send the exception org.apache.synapse.SynapseException: Error while invoking 'getClosestStore' method via reflection. at org.apache.synapse.mediators.bean.BeanUtils.invokeInstanceMethod(BeanUtils.java:79) at org.apache.synapse.mediators.bean.enterprise.EJBMediator.mediate(EJBMediator.java:132) at org.apache.synapse.mediators.AbstractListMediator.mediate(AbstractListMediator.java:77) at org.apache.synapse.mediators.AbstractListMediator.mediate(AbstractListMediator.java:47) at org.apache.synapse.mediators.base.SequenceMediator.mediate(SequenceMediator.java:131) at org.apache.synapse.core.axis2.ProxyServiceMessageReceiver.receive(ProxyServiceMessageReceiver.java:166) at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180) at org.apache.synapse.transport.passthru.ServerWorker.processEntityEnclosingRequest(ServerWorker.java:411) at org.apache.synapse.transport.passthru.ServerWorker.run(ServerWorker.java:183) at org.apache.axis2.transport.base.threads.NativeWorkerPool$1.run(NativeWorkerPool.java:172) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.synapse.mediators.bean.BeanUtils.invokeInstanceMethod(BeanUtils.java:74) ... 12 more Caused by: java.lang.IllegalStateException: No EJB receiver available for handling [appName:,modulename:EJBDemo,distinctname:] combination for invocation context org.jboss.ejb.client.EJBClientInvocationContext@5d5f1834 at org.jboss.ejb.client.EJBClientContext.requireEJBReceiver(EJBClientContext.java:584) at org.jboss.ejb.client.ReceiverInterceptor.handleInvocation(ReceiverInterceptor.java:119) at org.jboss.ejb.client.EJBClientInvocationContext.sendRequest(EJBClientInvocationContext.java:181) at org.jboss.ejb.client.EJBInvocationHandler.doInvoke(EJBInvocationHandler.java:136) at org.jboss.ejb.client.EJBInvocationHandler.doInvoke(EJBInvocationHandler.java:121) at org.jboss.ejb.client.EJBInvocationHandler.invoke(EJBInvocationHandler.java:104) at $Proxy17.getClosestStore(Unknown Source) On Fri, Aug 14, 2015 at 5:14 PM, Dinusha Senanayaka dinu...@wso2.com wrote: Hi, I'm trying EJB sample given in [1], [2]. But getting following exception while invoking the proxy. Found this [3] which is reported earlier, but for me issue comes continuously not intermittent. Also [4] seems to be related. but not sure how to set this property with ESB. Appreciate any help to sort this. [1] http://wso2.com/library/articles/2012/06/ejb-mediator-action-wso2-esb-450/ [2] http://www.dushantech.com/2012/06/syntaxhighlighter.html [3] https://wso2.org/jira/browse/ESBJAVA-1487 [4] http://stackoverflow.com/questions/11975396/no-ejb-receiver-available-for-handling Regards, Dinusha. -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/ -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/ -- Dushan Abeyruwan | Technical Lead
Re: [Dev] 1 test failure in latest C5
Hi Azeez, What branch you are building?.. master or the release-5.0.0-m4 branch? Regards, Aruna On Fri, Aug 14, 2015 at 10:23 PM, Afkham Azeez az...@wso2.com wrote: INFO: [192.168.1.3]:4004 [wso2.wka.domain] [3.5] Address[192.168.1.3]:4004 is SHUTDOWN Tests run: 64, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 36.865 sec FAILURE! Results : Failed tests: testSendMessageToMember(org.wso2.carbon.clustering.MulitcastMembershipSchemeTestCase): Members to send list is empty Tests run: 64, Failures: 1, Errors: 0, Skipped: 0 -- *Afkham Azeez* Director of Architecture; WSO2, Inc.; http://wso2.com Member; Apache Software Foundation; http://www.apache.org/ * http://www.apache.org/* *email: **az...@wso2.com* az...@wso2.com * cell: +94 77 3320919 %2B94%2077%203320919blog: * *http://blog.afkham.org* http://blog.afkham.org *twitter: **http://twitter.com/afkham_azeez* http://twitter.com/afkham_azeez *linked-in: **http://lk.linkedin.com/in/afkhamazeez http://lk.linkedin.com/in/afkhamazeez* *Lean . Enterprise . Middleware* -- *Aruna Sujith Karunarathna *| Software Engineer WSO2, Inc | lean. enterprise. middleware. #20, Palm Grove, Colombo 03, Sri Lanka Mobile: +94 71 9040362 | Work: +94 112145345 Email: ar...@wso2.com | Web: www.wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Error while using EJB mediator
Hi Dushan, I was running JBoss with port offset. Reverting back to default port solved the issue. There should be some client property in ESB side to tell the remote connection port of JBoss server. Not sure what it is though. Regards, Dinusha. On Fri, Aug 14, 2015 at 5:45 PM, Dushan Abeyruwan dus...@wso2.com wrote: Hi Dinusha, There has been lot's of class loader issues when comes to EJBMediator connection to JBoss, have shared the artifacts archived [1], we have to have jboss client (osgied) to be placed in ESB, anyway did you check by writing a simple JAVA client to invoke those services ? if with ESB we still getting above mentioned issue, we could try to add following parameter to synapse.properties under bean you have defined synapse.beanstalks.jack.jboss.naming.client.ejb.context=true anyway, shall we first check the java client ? [1] https://drive.google.com/drive/u/0/folders/0BxjKaX2u7UlUZXRaVURnWkxMcHc [2] http://stackoverflow.com/questions/11975396/no-ejb-receiver-available-for-handling On Fri, Aug 14, 2015 at 7:50 AM, Dinusha Senanayaka dinu...@wso2.com wrote: Forgot to send the exception org.apache.synapse.SynapseException: Error while invoking 'getClosestStore' method via reflection. at org.apache.synapse.mediators.bean.BeanUtils.invokeInstanceMethod(BeanUtils.java:79) at org.apache.synapse.mediators.bean.enterprise.EJBMediator.mediate(EJBMediator.java:132) at org.apache.synapse.mediators.AbstractListMediator.mediate(AbstractListMediator.java:77) at org.apache.synapse.mediators.AbstractListMediator.mediate(AbstractListMediator.java:47) at org.apache.synapse.mediators.base.SequenceMediator.mediate(SequenceMediator.java:131) at org.apache.synapse.core.axis2.ProxyServiceMessageReceiver.receive(ProxyServiceMessageReceiver.java:166) at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180) at org.apache.synapse.transport.passthru.ServerWorker.processEntityEnclosingRequest(ServerWorker.java:411) at org.apache.synapse.transport.passthru.ServerWorker.run(ServerWorker.java:183) at org.apache.axis2.transport.base.threads.NativeWorkerPool$1.run(NativeWorkerPool.java:172) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.synapse.mediators.bean.BeanUtils.invokeInstanceMethod(BeanUtils.java:74) ... 12 more Caused by: java.lang.IllegalStateException: No EJB receiver available for handling [appName:,modulename:EJBDemo,distinctname:] combination for invocation context org.jboss.ejb.client.EJBClientInvocationContext@5d5f1834 at org.jboss.ejb.client.EJBClientContext.requireEJBReceiver(EJBClientContext.java:584) at org.jboss.ejb.client.ReceiverInterceptor.handleInvocation(ReceiverInterceptor.java:119) at org.jboss.ejb.client.EJBClientInvocationContext.sendRequest(EJBClientInvocationContext.java:181) at org.jboss.ejb.client.EJBInvocationHandler.doInvoke(EJBInvocationHandler.java:136) at org.jboss.ejb.client.EJBInvocationHandler.doInvoke(EJBInvocationHandler.java:121) at org.jboss.ejb.client.EJBInvocationHandler.invoke(EJBInvocationHandler.java:104) at $Proxy17.getClosestStore(Unknown Source) On Fri, Aug 14, 2015 at 5:14 PM, Dinusha Senanayaka dinu...@wso2.com wrote: Hi, I'm trying EJB sample given in [1], [2]. But getting following exception while invoking the proxy. Found this [3] which is reported earlier, but for me issue comes continuously not intermittent. Also [4] seems to be related. but not sure how to set this property with ESB. Appreciate any help to sort this. [1] http://wso2.com/library/articles/2012/06/ejb-mediator-action-wso2-esb-450/ [2] http://www.dushantech.com/2012/06/syntaxhighlighter.html [3] https://wso2.org/jira/browse/ESBJAVA-1487 [4] http://stackoverflow.com/questions/11975396/no-ejb-receiver-available-for-handling Regards, Dinusha. -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/ -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/ -- Dushan Abeyruwan | Technical Lead Technical Support-Bloomington US PMC Member Apache Synpase WSO2 Inc. http://wso2.com/ Blog:*http://www.dushantech.com/ http://www.dushantech.com/* Mobile:(001)812-391-7441 -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/
[Dev] WSO2 Carbon Kernel 5.0.0 - Milestone 04 Released!
WSO2 Carbon Kernel 5.0.0 - Milestone 04 Released! We are pleased to inform you the 4th milestone release of Carbon Kernel 5.0.0 is now available to download from here http://maven.wso2.org/nexus/content/repositories/releases/org/wso2/carbon/wso2carbon-kernel/5.0.0-m4/wso2carbon-kernel-5.0.0-m4.zip . Carbon 5 [C5] is the next generation of WSO2 Carbon platform. The existing Carbon platform has served as a modular middleware platform for more than 5 years now. We've built many different products, solutions based on this platform. All the previous major releases of Carbon were sharing the same high level architecture, even though we've changed certain things time to time. Base architecture of the Carbon is modeled using the Apache Axis2's kernel architecture. Apache Axis2 is Web service engine. But it also has introduced a rich extensible server framework with a configuration and runtime model, deployment engine, clustering API and a implementation, etc. We extended this architecture and built a OSGI based modular server development framework called Carbon Kernel. It is tightly coupled with Apache Axis2. But now Apache Axis2 is becoming a dead project. We don't see enough active development on the trunk. Therefore we thought of getting rid of this tight coupling to Apache Axis2. Carbon kernel has gained weight over the time. There are many unwanted modules there. When there are more modules, the rate of patching or the rate of doing patch releases increases. This is why we had to release many patch releases of Carbon kernel in the past. This can become a maintenance nightmare for developers as well as for the users. We need to minimize Carbon kernel releases. The other reason for C5 is to make Carbon kernel a general purpose OSGi runtime, specialized in hosting servers. We will implement the bare minimal features required for server developers in the Carbon kernel. Our primary goal of C5 is to re-architect the Carbon platform from the ground up with the latest technologies and patterns to overcome the existing architectural limitations as well as to get rid of the dependencies to the legacy technologies like Apache Axis2. We need to build a next generation middleware platform that will last for the next 10 years. This milestone release is a step towards building an OSGi based server development framework. It includes following new features. New Features - Transport Management Framework - Java 8 Support Key Features - Pluggable runtimes framework - Clustering module - Context and config model, hierarchical tenancy model (Experimental) - Artifact deployment engine - Centralized logging back-end - Carbon launcher framework Documentation - WSO2 Carbon Kernel 5.0.0 - Documentation https://docs.wso2.org/display/Carbon500/WSO2+Carbon+Documentation Fixed Issues - WSO2 Carbon Kernel 5.0.0 - Fixed Issues https://wso2.org/jira/issues/?filter=12353 How To Contribute You can find more instructions on how to contribute https://docs.wso2.org/display/Carbon500/How+to+Contribute on our documentation site. If you have any suggestions or interested in C5 discussions, please do so via dev@wso2.org or architect...@wso2.org mailing lists . Reporting Issues We encourage you to report issues, documentation faults and feature requests regarding WSO2 C5 through the public issue tracking system https://wso2.org/jira/browse/CARBON. Thanks, WSO2 Carbon Team -- *Aruna Sujith Karunarathna *| Software Engineer WSO2, Inc | lean. enterprise. middleware. #20, Palm Grove, Colombo 03, Sri Lanka Mobile: +94 71 9040362 | Work: +94 112145345 Email: ar...@wso2.com | Web: www.wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] 1 test failure in latest C5
Master On Fri, Aug 14, 2015 at 11:09 PM, Aruna Karunarathna ar...@wso2.com wrote: Hi Azeez, What branch you are building?.. master or the release-5.0.0-m4 branch? Regards, Aruna On Fri, Aug 14, 2015 at 10:23 PM, Afkham Azeez az...@wso2.com wrote: INFO: [192.168.1.3]:4004 [wso2.wka.domain] [3.5] Address[192.168.1.3]:4004 is SHUTDOWN Tests run: 64, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 36.865 sec FAILURE! Results : Failed tests: testSendMessageToMember(org.wso2.carbon.clustering.MulitcastMembershipSchemeTestCase): Members to send list is empty Tests run: 64, Failures: 1, Errors: 0, Skipped: 0 -- *Afkham Azeez* Director of Architecture; WSO2, Inc.; http://wso2.com Member; Apache Software Foundation; http://www.apache.org/ * http://www.apache.org/* *email: **az...@wso2.com* az...@wso2.com * cell: +94 77 3320919 %2B94%2077%203320919blog: * *http://blog.afkham.org* http://blog.afkham.org *twitter: **http://twitter.com/afkham_azeez* http://twitter.com/afkham_azeez *linked-in: **http://lk.linkedin.com/in/afkhamazeez http://lk.linkedin.com/in/afkhamazeez* *Lean . Enterprise . Middleware* -- *Aruna Sujith Karunarathna *| Software Engineer WSO2, Inc | lean. enterprise. middleware. #20, Palm Grove, Colombo 03, Sri Lanka Mobile: +94 71 9040362 | Work: +94 112145345 Email: ar...@wso2.com | Web: www.wso2.com -- *Afkham Azeez* Director of Architecture; WSO2, Inc.; http://wso2.com Member; Apache Software Foundation; http://www.apache.org/ * http://www.apache.org/* *email: **az...@wso2.com* az...@wso2.com * cell: +94 77 3320919blog: **http://blog.afkham.org* http://blog.afkham.org *twitter: **http://twitter.com/afkham_azeez* http://twitter.com/afkham_azeez *linked-in: **http://lk.linkedin.com/in/afkhamazeez http://lk.linkedin.com/in/afkhamazeez* *Lean . Enterprise . Middleware* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] 1 test failure in latest C5
INFO: [192.168.1.3]:4004 [wso2.wka.domain] [3.5] Address[192.168.1.3]:4004 is SHUTDOWN Tests run: 64, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 36.865 sec FAILURE! Results : Failed tests: testSendMessageToMember(org.wso2.carbon.clustering.MulitcastMembershipSchemeTestCase): Members to send list is empty Tests run: 64, Failures: 1, Errors: 0, Skipped: 0 -- *Afkham Azeez* Director of Architecture; WSO2, Inc.; http://wso2.com Member; Apache Software Foundation; http://www.apache.org/ * http://www.apache.org/* *email: **az...@wso2.com* az...@wso2.com * cell: +94 77 3320919blog: **http://blog.afkham.org* http://blog.afkham.org *twitter: **http://twitter.com/afkham_azeez* http://twitter.com/afkham_azeez *linked-in: **http://lk.linkedin.com/in/afkhamazeez http://lk.linkedin.com/in/afkhamazeez* *Lean . Enterprise . Middleware* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Categorical or Numerical column?
Combined solution; * if a feature contains strings - categorical * Frequency of distinct values - if they repeat enough (80% default) and if it doesn't have decimal values, then it is a categorical feature. On Fri, Aug 14, 2015 at 7:22 PM, Supun Sethunga sup...@wso2.com wrote: Hi all, +1 for a hybrid solution. But still a -1 for using skewness even in the hybrid solution :D One good example why we shouldn't use skenwness is the income distribution graph in [1]. There, regardless of whether Im using the raw data (then its a continuous feature) or whether Im breaking them in to intervals and categorized the income in to several levels, I would get the same shape for the distribution. i.e skewness would be significant. So the point Im trying to make is, categorical features as well as a continuous features can be skewed/symmetric, and we cant really distinguish. [1] https://cdn2.vox-cdn.com/uploads/chorus_asset/file/2930990/Distribution_of_Annual_Household_Income_in_the_United_States_2012.0.png On Fri, Aug 14, 2015 at 1:03 AM, Nirmal Fernando nir...@wso2.com wrote: Thanks Thushan. Good suggestion on the frequency. *solutions* 1. Categorical threshold: if # of distinct values are less than X, it is a categorical feature. 2. Make all features with only integers (no decimals) categorical. 3. Skewness: if skewness of a distribution of a feature is less than X, it is a categorical feature. 4. Gaps between consecutive distinct values 5. Frequency of distinct values - if they repeat enough, then it is a categorical feature. 6. Combined solution So, I guess as suggested by many of you, we need to build a combined solution. On Fri, Aug 14, 2015 at 10:29 AM, Thushan Ganegedara thu...@gmail.com wrote: Moreover, I think a hybrid approach as follows might work well. 1. Select a sample 2. Filter columns by the data type and find potential categorical variables (integer / string) 3. Filter further by checking if same values are repeated multiple times in the dataset. On Fri, Aug 14, 2015 at 2:53 PM, Nirmal Fernando nir...@wso2.com wrote: Thanks for all the input. So let me summarise; *the problem* * We need to determine whether a feature is a categorical one or not, to draw certain graphs to explore a dataset, before a user starts to build analyses (before user input). * We can't get a 100% accuracy, hence it is of course a suggestion that we do. * Question is, what would be the most accurate method. *solutions* 1. Categorical threshold: if # of distinct values are less than X, it is a categorical feature. 2. Make all features with only integers (no decimals) categorical. 3. Skewness: if skewness of a distribution of a feature is less than X, it is a categorical feature. 4. Gaps between consecutive distinct values 5. Combined solution On Fri, Aug 14, 2015 at 9:33 AM, Maheshakya Wijewardena mahesha...@wso2.com wrote: Another approach to distinguish between categorical and numerical features can be elaborated as follows: First, we take out the unique values from the column and sort them. If it's a categorical feature, then the gaps between the elements of this sorted list should be equal. In a numerical feature, this is extremely unlikely to happen. This behavior of valid in most scenarios, but there are a few exceptions as well. eg: when a numerical ID is used as the categorical label - 19933, 19913, 18832, ... This is a very simple hack that can be easily implemented, but not a standard technique. WDYT? On Fri, Aug 14, 2015 at 8:55 AM, Srinath Perera srin...@wso2.com wrote: I mean current approach and skewness? On Fri, Aug 14, 2015 at 8:54 AM, Srinath Perera srin...@wso2.com wrote: Can we use a combination of both? On Thu, Aug 13, 2015 at 8:46 PM, Supun Sethunga sup...@wso2.com wrote: When a dataset is large, in general its said to be approximates to a Normal Distribution. :) True it Hypothetical, but the point they make is, when the datasets are large, then properties of a distribution like skewness, variance and etc. become closer to the properties Normal Distribution in most cases.. On Thu, Aug 13, 2015 at 11:07 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Supun, Thanks for the reply. On Thu, Aug 13, 2015 at 8:09 PM, Supun Sethunga sup...@wso2.com wrote: Hi Nirmal, IMO don't think we would be able to use skewness in this case. Skewness says how symmetric the distribution is. For example, if we consider a numerical/continuous feature (not categorical) which is Normally Distributed, then the skewness would be 0. Also for a categorical (encoded) feature having a systematic distribution, then again the skewness would be 0. What's the probability of you see a normal distribution of a real dataset? IMO it's very less and also since what we're doing here is a suggestion, do you see it as an issue? We did have this concern at the beginning as well, regarding how we could
Re: [Dev] [ML] Categorical or Numerical column?
Combined solution; * if a feature contains strings - categorical * Frequency of distinct values - if they repeat enough (80% default) and if it doesn't have decimal values, then it is a categorical feature. +1 On Fri, Aug 14, 2015 at 12:13 PM, Nirmal Fernando nir...@wso2.com wrote: Combined solution; * if a feature contains strings - categorical * Frequency of distinct values - if they repeat enough (80% default) and if it doesn't have decimal values, then it is a categorical feature. On Fri, Aug 14, 2015 at 7:22 PM, Supun Sethunga sup...@wso2.com wrote: Hi all, +1 for a hybrid solution. But still a -1 for using skewness even in the hybrid solution :D One good example why we shouldn't use skenwness is the income distribution graph in [1]. There, regardless of whether Im using the raw data (then its a continuous feature) or whether Im breaking them in to intervals and categorized the income in to several levels, I would get the same shape for the distribution. i.e skewness would be significant. So the point Im trying to make is, categorical features as well as a continuous features can be skewed/symmetric, and we cant really distinguish. [1] https://cdn2.vox-cdn.com/uploads/chorus_asset/file/2930990/Distribution_of_Annual_Household_Income_in_the_United_States_2012.0.png On Fri, Aug 14, 2015 at 1:03 AM, Nirmal Fernando nir...@wso2.com wrote: Thanks Thushan. Good suggestion on the frequency. *solutions* 1. Categorical threshold: if # of distinct values are less than X, it is a categorical feature. 2. Make all features with only integers (no decimals) categorical. 3. Skewness: if skewness of a distribution of a feature is less than X, it is a categorical feature. 4. Gaps between consecutive distinct values 5. Frequency of distinct values - if they repeat enough, then it is a categorical feature. 6. Combined solution So, I guess as suggested by many of you, we need to build a combined solution. On Fri, Aug 14, 2015 at 10:29 AM, Thushan Ganegedara thu...@gmail.com wrote: Moreover, I think a hybrid approach as follows might work well. 1. Select a sample 2. Filter columns by the data type and find potential categorical variables (integer / string) 3. Filter further by checking if same values are repeated multiple times in the dataset. On Fri, Aug 14, 2015 at 2:53 PM, Nirmal Fernando nir...@wso2.com wrote: Thanks for all the input. So let me summarise; *the problem* * We need to determine whether a feature is a categorical one or not, to draw certain graphs to explore a dataset, before a user starts to build analyses (before user input). * We can't get a 100% accuracy, hence it is of course a suggestion that we do. * Question is, what would be the most accurate method. *solutions* 1. Categorical threshold: if # of distinct values are less than X, it is a categorical feature. 2. Make all features with only integers (no decimals) categorical. 3. Skewness: if skewness of a distribution of a feature is less than X, it is a categorical feature. 4. Gaps between consecutive distinct values 5. Combined solution On Fri, Aug 14, 2015 at 9:33 AM, Maheshakya Wijewardena mahesha...@wso2.com wrote: Another approach to distinguish between categorical and numerical features can be elaborated as follows: First, we take out the unique values from the column and sort them. If it's a categorical feature, then the gaps between the elements of this sorted list should be equal. In a numerical feature, this is extremely unlikely to happen. This behavior of valid in most scenarios, but there are a few exceptions as well. eg: when a numerical ID is used as the categorical label - 19933, 19913, 18832, ... This is a very simple hack that can be easily implemented, but not a standard technique. WDYT? On Fri, Aug 14, 2015 at 8:55 AM, Srinath Perera srin...@wso2.com wrote: I mean current approach and skewness? On Fri, Aug 14, 2015 at 8:54 AM, Srinath Perera srin...@wso2.com wrote: Can we use a combination of both? On Thu, Aug 13, 2015 at 8:46 PM, Supun Sethunga sup...@wso2.com wrote: When a dataset is large, in general its said to be approximates to a Normal Distribution. :) True it Hypothetical, but the point they make is, when the datasets are large, then properties of a distribution like skewness, variance and etc. become closer to the properties Normal Distribution in most cases.. On Thu, Aug 13, 2015 at 11:07 AM, Nirmal Fernando nir...@wso2.com wrote: Hi Supun, Thanks for the reply. On Thu, Aug 13, 2015 at 8:09 PM, Supun Sethunga sup...@wso2.com wrote: Hi Nirmal, IMO don't think we would be able to use skewness in this case. Skewness says how symmetric the distribution is. For example, if we consider a numerical/continuous feature (not categorical) which is Normally Distributed, then the skewness would be 0. Also for a categorical (encoded) feature having a systematic distribution,
[Dev] Netty warning on Java 8
[2015-08-15 09:06:43,897] INFO {io.netty.util.internal.PlatformDependent}
- Your platform does not provide complete low-level API for accessing
direct buffers reliably. Unless explicitly requested, heap buffer will
always be preferred to avoid potential system unstability.
Looks like we will lose performance if we switch to Java 8 with Netty.
--
*Afkham Azeez*
Director of Architecture; WSO2, Inc.; http://wso2.com
Member; Apache Software Foundation; http://www.apache.org/
* http://www.apache.org/*
*email: **az...@wso2.com* az...@wso2.com
* cell: +94 77 3320919blog: **http://blog.afkham.org*
http://blog.afkham.org
*twitter: **http://twitter.com/afkham_azeez*
http://twitter.com/afkham_azeez
*linked-in: **http://lk.linkedin.com/in/afkhamazeez
http://lk.linkedin.com/in/afkhamazeez*
*Lean . Enterprise . Middleware*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] What is the best approach to version webapps?
Hi,
We need to version a webapp which contains RESTful APIs.
This webapp will be deployed in WSO2 Api Manager.
Following are 3 approaches I found for the purpose :
1. Make war name as warName${project.artifactId}-${pom.version}/
warName which will output webappName-version.war
Its endpoint address is http://HostName:port/webappName-version/
Ex : https://localhost:9443/api-import-export-1.0.0/
2. Make war name as warName${project.artifactId}#${pom.version}/
warName which will output webappName#version.war
This will allow Tomcat server to identify versions of the web
app.
Its endpoint address is http://HostName:port/webappName/version/
Ex : https://localhost:9443/api-import-export/1.0.0/
https://localhost:9443/api-import-export-1.0.0/
WSO2 Application Server follows this approach [1].
3. Apache tomcat consists of another approach using ## for
context naming [2].
That approach needs to make war name as warName
${project.artifactId}##${pom.version}/warName which will output
webappName##version.war
Its endpoint address is http://HostName:port/webappName/
This will use the latest version.
Ex : https://localhost:9443/api-import-export/
https://localhost:9443/api-import-export-1.0.0/
However this naming convention cannot be deployed in WSO2 Api
Manager. It returns AbstractWebappDeployer Unsupported file path format.
What is the best approach to follow when versioning the webapp ?
[1] https://docs.wso2.com/display/AS521/Webapp+Versioning
[2] http://tomcat.apache.org/tomcat-7.0-doc/config/context.html#Naming
Thanks,
ThiliniC.
--
Best Regards,
*Thilini Cooray*
Software Engineer
Mobile : +94 (0) 774 570 112 %2B94%20%280%29%20773%20451194
E-mail : thili...@wso2.com
WSO2 Inc. www.wso2.com
lean.enterprise.middleware
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] pySpark and nltk
We cannot use phython as the WSO2 ML is a java server. Please send a mail to architecture@ or dev@ On Sat, Aug 15, 2015 at 10:53 AM, Sinnathamby Mahesan sinnatha...@wso2.com wrote: Hi I am wondering how/whether we can use nltk modules with pySpark I installed pySpark and ran to get the prompt (successfully, seems to be working for python core matters) I wish to use nltk modules, it gives me troubles. import nltk seems to be working importing nltk modules causes a segmentation error and pySpark exits Any thoughts would be much appreciated. Thanks Mahesan -- ~~ Sinnathamby Mahesan ~~ ~~ -- Blog: http://srinathsview.blogspot.com twitter:@srinath_perera Site: http://people.apache.org/~hemapani/ Photos: http://www.flickr.com/photos/hemapani/ Phone: 0772360902 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] What is the best approach to version webapps?
Any particular reason for having a war file per version? Much better
approach would be to version the API classes. That way you could get all
traffic without an explicit version on to the latest available REST API.
You need to embed version info into API classes.
https://developer.github.com/v3/ Github api is a good reference to check.
On Sat, Aug 15, 2015 at 10:17 AM, Sanjeewa Malalgoda sanje...@wso2.com
wrote:
+1 for option 02.
On Aug 15, 2015 10:01 AM, Thilini Cooray thili...@wso2.com wrote:
Hi,
We need to version a webapp which contains RESTful APIs.
This webapp will be deployed in WSO2 Api Manager.
Following are 3 approaches I found for the purpose :
1. Make war name as warName${project.artifactId}-${pom.version}/
warName which will output webappName-version.war
Its endpoint address is http://HostName:port
/webappName-version/
Ex : https://localhost:9443/api-import-export-1.0.0/
2. Make war name as warName${project.artifactId}#${pom.version}
/warName which will output webappName#version.war
This will allow Tomcat server to identify versions of the web
app.
Its endpoint address is http://HostName:port/
webappName/version/
Ex : https://localhost:9443/api-import-export/1.0.0/
https://localhost:9443/api-import-export-1.0.0/
WSO2 Application Server follows this approach [1].
3. Apache tomcat consists of another approach using ## for
context naming [2].
That approach needs to make war name as warName
${project.artifactId}##${pom.version}/warName which will output
webappName##version.war
Its endpoint address is http://HostName:port/webappName/
This will use the latest version.
Ex : https://localhost:9443/api-import-export/
https://localhost:9443/api-import-export-1.0.0/
However this naming convention cannot be deployed in WSO2 Api
Manager. It returns AbstractWebappDeployer Unsupported file path format.
What is the best approach to follow when versioning the webapp ?
[1] https://docs.wso2.com/display/AS521/Webapp+Versioning
[2] http://tomcat.apache.org/tomcat-7.0-doc/config/context.html#Naming
Thanks,
ThiliniC.
--
Best Regards,
*Thilini Cooray*
Software Engineer
Mobile : +94 (0) 774 570 112 %2B94%20%280%29%20773%20451194
E-mail : thili...@wso2.com
WSO2 Inc. www.wso2.com
lean.enterprise.middleware
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--
Thanks regards,
Nirmal
Team Lead - WSO2 Machine Learner
Associate Technical Lead - Data Technologies Team, WSO2 Inc.
Mobile: +94715779733
Blog: http://nirmalfdo.blogspot.com/
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Architecture] Carbon Spark JDBC connector
Hi, 1. Adding new spark dialects related for various dbs (WIP) I have added new spark JDBC dialects for following DBs. - mysql - mssql - oracle - postgres - db2 No. Not incremental data processing. My question regarding the deleting entire summery table records and re-insert again. IMO, doing upsert will be more efficient than your above approach. Again, if there is no other option, above re-insert is done as a batch operation or are you insert record one by one? Yes. We had this implementation in Hive JDBC Handler. It is possible to follow the similar approach here, i.e., if upsert queries are supported by the DB(most DBs support merge queries) we can let the user to specify the upsert query to be used in the spark script and if the upsert query is not provided we can check the records exist in the table by using primary key and update or insert the records accordingly. But, IMO, since we support update operations in our data layer(when the CarbonAnalytics is used), we shouldn't worry that much about supporting it in Carbon Spark JDBC connector. On the other hand if that is how Spark supports insert into/overwrite by default, we should follow the same approach. On Thu, Aug 13, 2015 at 8:18 AM, Gihan Anuruddha gi...@wso2.com wrote: Hi Niranda, No. Not incremental data processing. My question regarding the deleting entire summery table records and re-insert again. IMO, doing upsert will be more efficient than your above approach. Again, if there is no other option, above re-insert is done as a batch operation or are you insert record one by one? Regards, Gihan On Wed, Aug 12, 2015 at 11:40 AM, Niranda Perera nira...@wso2.com wrote: Hi Gihan, are we talking about incremental processing here? insert into/overwrite queries will normally be used to push analyzed data into summary tables. in the spark jargon, insert overwrite table means, completely deleting the table and recreating it. I'm a confused with the meaning of 'overwrite' with respect to the previous 2.5.0 Hive scripts, are doing an update there? rgds On Tue, Aug 11, 2015 at 7:58 PM, Gihan Anuruddha gi...@wso2.com wrote: Hi Niranda, Are we going to solve those limitations before the GA? Specially limitation no.2. Over time we can have stat table with thousands of records, so are we going to remove all the records and reinsert every time that spark script runs? Regards, Gihan On Tue, Aug 11, 2015 at 7:13 AM, Niranda Perera nira...@wso2.com wrote: Hi all, we have implemented a custom Spark JDBC connector to be used in the Carbon environment. this enables the following 1. Now, temporary tables can be created in the Spark environment by specifying an analytics datasource (configured by the analytics-datasources.xml) and a table 2. Spark uses SELECT 1 FROM $table LIMIT 1 query to check the existence of a table and the LIMIT query is not provided by all dbs. With the new connector, this query can be provided with as a config. (this config is still WIP) 3. Adding new spark dialects related for various dbs (WIP) the idea is to test this for the following dbs - mysql - h2 - mssql - oracle - postgres - db2 I have loosely tested the connector with MySQL, and I would like the APIM team to use it with the API usage stats use-case, and provide us some feedback. this connector can be accessed as follows. (docs are still not updated. I will do that ASAP) create temporary table temp_table using CarbonJDBC options (dataSource datasource name, tableName table name); select * from temp_table insert into/overwrite table temp_table some select statement known limitations 1. when creating a temp table, it should already be created in the underlying datasource 2. insert overwrite table deletes the existing table and creates it again would be very grateful if you could use this connector in your current JDBC use cases and provide us with feedback. best -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 https://twitter.com/N1R44 https://pythagoreanscript.wordpress.com/ ___ Architecture mailing list architect...@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 https://twitter.com/N1R44 https://pythagoreanscript.wordpress.com/ -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Thanks Regards, Inosh Goonewardena
[Dev] [ESB] JMS Transport Performance Testing
Hi. I have added few extra features to WSO2 ESB JMS transport (sender), and I want to test performance of those as transactions-per-second and compare it with the current performance values. So for that, is there any specific ESB configuration setting and JMeter/SOAPUI setting that I should be using? Or any documentation that I should follow? Thank you! -- *Eranda Rajapakshe* Computer Science and Engineering Undergraduate, University of Moratuwa. Tel : +94784822608 Email : erand...@gmail.com eran...@wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] What is the best approach to version webapps?
+1 for option 02.
On Aug 15, 2015 10:01 AM, Thilini Cooray thili...@wso2.com wrote:
Hi,
We need to version a webapp which contains RESTful APIs.
This webapp will be deployed in WSO2 Api Manager.
Following are 3 approaches I found for the purpose :
1. Make war name as warName${project.artifactId}-${pom.version}/
warName which will output webappName-version.war
Its endpoint address is http://HostName:port
/webappName-version/
Ex : https://localhost:9443/api-import-export-1.0.0/
2. Make war name as warName${project.artifactId}#${pom.version}
/warName which will output webappName#version.war
This will allow Tomcat server to identify versions of the web
app.
Its endpoint address is http://HostName:port/
webappName/version/
Ex : https://localhost:9443/api-import-export/1.0.0/
https://localhost:9443/api-import-export-1.0.0/
WSO2 Application Server follows this approach [1].
3. Apache tomcat consists of another approach using ## for
context naming [2].
That approach needs to make war name as warName
${project.artifactId}##${pom.version}/warName which will output
webappName##version.war
Its endpoint address is http://HostName:port/webappName/
This will use the latest version.
Ex : https://localhost:9443/api-import-export/
https://localhost:9443/api-import-export-1.0.0/
However this naming convention cannot be deployed in WSO2 Api
Manager. It returns AbstractWebappDeployer Unsupported file path format.
What is the best approach to follow when versioning the webapp ?
[1] https://docs.wso2.com/display/AS521/Webapp+Versioning
[2] http://tomcat.apache.org/tomcat-7.0-doc/config/context.html#Naming
Thanks,
ThiliniC.
--
Best Regards,
*Thilini Cooray*
Software Engineer
Mobile : +94 (0) 774 570 112 %2B94%20%280%29%20773%20451194
E-mail : thili...@wso2.com
WSO2 Inc. www.wso2.com
lean.enterprise.middleware
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] WSO2 Committers += Madusanka Premaratne
Hi, It is with great pleasure we welcome Madusanka Premaratne as a WSO2 Committer. @Madusanka, congratulations and keep up the good work! Thanks, NuwanD. -- Nuwan Dias Technical Lead - WSO2, Inc. http://wso2.com email : nuw...@wso2.com Phone : +94 777 775 729 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [CARBON-15265][IDENTITY-3423][MB-1128] is reproducible in kernal 4.4.1
Hi Tharindu,
Please find the attach files which contains stack trace separately.
Cheers!
On Fri, Aug 14, 2015 at 3:55 PM, Tharindu Edirisinghe tharin...@wso2.com
wrote:
Hi Indika,
We are looking to identify the issue. Can you also send us the stack trace
of the two scenarios separately.
Thanks,
TharinduE
On Fri, Aug 14, 2015 at 3:50 PM, Indika Sampath indi...@wso2.com wrote:
Hi Tharindu,
Above deadlock occurred when we remove topic subscription.
DELETE FROM UM_HYBRID_ROLE WHERE UM_ROLE_NAME =
'Q_tmp_192_168_1_21_41372_1' AND UM_TENANT_ID=-1234
We are getting another deadlock when we adding topic subscription also.
INSERT INTO UM_HYBRID_USER_ROLE (UM_USER_NAME, UM_ROLE_ID, UM_TENANT_ID,
UM_DOMAIN_ID) VALUES ('admin',(SELECT UM_ID FROM UM_HYBRID_ROLE WHERE
UM_ROLE_NAME='Q_tmp_192_168_1_21_58252_1' AND UM_TENANT_ID=-1234), -1234,
(SELECT UM_DOMAIN_ID FROM UM_DOMAIN WHERE UM_TENANT_ID=-1234 AND
UM_DOMAIN_NAME='PRIMARY'))
Please find the attached text file which contains output of SHOW ENGINE
INNODB STATUS;
Cheers!
On Fri, Aug 14, 2015 at 3:40 PM, Indika Sampath indi...@wso2.com wrote:
Hi Tharindu,
Please find the attach text file which contains output of above command.
Cheers!
On Fri, Aug 14, 2015 at 1:03 PM, Tharindu Edirisinghe
tharin...@wso2.com wrote:
Hi Ramith,
It seems this is not the exact same issue reported in [1]. For
investigating further can you connect to mysql database from terminal/mysql
client and run the following command and share the output with us. We
should be able to see the database level errors caused from the output of
this command [2].
*SHOW ENGINE INNODB STATUS;*
[1] https://wso2.org/jira/browse/CARBON-15265
[2] https://dev.mysql.com/doc/refman/5.5/en/show-engine.html
Thanks,
TharinduE
On Fri, Aug 14, 2015 at 12:44 PM, Ramith Jayasinghe ram...@wso2.com
wrote:
$subject. Could we have a look?
--
Ramith Jayasinghe
Technical Lead
WSO2 Inc., http://wso2.com
lean.enterprise.middleware
E: ram...@wso2.com
P: +94 777542851
--
Tharindu Edirisinghe
Software Engineer | WSO2 Inc
Identity Server Team
Blog : tharindue.blogspot.com
mobile : +94 775 181586
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--
Indika Sampath
Senior Software Engineer
WSO2 Inc.
http://wso2.com
Phone: +94 716 424 744
Blog: http://indikasampath.blogspot.com/
--
Indika Sampath
Senior Software Engineer
WSO2 Inc.
http://wso2.com
Phone: +94 716 424 744
Blog: http://indikasampath.blogspot.com/
--
Tharindu Edirisinghe
Software Engineer | WSO2 Inc
Identity Server Team
Blog : tharindue.blogspot.com
mobile : +94 775 181586
--
Indika Sampath
Senior Software Engineer
WSO2 Inc.
http://wso2.com
Phone: +94 716 424 744
Blog: http://indikasampath.blogspot.com/
add_subscription_stack_trace
Description: Binary data
remove_subscription_stack_trace
Description: Binary data
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Review and Merge PR
Hi Malaka, Find the pull request for Flicker below.. which is changed according to the test failure. https://github.com/wso2/esb-connectors/pull/268 Thanks. -- Regards S.Sriashalya, WSO2 *Inc*. lean . enterprise . middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] DAS dashboard table-gadget column order
Columns you define in the schema, does not map to RDBMS physical tables' columns. Are you saying that the gadget tables that you create, do not have the column order as it is in the schema? Is it in the same order in the Data explorer? On 8/14/15, Thanuja Uruththirakodeeswaran thanu...@wso2.com wrote: Hi Gimantha, I used external HBase DB and DAS embedded H2 DB. I checked with HBase table and table-gadget column order same as HBase table. I tried with H2 table, but I couldn't see column names as I think it was encrypted or something. How can I check the column names in DAS embedded H2 database? Thanks. On Fri, Aug 14, 2015 at 1:28 PM, Gimantha Bandara giman...@wso2.com wrote: Hi Thanuja, Is it same with the H2 table or only the HBase analytics table? On Thu, Aug 13, 2015 at 6:50 PM, Thanuja Uruththirakodeeswaran thanu...@wso2.com wrote: Hi, I've persisted a event stream in event store which is a HBase database. Then using the following query I created table in spark environment. Also I used H2 database as processed store. CREATE TEMPORARY TABLE memberinfo USING CarbonAnalytics OPTIONS (tableName MEMBER_INFO); CREATE TEMPORARY TABLE memberdetails USING CarbonAnalytics OPTIONS (tableName MEMBER_DETAILS, schema X STRING, Y STRING, Z STRING); INSERT OVERWRITE TABLE memberdetails select * from memberinfo; Here MEMBER_INFO - HBase database table, MEMBER_DETAILS - H2 database table When I use the Data Explorer to see records in table MEMBER_DETAILS, column order as specified in schema. But when I created a table gadget using the same table and added to dashboard, column order is not as in schema. But I think columns are in the order as in HBase database table. What I have to do to get the columns as in schema order? Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gimantha Bandara Software Engineer WSO2. Inc : http://wso2.com Mobile : +94714961919 -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 -- Gimantha Bandara Software Engineer WSO2. Inc : http://wso2.com Mobile : +94714961919 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Error while using EJB mediator
Hi Dinusha, There has been lot's of class loader issues when comes to EJBMediator connection to JBoss, have shared the artifacts archived [1], we have to have jboss client (osgied) to be placed in ESB, anyway did you check by writing a simple JAVA client to invoke those services ? if with ESB we still getting above mentioned issue, we could try to add following parameter to synapse.properties under bean you have defined synapse.beanstalks.jack.jboss.naming.client.ejb.context=true anyway, shall we first check the java client ? [1] https://drive.google.com/drive/u/0/folders/0BxjKaX2u7UlUZXRaVURnWkxMcHc [2] http://stackoverflow.com/questions/11975396/no-ejb-receiver-available-for-handling On Fri, Aug 14, 2015 at 7:50 AM, Dinusha Senanayaka dinu...@wso2.com wrote: Forgot to send the exception org.apache.synapse.SynapseException: Error while invoking 'getClosestStore' method via reflection. at org.apache.synapse.mediators.bean.BeanUtils.invokeInstanceMethod(BeanUtils.java:79) at org.apache.synapse.mediators.bean.enterprise.EJBMediator.mediate(EJBMediator.java:132) at org.apache.synapse.mediators.AbstractListMediator.mediate(AbstractListMediator.java:77) at org.apache.synapse.mediators.AbstractListMediator.mediate(AbstractListMediator.java:47) at org.apache.synapse.mediators.base.SequenceMediator.mediate(SequenceMediator.java:131) at org.apache.synapse.core.axis2.ProxyServiceMessageReceiver.receive(ProxyServiceMessageReceiver.java:166) at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180) at org.apache.synapse.transport.passthru.ServerWorker.processEntityEnclosingRequest(ServerWorker.java:411) at org.apache.synapse.transport.passthru.ServerWorker.run(ServerWorker.java:183) at org.apache.axis2.transport.base.threads.NativeWorkerPool$1.run(NativeWorkerPool.java:172) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.synapse.mediators.bean.BeanUtils.invokeInstanceMethod(BeanUtils.java:74) ... 12 more Caused by: java.lang.IllegalStateException: No EJB receiver available for handling [appName:,modulename:EJBDemo,distinctname:] combination for invocation context org.jboss.ejb.client.EJBClientInvocationContext@5d5f1834 at org.jboss.ejb.client.EJBClientContext.requireEJBReceiver(EJBClientContext.java:584) at org.jboss.ejb.client.ReceiverInterceptor.handleInvocation(ReceiverInterceptor.java:119) at org.jboss.ejb.client.EJBClientInvocationContext.sendRequest(EJBClientInvocationContext.java:181) at org.jboss.ejb.client.EJBInvocationHandler.doInvoke(EJBInvocationHandler.java:136) at org.jboss.ejb.client.EJBInvocationHandler.doInvoke(EJBInvocationHandler.java:121) at org.jboss.ejb.client.EJBInvocationHandler.invoke(EJBInvocationHandler.java:104) at $Proxy17.getClosestStore(Unknown Source) On Fri, Aug 14, 2015 at 5:14 PM, Dinusha Senanayaka dinu...@wso2.com wrote: Hi, I'm trying EJB sample given in [1], [2]. But getting following exception while invoking the proxy. Found this [3] which is reported earlier, but for me issue comes continuously not intermittent. Also [4] seems to be related. but not sure how to set this property with ESB. Appreciate any help to sort this. [1] http://wso2.com/library/articles/2012/06/ejb-mediator-action-wso2-esb-450/ [2] http://www.dushantech.com/2012/06/syntaxhighlighter.html [3] https://wso2.org/jira/browse/ESBJAVA-1487 [4] http://stackoverflow.com/questions/11975396/no-ejb-receiver-available-for-handling Regards, Dinusha. -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/ -- Dinusha Dilrukshi Associate Technical Lead WSO2 Inc.: http://wso2.com/ Mobile: +94725255071 Blog: http://dinushasblog.blogspot.com/ -- Dushan Abeyruwan | Technical Lead Technical Support-Bloomington US PMC Member Apache Synpase WSO2 Inc. http://wso2.com/ Blog:*http://www.dushantech.com/ http://www.dushantech.com/* Mobile:(001)812-391-7441 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] DAS dashboard table-gadget column order
Hi Gimantha, I used external HBase DB and DAS embedded H2 DB. I checked with HBase table and table-gadget column order same as HBase table. I tried with H2 table, but I couldn't see column names as I think it was encrypted or something. How can I check the column names in DAS embedded H2 database? Thanks. On Fri, Aug 14, 2015 at 1:28 PM, Gimantha Bandara giman...@wso2.com wrote: Hi Thanuja, Is it same with the H2 table or only the HBase analytics table? On Thu, Aug 13, 2015 at 6:50 PM, Thanuja Uruththirakodeeswaran thanu...@wso2.com wrote: Hi, I've persisted a event stream in event store which is a HBase database. Then using the following query I created table in spark environment. Also I used H2 database as processed store. CREATE TEMPORARY TABLE memberinfo USING CarbonAnalytics OPTIONS (tableName MEMBER_INFO); CREATE TEMPORARY TABLE memberdetails USING CarbonAnalytics OPTIONS (tableName MEMBER_DETAILS, schema X STRING, Y STRING, Z STRING); INSERT OVERWRITE TABLE memberdetails select * from memberinfo; Here MEMBER_INFO - HBase database table, MEMBER_DETAILS - H2 database table When I use the Data Explorer to see records in table MEMBER_DETAILS, column order as specified in schema. But when I created a table gadget using the same table and added to dashboard, column order is not as in schema. But I think columns are in the order as in HBase database table. What I have to do to get the columns as in schema order? Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gimantha Bandara Software Engineer WSO2. Inc : http://wso2.com Mobile : +94714961919 -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [AppM] Component versions used on V1.1.0 component release
Hi All, We are releasing AppManager v.1.1.0 (component release) based on Carbon 4.4.1 with following depending component versions. The AppM components will be packed into EMM next release. Please provide your feedback/objections. Next release of AppM product will most likely use these versions too. 1. Carbon-Identity 4.5.4 : This is released, However It will not be the one packed with next IS release. Subsequent Identity server fixes may not be available for components 4.5.4. 2. Carbon-Mediation 4.4.3 : This is released, However it will not be the one packed with next ESB release. Subsequent ESB fixes may not be available for 4.4.3, but only on 4.4.4. 3. synapse-core_2.1.3.wso2v6 . This may not be maintained by ESB team after their ESB 4.9.0 release. Subsequent synapse fixes may not be available on 2.1.3.wso2v6. Cheers, Ruwan -- *Ruwan Abeykoon* *Architect,* *WSO2, Inc. http://wso2.com http://wso2.com/ * *lean.enterprise.middleware.* email: ruw...@wso2.com phone:(+94) 39736 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [CARBON-15265][IDENTITY-3423][MB-1128] is reproducible in kernal 4.4.1
Hi Tharindu,
Above deadlock occurred when we remove topic subscription.
DELETE FROM UM_HYBRID_ROLE WHERE UM_ROLE_NAME =
'Q_tmp_192_168_1_21_41372_1' AND UM_TENANT_ID=-1234
We are getting another deadlock when we adding topic subscription also.
INSERT INTO UM_HYBRID_USER_ROLE (UM_USER_NAME, UM_ROLE_ID, UM_TENANT_ID,
UM_DOMAIN_ID) VALUES ('admin',(SELECT UM_ID FROM UM_HYBRID_ROLE WHERE
UM_ROLE_NAME='Q_tmp_192_168_1_21_58252_1' AND UM_TENANT_ID=-1234), -1234,
(SELECT UM_DOMAIN_ID FROM UM_DOMAIN WHERE UM_TENANT_ID=-1234 AND
UM_DOMAIN_NAME='PRIMARY'))
Please find the attached text file which contains output of SHOW ENGINE
INNODB STATUS;
Cheers!
On Fri, Aug 14, 2015 at 3:40 PM, Indika Sampath indi...@wso2.com wrote:
Hi Tharindu,
Please find the attach text file which contains output of above command.
Cheers!
On Fri, Aug 14, 2015 at 1:03 PM, Tharindu Edirisinghe tharin...@wso2.com
wrote:
Hi Ramith,
It seems this is not the exact same issue reported in [1]. For
investigating further can you connect to mysql database from terminal/mysql
client and run the following command and share the output with us. We
should be able to see the database level errors caused from the output of
this command [2].
*SHOW ENGINE INNODB STATUS;*
[1] https://wso2.org/jira/browse/CARBON-15265
[2] https://dev.mysql.com/doc/refman/5.5/en/show-engine.html
Thanks,
TharinduE
On Fri, Aug 14, 2015 at 12:44 PM, Ramith Jayasinghe ram...@wso2.com
wrote:
$subject. Could we have a look?
--
Ramith Jayasinghe
Technical Lead
WSO2 Inc., http://wso2.com
lean.enterprise.middleware
E: ram...@wso2.com
P: +94 777542851
--
Tharindu Edirisinghe
Software Engineer | WSO2 Inc
Identity Server Team
Blog : tharindue.blogspot.com
mobile : +94 775 181586
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--
Indika Sampath
Senior Software Engineer
WSO2 Inc.
http://wso2.com
Phone: +94 716 424 744
Blog: http://indikasampath.blogspot.com/
--
Indika Sampath
Senior Software Engineer
WSO2 Inc.
http://wso2.com
Phone: +94 716 424 744
Blog: http://indikasampath.blogspot.com/
=
150814 15:45:59 INNODB MONITOR OUTPUT
=
Per second averages calculated from the last 1 seconds
-
BACKGROUND THREAD
-
srv_master_thread loops: 1669 1_second, 1669 sleeps, 156 10_second, 238
background, 238 flush
srv_master_thread log flush and writes: 2757
--
SEMAPHORES
--
OS WAIT ARRAY INFO: reservation count 1095210, signal count 634234
Mutex spin waits 6843782, rounds 34981966, OS waits 893336
RW-shared spins 594791, rounds 10468841, OS waits 156859
RW-excl spins 214480, rounds 2478214, OS waits 35428
Spin rounds per wait: 5.11 mutex, 17.60 RW-shared, 11.55 RW-excl
LATEST DETECTED DEADLOCK
150814 15:45:27
*** (1) TRANSACTION:
TRANSACTION 1FC44D6, ACTIVE 0 sec fetching rows
mysql tables in use 3, locked 3
LOCK WAIT 4 lock struct(s), heap size 1248, 2 row lock(s), undo log entries 1
MySQL thread id 285, OS thread handle 0x1664, query id 19128689 192.168.1.22
root Sending data
INSERT INTO UM_HYBRID_USER_ROLE (UM_USER_NAME, UM_ROLE_ID, UM_TENANT_ID,
UM_DOMAIN_ID) VALUES ('admin',(SELECT UM_ID FROM UM_HYBRID_ROLE WHERE
UM_ROLE_NAME='Q_tmp_192_168_1_21_58252_1' AND UM_TENANT_ID=-1234), -1234,
(SELECT UM_DOMAIN_ID FROM UM_DOMAIN WHERE UM_TENANT_ID=-1234 AND
UM_DOMAIN_NAME='PRIMARY'))
*** (1) WAITING FOR THIS LOCK TO BE GRANTED:
RECORD LOCKS space id 113 page no 3 n bits 168 index `PRIMARY` of table
`carbondb`.`um_hybrid_role` trx id 1FC44D6 lock mode S locks rec but not gap
waiting
Record lock, heap no 94 PHYSICAL RECORD: n_fields 5; compact format; info bits 0
0: len 4; hex 8107; asc ;;
1: len 4; hex 7b2e; asc.;;
2: len 6; hex 01fc44d4; asc D ;;
3: len 7; hex de0005c0030110; asc;;
4: len 26; hex 515f746d705f3139325f3136385f315f32315f34313532385f31; asc
Q_tmp_192_168_1_21_41528_1;;
*** (2) TRANSACTION:
TRANSACTION 1FC44D4, ACTIVE 0 sec fetching rows, thread declared inside InnoDB
407
mysql tables in use 3, locked 3
4 lock struct(s), heap size 1248, 2 row lock(s), undo log entries 1
MySQL thread id 260, OS thread handle 0x168c, query id 19128690 192.168.1.20
root Sending data
INSERT INTO UM_HYBRID_USER_ROLE (UM_USER_NAME, UM_ROLE_ID, UM_TENANT_ID,
UM_DOMAIN_ID) VALUES ('admin',(SELECT UM_ID FROM UM_HYBRID_ROLE WHERE
UM_ROLE_NAME='Q_tmp_192_168_1_21_41528_1' AND UM_TENANT_ID=-1234), -1234,
(SELECT UM_DOMAIN_ID FROM UM_DOMAIN WHERE UM_TENANT_ID=-1234 AND
UM_DOMAIN_NAME='PRIMARY'))
*** (2) HOLDS THE LOCK(S):
RECORD LOCKS space id 113 page no 3 n bits 168 index `PRIMARY` of table
`carbondb`.`um_hybrid_role` trx id 1FC44D4 lock_mode X locks rec but not gap
Record lock, heap no 94 PHYSICAL RECORD: n_fields 5; compact format; info bits 0
0: len
Re: [Dev] [CARBON-15265][IDENTITY-3423][MB-1128] is reproducible in kernal 4.4.1
Hi Indika,
We are looking to identify the issue. Can you also send us the stack trace
of the two scenarios separately.
Thanks,
TharinduE
On Fri, Aug 14, 2015 at 3:50 PM, Indika Sampath indi...@wso2.com wrote:
Hi Tharindu,
Above deadlock occurred when we remove topic subscription.
DELETE FROM UM_HYBRID_ROLE WHERE UM_ROLE_NAME =
'Q_tmp_192_168_1_21_41372_1' AND UM_TENANT_ID=-1234
We are getting another deadlock when we adding topic subscription also.
INSERT INTO UM_HYBRID_USER_ROLE (UM_USER_NAME, UM_ROLE_ID, UM_TENANT_ID,
UM_DOMAIN_ID) VALUES ('admin',(SELECT UM_ID FROM UM_HYBRID_ROLE WHERE
UM_ROLE_NAME='Q_tmp_192_168_1_21_58252_1' AND UM_TENANT_ID=-1234), -1234,
(SELECT UM_DOMAIN_ID FROM UM_DOMAIN WHERE UM_TENANT_ID=-1234 AND
UM_DOMAIN_NAME='PRIMARY'))
Please find the attached text file which contains output of SHOW ENGINE
INNODB STATUS;
Cheers!
On Fri, Aug 14, 2015 at 3:40 PM, Indika Sampath indi...@wso2.com wrote:
Hi Tharindu,
Please find the attach text file which contains output of above command.
Cheers!
On Fri, Aug 14, 2015 at 1:03 PM, Tharindu Edirisinghe tharin...@wso2.com
wrote:
Hi Ramith,
It seems this is not the exact same issue reported in [1]. For
investigating further can you connect to mysql database from terminal/mysql
client and run the following command and share the output with us. We
should be able to see the database level errors caused from the output of
this command [2].
*SHOW ENGINE INNODB STATUS;*
[1] https://wso2.org/jira/browse/CARBON-15265
[2] https://dev.mysql.com/doc/refman/5.5/en/show-engine.html
Thanks,
TharinduE
On Fri, Aug 14, 2015 at 12:44 PM, Ramith Jayasinghe ram...@wso2.com
wrote:
$subject. Could we have a look?
--
Ramith Jayasinghe
Technical Lead
WSO2 Inc., http://wso2.com
lean.enterprise.middleware
E: ram...@wso2.com
P: +94 777542851
--
Tharindu Edirisinghe
Software Engineer | WSO2 Inc
Identity Server Team
Blog : tharindue.blogspot.com
mobile : +94 775 181586
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--
Indika Sampath
Senior Software Engineer
WSO2 Inc.
http://wso2.com
Phone: +94 716 424 744
Blog: http://indikasampath.blogspot.com/
--
Indika Sampath
Senior Software Engineer
WSO2 Inc.
http://wso2.com
Phone: +94 716 424 744
Blog: http://indikasampath.blogspot.com/
--
Tharindu Edirisinghe
Software Engineer | WSO2 Inc
Identity Server Team
Blog : tharindue.blogspot.com
mobile : +94 775 181586
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Caramel] Adding more custom Handlebars helpers to Caramel
Hi All,
Please find my comments inline.
*-1 ifCond and selectIf*
I agree with your view. Since Mustache and Handlebars follow the
logic-less template approach, Caramel should also follow it.
However there are some circumstances where you have to put some logic in
the template. For example, in [1] we have used selectIf helper to determine
the proper CSS class for some action buttons. Before introducing selectIf
helper, these CSS classes were hard-coded in this [2] .js file (which is in
the server-side). Hard-coding CSS classes is acceptable in HTML templates
and client-side JavaScripts, but not for other server-side .js or .jsg
files. That's why we introduced the selectIf helper.
+1 for the effort you have put to make it nice and well documented. If the
vision is to have *logic-less* templating we may need to follow it. If
you prevent logic in templates by design (like handlebars and mustache
does), you will be obliged to put the logic elsewhere, so your templates
will end up uncluttered [3].
For the specific use-case you have mentioned in [1]; I believe hard-coding
on view model[2] is a correct approach. Then you have control over all
templates that presenting the specific view model. Let me further explain
this. Suppose you need to change css class appearing for Submit for
Review phase in all templates including [1]. Since you
have implemented this logic at the template level you need to change all
the templates.
*+1 for for*
The {{index}} expression has been introduced to the {{#each}} block helper
in Handlebars 3.0.3 version. However startIndex, endIndex and jump optional
parameters of the proposed for helper can be helpful. For example,
displaying only certain number of items based on a user input (see below
image). So, adding for helper will be helpful.
+1. This is awesome. Until you upgrade into handlebars v3.0.3 this is
really beneficial. Even in {{#each}}, I don't think you have features such
as startIndex, endIndex and jump optional parameters.
[1]
https://github.com/sajithar/carbon-appmgt/blob/047b7831886f50f6e656ca9d56739d08003c7240/features/appmgt/org.wso2.carbon.appmgt.publisher.feature/src/main/resources/publisher/themes/mobileapp/partials/list-assets-row.hbs#L50
[2]
https://github.com/sajithar/carbon-appmgt/blob/2d362df789eadc1b67e0edf41209380aa82bf7c1/features/appmgt/org.wso2.carbon.appmgt.publisher.feature/src/main/resources/publisher/themes/mobileapp/renderers/controllers/assets_router.js#L39
[3] http://stackoverflow.com/a/4946409/1560536
On Thu, Aug 13, 2015 at 11:04 AM, Sajith Ariyarathna sajit...@wso2.com
wrote:
Hi Manu,
Please find my comments inline.
-1 *ifCond* and *selectIf*
I agree with your view. Since Mustache and Handlebars follow the *logic-less
template* approach, Caramel should also follow it.
However there are some circumstances where you have to put some logic in
the template. For example, in [1] we have used selectIf helper to
determine the proper CSS class for some action buttons. Before introducing
selectIf helper, these CSS classes were hard-coded in this [2] .js file
(which is in the server-side). Hard-coding CSS classes is acceptable in
HTML templates and client-side JavaScripts, but not for other server-side
.js or .jsg files. That's why we introduced the selectIf helper.
+1 for *for*
The {{index}} expression has been introduced to the {{#each}} block
helper in Handlebars 3.0.3 version. However startIndex, endIndex and jump
optional
parameters of the proposed for helper can be helpful. For example,
displaying only certain number of items based on a user input (see below
image). So, adding for helper will be helpful.
[image: Inline image 1]
[1]
https://github.com/sajithar/carbon-appmgt/blob/047b7831886f50f6e656ca9d56739d08003c7240/features/appmgt/org.wso2.carbon.appmgt.publisher.feature/src/main/resources/publisher/themes/mobileapp/partials/list-assets-row.hbs#L50
[2]
https://github.com/sajithar/carbon-appmgt/blob/2d362df789eadc1b67e0edf41209380aa82bf7c1/features/appmgt/org.wso2.carbon.appmgt.publisher.feature/src/main/resources/publisher/themes/mobileapp/renderers/controllers/assets_router.js#L39
Thanks.
On Wed, Aug 12, 2015 at 6:40 PM, Manuranga Perera m...@wso2.com wrote:
-1 *ifCond* and *selectIf*
the reason we have separate *logic-less* temperating is to remove logic
out of ui representation. this helper defeats whole purpose of having
handlebars.
different people have different opinions on this, see the discussion on
https://github.com/wycats/handlebars.js/issues/616 . I personally don't
like putting it in templates.
It is better to do the necessary logic in the js/jag file and use the
built in Helpers. is there any reason to not to do it this way?
+1 for *for*
but think it's there in new version anyway. is this one any different? if
not we should just update to new Handlebars instead.
On Wed, Aug 12, 2015 at 3:28 PM, Sajith Ariyarathna sajit...@wso2.com
wrote:
Hi All,
For
Re: [Dev] [CARBON-15265][IDENTITY-3423][MB-1128] is reproducible in kernal 4.4.1
Hi Tharindu, Please find the attach text file which contains output of above command. Cheers! On Fri, Aug 14, 2015 at 1:03 PM, Tharindu Edirisinghe tharin...@wso2.com wrote: Hi Ramith, It seems this is not the exact same issue reported in [1]. For investigating further can you connect to mysql database from terminal/mysql client and run the following command and share the output with us. We should be able to see the database level errors caused from the output of this command [2]. *SHOW ENGINE INNODB STATUS;* [1] https://wso2.org/jira/browse/CARBON-15265 [2] https://dev.mysql.com/doc/refman/5.5/en/show-engine.html Thanks, TharinduE On Fri, Aug 14, 2015 at 12:44 PM, Ramith Jayasinghe ram...@wso2.com wrote: $subject. Could we have a look? -- Ramith Jayasinghe Technical Lead WSO2 Inc., http://wso2.com lean.enterprise.middleware E: ram...@wso2.com P: +94 777542851 -- Tharindu Edirisinghe Software Engineer | WSO2 Inc Identity Server Team Blog : tharindue.blogspot.com mobile : +94 775 181586 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Indika Sampath Senior Software Engineer WSO2 Inc. http://wso2.com Phone: +94 716 424 744 Blog: http://indikasampath.blogspot.com/ = 150814 15:36:05 INNODB MONITOR OUTPUT = Per second averages calculated from the last 8 seconds - BACKGROUND THREAD - srv_master_thread loops: 1596 1_second, 1596 sleeps, 149 10_second, 230 background, 230 flush srv_master_thread log flush and writes: 2684 -- SEMAPHORES -- OS WAIT ARRAY INFO: reservation count 1095161, signal count 634173 Mutex spin waits 6839180, rounds 34975078, OS waits 893318 RW-shared spins 594744, rounds 10468101, OS waits 156838 RW-excl spins 214442, rounds 2477679, OS waits 35423 Spin rounds per wait: 5.11 mutex, 17.60 RW-shared, 11.55 RW-excl LATEST DETECTED DEADLOCK 150814 15:05:40 *** (1) TRANSACTION: TRANSACTION 1FC34F9, ACTIVE 0 sec fetching rows mysql tables in use 1, locked 1 LOCK WAIT 10 lock struct(s), heap size 1248, 7 row lock(s), undo log entries 2 MySQL thread id 234, OS thread handle 0x9f4, query id 19097990 192.168.1.20 root updating DELETE FROM UM_HYBRID_ROLE WHERE UM_ROLE_NAME = 'Q_tmp_192_168_1_21_41372_1' AND UM_TENANT_ID=-1234 *** (1) WAITING FOR THIS LOCK TO BE GRANTED: RECORD LOCKS space id 113 page no 3 n bits 136 index `PRIMARY` of table `carbondb`.`um_hybrid_role` trx id 1FC34F9 lock_mode X locks rec but not gap waiting Record lock, heap no 47 PHYSICAL RECORD: n_fields 5; compact format; info bits 0 0: len 4; hex 8066; ascf;; 1: len 4; hex 7b2e; asc.;; 2: len 6; hex 01fc3174; asc 1t;; 3: len 7; hex a50e810110; asc;; 4: len 26; hex 515f746d705f3139325f3136385f315f32315f34313338325f31; asc Q_tmp_192_168_1_21_41382_1;; *** (2) TRANSACTION: TRANSACTION 1FC34FA, ACTIVE 0 sec fetching rows, thread declared inside InnoDB 484 mysql tables in use 1, locked 1 8 lock struct(s), heap size 1248, 4 row lock(s), undo log entries 1 MySQL thread id 205, OS thread handle 0x170c, query id 19097991 192.168.1.20 root updating DELETE FROM UM_HYBRID_ROLE WHERE UM_ROLE_NAME = 'Q_tmp_192_168_1_21_41382_1' AND UM_TENANT_ID=-1234 *** (2) HOLDS THE LOCK(S): RECORD LOCKS space id 113 page no 3 n bits 136 index `PRIMARY` of table `carbondb`.`um_hybrid_role` trx id 1FC34FA lock mode S locks rec but not gap Record lock, heap no 47 PHYSICAL RECORD: n_fields 5; compact format; info bits 0 0: len 4; hex 8066; ascf;; 1: len 4; hex 7b2e; asc.;; 2: len 6; hex 01fc3174; asc 1t;; 3: len 7; hex a50e810110; asc;; 4: len 26; hex 515f746d705f3139325f3136385f315f32315f34313338325f31; asc Q_tmp_192_168_1_21_41382_1;; *** (2) WAITING FOR THIS LOCK TO BE GRANTED: RECORD LOCKS space id 113 page no 3 n bits 136 index `PRIMARY` of table `carbondb`.`um_hybrid_role` trx id 1FC34FA lock_mode X locks rec but not gap waiting Record lock, heap no 34 PHYSICAL RECORD: n_fields 5; compact format; info bits 32 0: len 4; hex 805b; asc[;; 1: len 4; hex 7b2e; asc.;; 2: len 6; hex 01fc34f9; asc 4 ;; 3: len 7; hex 7d001c40080351; asc } @ Q;; 4: len 26; hex 515f746d705f3139325f3136385f315f32315f34313337325f31; asc Q_tmp_192_168_1_21_41372_1;; *** WE ROLL BACK TRANSACTION (2) TRANSACTIONS Trx id counter 1FC3744 Purge done for trx's n:o 1FC3739 undo n:o 0 History list length 768 LIST OF TRANSACTIONS FOR EACH SESSION: ---TRANSACTION 0, not started MySQL thread id 244, OS thread handle 0x12f0, query id 19102478 192.168.1.52 root checking query cache for query /* ApplicationName=DBeaver Enterprise 3.4.2 - Main */ SHOW ENGINE INNODB STATUS ---TRANSACTION 1FC34B3, not started MySQL thread id 240, OS thread handle
