[Dev] [ML] Issue while loading the leaf dataset (misreading classes)
Hi, I found the potential cause of the poor accuracy for the leaf dataset. It seems the data read into ML is wrong. I have attached the data file as a CSV (classes are in the last column) However, when I print out the labels of the read data (classes), it looks something like below. Clearly there aren't this many 3.0 classes and there should be classes up to 36.0. Is this caused by a bug? 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 12.012.012.012.012.012.0 12.012.012.012.013.013.013.013.013.013.0 13.013.013.013.014.014.014.014.014.0 14.014.014.015.015.015.015.015.015.0 15.015.015.015.015.015.016.016.016.016.0 16.016.016.016.017.017.017.017.017.0 17.017.017.017.017.018.018.018.018.0 18.018.018.018.018.018.018.019.019.019.0 19.019.019.019.019.019.019.019.019.0 19.019.02.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia 0.72694,1.4742,0.32396,0.98535,1,0.83592,0.0046566,0.0039465,0.04779,0.12795,0.016108,0.0052323,0.00027477,1.1756,1 0.74173,1.5257,0.36116,0.98152,0.99825,0.79867,0.0052423,0.0050016,0.02416,0.090476,0.0081195,0.002708,7.48E-05,0.69659,1 0.76722,1.5725,0.38998,0.97755,1,0.80812,0.0074573,0.010121,0.011897,0.057445,0.0032891,0.00092068,3.79E-05,0.44348,1 0.73797,1.4597,0.35376,0.97566,1,0.81697,0.0068768,0.0086068,0.01595,0.065491,0.0042707,0.0011544,6.63E-05,0.58785,1 0.82301,1.7707,0.44462,0.97698,1,0.75493,0.007428,0.010042,0.0079379,0.045339,0.0020514,0.00055986,2.35E-05,0.34214,1 0.72997,1.4892,0.34284,0.98755,1,0.84482,0.0049451,0.0044506,0.010487,0.058528,0.0034138,0.0011248,2.48E-05,0.34068,1 0.82063,1.7529,0.44458,0.97964,0.99649,0.7677,0.0059279,0.0063954,0.018375,0.080587,0.0064523,0.0022713,4.15E-05,0.53904,1 0.77982,1.6215,0.39222,0.98512,0.99825,0.80816,0.0050987,0.0047314,0.024875,0.089686,0.0079794,0.0024664,0.00014676,0.66975,1 0.83089,1.8199,0.45693,0.9824,1,0.77106,0.0060055,0.006564,0.0072447,0.040616,0.0016469,0.00038812,3.29E-05,0.33696,1 0.90631,2.3906,0.58336,0.97683,0.99825,0.66419,0.0084019,0.012848,0.0070096,0.042347,0.0017901,0.00045889,2.83E-05,0.28082,1 0.7459,1.4927,0.34116,0.98296,1,0.83088,0.0055665,0.0056395,0.0057679,0.036511,0.0013313,0.00030872,3.18E-05,0.25026,1 0.79606,1.6934,0.43387,0.98181,1,0.76985,0.0077992,0.011071,0.013677,0.057832,0.004,0.00081648,0.00013855,0.49751,1 0.93361,2.7582,0.64257,0.98346,1,0.59851,0.0055336,0.0055731,0.029712,0.089889,0.0080153,0.0020648,0.00023883,0.91499,2 0.91186,2.4994,0.60323,0.983,1,0.64916,0.0061494,0.0068823,0.018887,0.072486,0.0052267,0.0014887,8.33E-05,0.67811,2 0.89063,2.2927,0.56667,0.98732,1,0.66427,0.0028365,0.0014643,0.029272,0.091328,0.0082717,0.0022383,0.00020166,0.87177,2 0.86755,2.009,0.51464,0.98691,1,0.70277,0.0054439,0.0053937,0.030348,0.092063,0.0084044,0.0022541,0.00019854,0.94545,2
Re: [Dev] [ML] Issue while loading the leaf dataset (misreading classes)
Hi thushan, We need more info. What did you exactly print and where? On Tue, Aug 11, 2015 at 12:47 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi, I found the potential cause of the poor accuracy for the leaf dataset. It seems the data read into ML is wrong. I have attached the data file as a CSV (classes are in the last column) However, when I print out the labels of the read data (classes), it looks something like below. Clearly there aren't this many 3.0 classes and there should be classes up to 36.0. Is this caused by a bug? 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 12.012.012.012.012.012.0 12.012.012.012.013.013.013.013.013.013.0 13.013.013.013.014.014.014.014.014.0 14.014.014.015.015.015.015.015.015.0 15.015.015.015.015.015.016.016.016.016.0 16.016.016.016.017.017.017.017.017.0 17.017.017.017.017.018.018.018.018.0 18.018.018.018.018.018.018.019.019.019.0 19.019.019.019.019.019.019.019.019.0 19.019.02.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 2.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Thanks regards, Nirmal Team Lead - WSO2 Machine Learner Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Need to improt javax.naming and javax.sql.* inside maven imports for OSGi
Hi Devs,
I'm working on optimizing maven build scripts for CDMF grouping feature. In
group-mgt component I had to import javax.sql and javax.naming as OSGi
imports to build and run product without issue. Here is the snap from my
pom file.
* plugin*
*groupIdorg.apache.felix/groupId*
*artifactIdmaven-bundle-plugin/artifactId*
*version1.4.0/version*
*extensionstrue/extensions*
*configuration*
*instructions*
*
Bundle-SymbolicName${project.artifactId}/Bundle-SymbolicName*
*Bundle-Name${project.artifactId}/Bundle-Name*
*
Bundle-Version${carbon.device.mgt.version}/Bundle-Version*
*Bundle-DescriptionDevice Management Core Group
Bundle/Bundle-Description*
*
Private-Packageorg.wso2.carbon.device.mgt.group.core.internal/Private-Package*
*Import-Package*
*org.wso2.carbon.device.mgt.group.common.*,*
*org.wso2.carbon.device.mgt.common.*,*
*org.wso2.carbon.device.mgt.core.*,*
*org.wso2.carbon.user.core.*,*
*org.wso2.carbon.user.core,*
*org.apache.commons.logging.*,*
*javax.naming,*
*javax.sql.*,*
*org.osgi.framework.*,*
*org.osgi.service.component.*,*
*org.wso2.carbon.user.api.**
*/Import-Package*
*Export-Package*
*
!org.wso2.carbon.device.mgt.group.core.internal,*
*org.wso2.carbon.device.mgt.group.core.**
*/Export-Package*
*/instructions*
*/configuration*
*/plugin*
But I feel that, javax.naming and javax.sql imports should be get rid out
from OSGi imports since they are provided by the runtime. However when I
removed those two imports from pom file, build break happen with this error.
[ERROR] Error building bundle
org.wso2.carbon.devicemgt:org.wso2.carbon.device.mgt.group.core:bundle:0.9.2-SNAPSHOT
: Unresolved references to [javax.naming, javax.sql] by class(es) on the
Bundle-Classpath[Jar:dot]:
[org/wso2/carbon/device/mgt/group/core/dao/GroupManagementDAOFactory.class,
org/wso2/carbon/device/mgt/group/core/dao/GroupManagementDAOUtil.class,
org/wso2/carbon/device/mgt/group/core/dao/GroupDAOImpl.class]
So I'm wondering that, why I still need to import those non OSGi packages
inside OSGi imports since they are provided by the runtime.
Any thoughts?
--
*Charitha Goonetilleke*
Software Engineer
WSO2 Inc.; http://wso2.com
lean.enterprise.middleware
mobile: +94 77 751 3669 %2B94777513669
Twitter:@CharithaWs https://twitter.com/CharithaWs, fb: charithag
https://www.facebook.com/charithag, linkedin: charithag
http://www.linkedin.com/in/charithag
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Please review and merge PR for IDENTITY-3042
Hi, Please review and merge the PR [1] and [2] as the fix for the public JIRA [3]. [1] https://github.com/wso2/carbon4-kernel/pull/378 [2] https://github.com/wso2/carbon-identity/pull/791 [3] https://wso2.org/jira/browse/IDENTITY-3042 Thanks and Regards -- Indunil Upeksha Rathnayake Software Engineer | WSO2 Inc Emailindu...@wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Architecture] [Connector + Inbound] RSS/Atom feed Connector + Inbound for WSO2 ESB
Use Case Diagram https://docs.google.com/a/wso2.com/document/d/1XpqU3z7xbKUb20N5ttvje3wdIR4DuydKqz1iiwAAeEY/edit?usp=sharing On Thu, Jul 30, 2015 at 6:35 PM, Malaka Silva mal...@wso2.com wrote: Looks good On Thu, Jul 30, 2015 at 5:25 PM, Rajjaz Mohammed raj...@wso2.com wrote: Hi Malaka, as you mentioned implementation will be polling inbound and Connector for Atom/RSS feed. i will post diagram soon after study further about Apache abdera framework working flow. here is my Milestone plan https://docs.google.com/a/wso2.com/spreadsheets/d/12wFJ1l0ffkOirvLSzO5A7T4ySiH3pIaQlQtp6fHGgX4/edit?usp=sharing On Thu, Jul 30, 2015 at 10:33 AM, Malaka Silva mal...@wso2.com wrote: Hi Rajjaz, Above implementation is going to be polling inbound and a connector for sending right? Can you provide more info on this please. Maybe a diagram will help. On Thu, Jul 30, 2015 at 8:28 AM, Rajjaz Mohammed raj...@wso2.com wrote: Hi all, I have planned to develop $subject as described below using Apache Abdera framework. *Intro* RSS/Atom Connector for creating, editing, and publishing web feeds and other web resources. *Methods* 1. Retrieving resources (GET) :retrieve feeds and inject to esb mediation logic resources using the our Connector is straightforward: If the resource is not an XML document, the ClientResponse object can provide an InputStream. The ClientResponse object provides access to all of the response headers such as ETag and Last-Modified. 2. Creating resources (POST) : 3. Updating resources (PUT) 4. Deleting resources other then that Connector we will have the features - SSL-protected endpoints - customize options for a client request - Custom HTTP methods - HTTP Authentication mechanisms - HTTP cookies - HTTP Cache-Control mechanism and also Support for format and protocol extensions and can create Atom Publishing Protocol server. for More Details about the Framework and features click https://cwiki.apache.org/confluence/display/ABDERA/AtomPub+Client#AtomPubClient-Creatingresources%28POST%29 -- Thank you Best Regards Rajjaz HM Associate Software Engineer WSO2 Inc. http://wso2.com/ lean | enterprise | middleware Mobile : +94752833834 Email :raj...@wso2.com LinkedIn | Blogger | WSO2 Profile http://wso2.com/about/team/mohammer_rajjaz/ -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ http://wso2.com/about/team/malaka-silva/ Save a tree -Conserve nature Save the world for your future. Print this email only if it is absolutely necessary. -- Thank you Best Regards Rajjaz HM Associate Software Engineer WSO2 Inc. http://wso2.com/ lean | enterprise | middleware Mobile : +94752833834 Email :raj...@wso2.com LinkedIn | Blogger | WSO2 Profile http://wso2.com/about/team/mohammer_rajjaz/ -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ http://wso2.com/about/team/malaka-silva/ Save a tree -Conserve nature Save the world for your future. Print this email only if it is absolutely necessary. -- Thank you Best Regards *Rajjaz HM* Associate Software Engineer WSO2 Inc. http://wso2.com/ lean | enterprise | middleware Mobile : +94752833834 Email :raj...@wso2.com LinkedIn | Blogger | WSO2 Profile http://wso2.com/about/team/mohammer_rajjaz/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Load testing for the File connector
I need to do the load testing for the operations(decompress file,read content inside compressed file and add file inside compressed folder) of the file connector. How can I do that? Any suggestion? *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Load test for File Connector
Hi Malaka, Thank you. *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138* On Tue, Aug 11, 2015 at 12:01 PM, Malaka Silva mal...@wso2.com wrote: You can use soap ui or jmeter for this purpose. You can use console for monitoring [2] [1] http://www.soapui.org/Getting-Started/load-testing.html [2] http://docs.oracle.com/javase/6/docs/technotes/guides/management/jconsole.html On Tue, Aug 11, 2015 at 11:43 AM, Vivekananthan Sivanayagam vivekanant...@wso2.com wrote: Hi, I need to do the load testing for the operations(decompress file,read content inside compressed file and add file inside compressed folder) of the file connector. How can I do that? Any suggestion? *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138 %2B94752786138* -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ http://wso2.com/about/team/malaka-silva/ Save a tree -Conserve nature Save the world for your future. Print this email only if it is absolutely necessary. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Progress with Deeplearning Component
Great! Please create a Jira. On Tue, Aug 11, 2015 at 12:43 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi CD, No worries. On Tue, Aug 11, 2015 at 5:11 PM, CD Athuraliya chathur...@wso2.com wrote: Hi Nirmal, We will be able to fix this issue. Thanks Thushan for pointing this out! :) On Tue, Aug 11, 2015 at 12:32 PM, Nirmal Fernando nir...@wso2.com wrote: @CD, is this something we could fix? can we list features in the order of the indices? On Tue, Aug 11, 2015 at 12:25 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi, I noticed that, in certain cases, the features don't follow the correct ordering. Any idea why this is happening? For example in this image, V10 appears after V1 On Tue, Aug 11, 2015 at 12:10 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, After a daunting struggle, I was able to corner the issue with the poor accuracy for the specific leaf dataset. The dataset has classes from 1 to 36. However, there are no classes from 16th - 22nd. i.e. Classes go as 1,2,..,14,15,23,24,...,35,36 Then, while converting these class labels to enums in H-2-O (combined with the fact that there's very little data for each class) confuses H-2-O and causes it to *assign different enum values for the same classes in different datasets*. Which manifest itself as a poor accuracy. I suspect that there's a mismatch between the labels provided by JavaRDD and enums produced by H-2-O as well. I'm looking into this issue right now. Thank you On Mon, Aug 10, 2015 at 11:16 AM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, I've been testing the new Deeplearning component with few different datasets (mainly leaf dataset) and the leaf dataset seems to be not working as expected for an unknown reason. However, I tested the Deeplearning component extensively with the leaf dataset and identified several potential problems that might be causing the poor accuracy. 1. Need to have higher number of epochs (compared to other datasets) to produce a reasonable accuracy. 2. Too many neurons causing overfitting thereby causing poor accuracy. 3. Some classes have quite closely related features (Especially the latter classes are misclassified often) I was able to get an accuracy of 86% with Logistic Regression L-BFGS. Which is quite reasonable. But I'm having trouble reaching that accuracy with Deeplearning (which should be quite easy). Highest accuracy I reached so far is 71.xx% So I'm still looking for any definite issues causing the poor accuracy. Thank you. -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Thanks regards, Nirmal Team Lead - WSO2 Machine Learner Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ -- *CD Athuraliya* Software Engineer WSO2, Inc. lean . enterprise . middleware Mobile: +94 716288847 94716288847 LinkedIn http://lk.linkedin.com/in/cdathuraliya | Twitter https://twitter.com/cdathuraliya | Blog http://cdathuraliya.tumblr.com/ -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Thanks regards, Nirmal Team Lead - WSO2 Machine Learner Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Issue while loading the leaf dataset (misreading classes)
Can you use following code and try;
ListLabeledPoint points = labeledPoints.collect();
for(int i=0;ipoints.size();i++){
System.out.print(points.get(i).label() + \t);
}
On Tue, Aug 11, 2015 at 2:30 PM, Thushan Ganegedara thu...@gmail.com
wrote:
I used the following snippet
for(int i=0;ilabeledPoints.collect().size();i++){
System.out.print(labeledPoints.collect().get(i).label() +
\t);
}
in the public MLModel build() throws MLModelBuilderException in
DeeplearningModelBuilder.java
On Tue, Aug 11, 2015 at 6:17 PM, Nirmal Fernando nir...@wso2.com wrote:
Hi thushan,
We need more info. What did you exactly print and where?
On Tue, Aug 11, 2015 at 12:47 PM, Thushan Ganegedara thu...@gmail.com
wrote:
Hi,
I found the potential cause of the poor accuracy for the leaf dataset.
It seems the data read into ML is wrong.
I have attached the data file as a CSV (classes are in the last column)
However, when I print out the labels of the read data (classes), it
looks something like below. Clearly there aren't this many 3.0 classes
and there should be classes up to 36.0.
Is this caused by a bug?
1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
1.0 1.0 1.0 12.012.012.012.012.012.0
12.012.012.012.013.013.013.013.013.013.0
13.013.013.013.014.014.014.014.014.0
14.014.014.015.015.015.015.015.015.0
15.015.015.015.015.015.016.016.016.016.0
16.016.016.016.017.017.017.017.017.0
17.017.017.017.017.018.018.018.018.0
18.018.018.018.018.018.018.019.019.019.0
19.019.019.019.019.019.019.019.019.0
19.019.02.0 2.0 2.0 2.0 2.0 2.0 2.0
2.0 2.0 2.0 2.0 2.0 2.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 4.0 4.0 4.0 4.0 4.0 4.0
4.0 4.0 4.0 4.0 4.0 4.0 5.0 5.0 5.0 5.0
5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0
6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0
6.0 6.0 6.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0
7.0 7.0 7.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0
--
Regards,
Thushan Ganegedara
School of IT
University of Sydney, Australia
--
Thanks regards,
Nirmal
Team Lead - WSO2 Machine Learner
Associate Technical Lead - Data Technologies Team, WSO2 Inc.
Mobile: +94715779733
Blog: http://nirmalfdo.blogspot.com/
--
Regards,
Thushan Ganegedara
School of IT
University of Sydney, Australia
--
Thanks regards,
Nirmal
Team Lead - WSO2 Machine Learner
Associate Technical Lead - Data Technologies Team, WSO2 Inc.
Mobile: +94715779733
Blog: http://nirmalfdo.blogspot.com/
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [GSoC2015] d3js Moving SVG elements inside a transforming group
On Tue, Aug 11, 2015 at 3:30 PM, Mohamed Fawzan fawz...@gmail.com wrote: adding Dakshika. On Tue, Aug 11, 2015 at 2:59 PM, Mohamed Fawzan fawz...@gmail.com wrote: Hi, Can someone help on this SO question[1] http://stackoverflow.com/questions/31935084/d3js-moving-svg-elements-inside-a-transforming-group ? [1] - http://stackoverflow.com/questions/31935084/d3js-moving-svg-elements-inside-a-transforming-group -Regards -- Mohammed Fawzan Faculty of Engineering | UoP +94771121195 -- Mohammed Fawzan Faculty of Engineering | UoP +94771121195 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gimantha Bandara Software Engineer WSO2. Inc : http://wso2.com Mobile : +94714961919 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Load test for File Connector
Hi, I need to do the load testing for the operations(decompress file,read content inside compressed file and add file inside compressed folder) of the file connector. How can I do that? Any suggestion? *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] carbon-registry 4.4.5 release
Sure Prasanna. We'll trigger fresh builds for DAS with this repo and check. On 11 August 2015 at 11:28, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, carbon-registry-4.4.5 release is uploaded to the nexus staging repo. [1]. @Anjana/Manu/UdaraR please verify your fixes adding the following repository[1]. We'll release it from the staging repo once you have verified. [1] - http://maven.wso2.org/nexus/content/repositories/orgwso2carbonregistry-012/ Thanks On Tue, Aug 11, 2015 at 10:25 AM, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, I started the release prepare. As per the discussions had yesterday releasing with carbon-commons 4.4.4. Thanks Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 -- Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gokul Balakrishnan Senior Software Engineer, WSO2, Inc. http://wso2.com Mob: +94 77 593 5789 | +1 650 272 9927 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [GSoC2015] d3js Moving SVG elements inside a transforming group
Hi, Can someone help on this SO question[1] http://stackoverflow.com/questions/31935084/d3js-moving-svg-elements-inside-a-transforming-group ? [1] - http://stackoverflow.com/questions/31935084/d3js-moving-svg-elements-inside-a-transforming-group -Regards -- Mohammed Fawzan Faculty of Engineering | UoP +94771121195 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Issue while loading the leaf dataset (misreading classes)
I used the following snippet
for(int i=0;ilabeledPoints.collect().size();i++){
System.out.print(labeledPoints.collect().get(i).label() + \t);
}
in the public MLModel build() throws MLModelBuilderException in
DeeplearningModelBuilder.java
On Tue, Aug 11, 2015 at 6:17 PM, Nirmal Fernando nir...@wso2.com wrote:
Hi thushan,
We need more info. What did you exactly print and where?
On Tue, Aug 11, 2015 at 12:47 PM, Thushan Ganegedara thu...@gmail.com
wrote:
Hi,
I found the potential cause of the poor accuracy for the leaf dataset. It
seems the data read into ML is wrong.
I have attached the data file as a CSV (classes are in the last column)
However, when I print out the labels of the read data (classes), it looks
something like below. Clearly there aren't this many 3.0 classes and
there should be classes up to 36.0.
Is this caused by a bug?
1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
1.0 1.0 1.0 12.012.012.012.012.012.0
12.012.012.012.013.013.013.013.013.013.0
13.013.013.013.014.014.014.014.014.0
14.014.014.015.015.015.015.015.015.0
15.015.015.015.015.015.016.016.016.016.0
16.016.016.016.017.017.017.017.017.0
17.017.017.017.017.018.018.018.018.0
18.018.018.018.018.018.018.019.019.019.0
19.019.019.019.019.019.019.019.019.0
19.019.02.0 2.0 2.0 2.0 2.0 2.0 2.0
2.0 2.0 2.0 2.0 2.0 2.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 4.0 4.0 4.0 4.0 4.0 4.0
4.0 4.0 4.0 4.0 4.0 4.0 5.0 5.0 5.0 5.0
5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0
6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0
6.0 6.0 6.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0
7.0 7.0 7.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0
--
Regards,
Thushan Ganegedara
School of IT
University of Sydney, Australia
--
Thanks regards,
Nirmal
Team Lead - WSO2 Machine Learner
Associate Technical Lead - Data Technologies Team, WSO2 Inc.
Mobile: +94715779733
Blog: http://nirmalfdo.blogspot.com/
--
Regards,
Thushan Ganegedara
School of IT
University of Sydney, Australia
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Progress with Deeplearning Component
Hi, I noticed that, in certain cases, the features don't follow the correct ordering. Any idea why this is happening? For example in this image, V10 appears after V1 On Tue, Aug 11, 2015 at 12:10 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, After a daunting struggle, I was able to corner the issue with the poor accuracy for the specific leaf dataset. The dataset has classes from 1 to 36. However, there are no classes from 16th - 22nd. i.e. Classes go as 1,2,..,14,15,23,24,...,35,36 Then, while converting these class labels to enums in H-2-O (combined with the fact that there's very little data for each class) confuses H-2-O and causes it to *assign different enum values for the same classes in different datasets*. Which manifest itself as a poor accuracy. I suspect that there's a mismatch between the labels provided by JavaRDD and enums produced by H-2-O as well. I'm looking into this issue right now. Thank you On Mon, Aug 10, 2015 at 11:16 AM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, I've been testing the new Deeplearning component with few different datasets (mainly leaf dataset) and the leaf dataset seems to be not working as expected for an unknown reason. However, I tested the Deeplearning component extensively with the leaf dataset and identified several potential problems that might be causing the poor accuracy. 1. Need to have higher number of epochs (compared to other datasets) to produce a reasonable accuracy. 2. Too many neurons causing overfitting thereby causing poor accuracy. 3. Some classes have quite closely related features (Especially the latter classes are misclassified often) I was able to get an accuracy of 86% with Logistic Regression L-BFGS. Which is quite reasonable. But I'm having trouble reaching that accuracy with Deeplearning (which should be quite easy). Highest accuracy I reached so far is 71.xx% So I'm still looking for any definite issues causing the poor accuracy. Thank you. -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Progress with Deeplearning Component
Hi Nirmal, We will be able to fix this issue. Thanks Thushan for pointing this out! :) On Tue, Aug 11, 2015 at 12:32 PM, Nirmal Fernando nir...@wso2.com wrote: @CD, is this something we could fix? can we list features in the order of the indices? On Tue, Aug 11, 2015 at 12:25 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi, I noticed that, in certain cases, the features don't follow the correct ordering. Any idea why this is happening? For example in this image, V10 appears after V1 On Tue, Aug 11, 2015 at 12:10 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, After a daunting struggle, I was able to corner the issue with the poor accuracy for the specific leaf dataset. The dataset has classes from 1 to 36. However, there are no classes from 16th - 22nd. i.e. Classes go as 1,2,..,14,15,23,24,...,35,36 Then, while converting these class labels to enums in H-2-O (combined with the fact that there's very little data for each class) confuses H-2-O and causes it to *assign different enum values for the same classes in different datasets*. Which manifest itself as a poor accuracy. I suspect that there's a mismatch between the labels provided by JavaRDD and enums produced by H-2-O as well. I'm looking into this issue right now. Thank you On Mon, Aug 10, 2015 at 11:16 AM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, I've been testing the new Deeplearning component with few different datasets (mainly leaf dataset) and the leaf dataset seems to be not working as expected for an unknown reason. However, I tested the Deeplearning component extensively with the leaf dataset and identified several potential problems that might be causing the poor accuracy. 1. Need to have higher number of epochs (compared to other datasets) to produce a reasonable accuracy. 2. Too many neurons causing overfitting thereby causing poor accuracy. 3. Some classes have quite closely related features (Especially the latter classes are misclassified often) I was able to get an accuracy of 86% with Logistic Regression L-BFGS. Which is quite reasonable. But I'm having trouble reaching that accuracy with Deeplearning (which should be quite easy). Highest accuracy I reached so far is 71.xx% So I'm still looking for any definite issues causing the poor accuracy. Thank you. -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Thanks regards, Nirmal Team Lead - WSO2 Machine Learner Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ -- *CD Athuraliya* Software Engineer WSO2, Inc. lean . enterprise . middleware Mobile: +94 716288847 94716288847 LinkedIn http://lk.linkedin.com/in/cdathuraliya | Twitter https://twitter.com/cdathuraliya | Blog http://cdathuraliya.tumblr.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Please review and merge PR for IDENTITY-3102
Hi, Please review and merge the PR [1] as the fix for the public JIRA [2]. [1] https://github.com/wso2/carbon-identity/pull/780 [2] https://wso2.org/jira/browse/IDENTITY-3102 Thanks and Regards -- Indunil Upeksha Rathnayake Software Engineer | WSO2 Inc Emailindu...@wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Issue while loading the leaf dataset (misreading classes)
I still get the same result
1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
1.0 1.0 1.0 12.012.012.012.012.012.0
12.012.012.012.013.013.013.013.013.013.0
13.013.013.013.014.014.014.014.014.0
14.014.014.015.015.015.015.015.015.0
15.015.015.015.015.015.016.016.016.016.0
16.016.016.016.017.017.017.017.017.0
17.017.017.017.017.018.018.018.018.0
18.018.018.018.018.018.018.019.019.019.0
19.019.019.019.019.019.019.019.019.0
19.019.02.0 2.0 2.0 2.0 2.0 2.0 2.0
2.0 2.0 2.0 2.0 2.0 2.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 4.0 4.0 4.0 4.0 4.0 4.0
4.0 4.0 4.0 4.0 4.0 4.0 5.0 5.0 5.0 5.0
5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0
6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0
6.0 6.0 6.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0
7.0 7.0 7.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0
On Tue, Aug 11, 2015 at 7:05 PM, Nirmal Fernando nir...@wso2.com wrote:
Can you use following code and try;
ListLabeledPoint points = labeledPoints.collect();
for(int i=0;ipoints.size();i++){
System.out.print(points.get(i).label() + \t);
}
On Tue, Aug 11, 2015 at 2:30 PM, Thushan Ganegedara thu...@gmail.com
wrote:
I used the following snippet
for(int i=0;ilabeledPoints.collect().size();i++){
System.out.print(labeledPoints.collect().get(i).label() +
\t);
}
in the public MLModel build() throws MLModelBuilderException in
DeeplearningModelBuilder.java
On Tue, Aug 11, 2015 at 6:17 PM, Nirmal Fernando nir...@wso2.com wrote:
Hi thushan,
We need more info. What did you exactly print and where?
On Tue, Aug 11, 2015 at 12:47 PM, Thushan Ganegedara thu...@gmail.com
wrote:
Hi,
I found the potential cause of the poor accuracy for the leaf dataset.
It seems the data read into ML is wrong.
I have attached the data file as a CSV (classes are in the last column)
However, when I print out the labels of the read data (classes), it
looks something like below. Clearly there aren't this many 3.0 classes
and there should be classes up to 36.0.
Is this caused by a bug?
1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
1.0 1.0 1.0 12.012.012.012.012.012.0
12.012.012.012.013.013.013.013.013.0
13.0
13.013.013.013.014.014.014.014.014.0
14.014.014.015.015.015.015.015.015.0
15.015.015.015.015.015.016.016.016.0
16.0
16.016.016.016.017.017.017.017.017.0
17.017.017.017.017.018.018.018.018.0
18.018.018.018.018.018.018.019.019.0
19.0
19.019.019.019.019.019.019.019.019.0
19.019.02.0 2.0 2.0 2.0 2.0 2.0 2.0
2.0 2.0 2.0 2.0 2.0 2.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 4.0 4.0 4.0 4.0 4.0 4.0
4.0 4.0 4.0 4.0 4.0 4.0 5.0 5.0 5.0 5.0
5.0 5.0 5.0 5.0 5.0
[Dev] at_hash hash size
Hi,
The fixing PR of [3] (Access Token hash value is calculated incorrectly)
pick the first 16 bytes as the left most half of the digest. Just for my
curiosity, can we guarantee it is always
16 bytes, or otherwise digest is always 32 bytes. Does n't it vary
depending on the algorithm use(alg header).
byte[] leftmost = new byte[16];
+for (int i = 0; i 16; i++){
+leftmost[i]=digest[i];
+}
at_hash
OPTIONAL. Access Token hash value. Its value is the base64url
encoding of the left-most half of the hash of the octets of the
ASCII representation of the access_token value, where the hash
algorithm used is the hash algorithm used in the alg parameter
of the State Token's JWS [JWS] header. * For instance, if the alg*
* is RS256*, hash the access_token value with SHA-256, then take
the left-most 128 bits and base64url encode them. The at_hash
[1]
https://github.com/wso2/carbon-identity/commit/1756178b9ad62295eb5274a47b06775de13eab95
[2] https://tools.ietf.org/html/draft-bradley-oauth-jwt-encoded-state-01
[3] https://wso2.org/jira/browse/IDENTITY-3385
--
Udara Liyanage
Software Engineer
WSO2, Inc.: http://wso2.com
lean. enterprise. middleware
web: http://udaraliyanage.wordpress.com
phone: +94 71 443 6897
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Load test for File Connector
You can use soap ui or jmeter for this purpose. You can use console for monitoring [2] [1] http://www.soapui.org/Getting-Started/load-testing.html [2] http://docs.oracle.com/javase/6/docs/technotes/guides/management/jconsole.html On Tue, Aug 11, 2015 at 11:43 AM, Vivekananthan Sivanayagam vivekanant...@wso2.com wrote: Hi, I need to do the load testing for the operations(decompress file,read content inside compressed file and add file inside compressed folder) of the file connector. How can I do that? Any suggestion? *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138 %2B94752786138* -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ http://wso2.com/about/team/malaka-silva/ Save a tree -Conserve nature Save the world for your future. Print this email only if it is absolutely necessary. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Progress with Deeplearning Component
@CD, is this something we could fix? can we list features in the order of the indices? On Tue, Aug 11, 2015 at 12:25 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi, I noticed that, in certain cases, the features don't follow the correct ordering. Any idea why this is happening? For example in this image, V10 appears after V1 On Tue, Aug 11, 2015 at 12:10 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, After a daunting struggle, I was able to corner the issue with the poor accuracy for the specific leaf dataset. The dataset has classes from 1 to 36. However, there are no classes from 16th - 22nd. i.e. Classes go as 1,2,..,14,15,23,24,...,35,36 Then, while converting these class labels to enums in H-2-O (combined with the fact that there's very little data for each class) confuses H-2-O and causes it to *assign different enum values for the same classes in different datasets*. Which manifest itself as a poor accuracy. I suspect that there's a mismatch between the labels provided by JavaRDD and enums produced by H-2-O as well. I'm looking into this issue right now. Thank you On Mon, Aug 10, 2015 at 11:16 AM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, I've been testing the new Deeplearning component with few different datasets (mainly leaf dataset) and the leaf dataset seems to be not working as expected for an unknown reason. However, I tested the Deeplearning component extensively with the leaf dataset and identified several potential problems that might be causing the poor accuracy. 1. Need to have higher number of epochs (compared to other datasets) to produce a reasonable accuracy. 2. Too many neurons causing overfitting thereby causing poor accuracy. 3. Some classes have quite closely related features (Especially the latter classes are misclassified often) I was able to get an accuracy of 86% with Logistic Regression L-BFGS. Which is quite reasonable. But I'm having trouble reaching that accuracy with Deeplearning (which should be quite easy). Highest accuracy I reached so far is 71.xx% So I'm still looking for any definite issues causing the poor accuracy. Thank you. -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Thanks regards, Nirmal Team Lead - WSO2 Machine Learner Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Progress with Deeplearning Component
Hi CD, No worries. On Tue, Aug 11, 2015 at 5:11 PM, CD Athuraliya chathur...@wso2.com wrote: Hi Nirmal, We will be able to fix this issue. Thanks Thushan for pointing this out! :) On Tue, Aug 11, 2015 at 12:32 PM, Nirmal Fernando nir...@wso2.com wrote: @CD, is this something we could fix? can we list features in the order of the indices? On Tue, Aug 11, 2015 at 12:25 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi, I noticed that, in certain cases, the features don't follow the correct ordering. Any idea why this is happening? For example in this image, V10 appears after V1 On Tue, Aug 11, 2015 at 12:10 PM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, After a daunting struggle, I was able to corner the issue with the poor accuracy for the specific leaf dataset. The dataset has classes from 1 to 36. However, there are no classes from 16th - 22nd. i.e. Classes go as 1,2,..,14,15,23,24,...,35,36 Then, while converting these class labels to enums in H-2-O (combined with the fact that there's very little data for each class) confuses H-2-O and causes it to *assign different enum values for the same classes in different datasets*. Which manifest itself as a poor accuracy. I suspect that there's a mismatch between the labels provided by JavaRDD and enums produced by H-2-O as well. I'm looking into this issue right now. Thank you On Mon, Aug 10, 2015 at 11:16 AM, Thushan Ganegedara thu...@gmail.com wrote: Hi all, I've been testing the new Deeplearning component with few different datasets (mainly leaf dataset) and the leaf dataset seems to be not working as expected for an unknown reason. However, I tested the Deeplearning component extensively with the leaf dataset and identified several potential problems that might be causing the poor accuracy. 1. Need to have higher number of epochs (compared to other datasets) to produce a reasonable accuracy. 2. Too many neurons causing overfitting thereby causing poor accuracy. 3. Some classes have quite closely related features (Especially the latter classes are misclassified often) I was able to get an accuracy of 86% with Logistic Regression L-BFGS. Which is quite reasonable. But I'm having trouble reaching that accuracy with Deeplearning (which should be quite easy). Highest accuracy I reached so far is 71.xx% So I'm still looking for any definite issues causing the poor accuracy. Thank you. -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia -- Thanks regards, Nirmal Team Lead - WSO2 Machine Learner Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ -- *CD Athuraliya* Software Engineer WSO2, Inc. lean . enterprise . middleware Mobile: +94 716288847 94716288847 LinkedIn http://lk.linkedin.com/in/cdathuraliya | Twitter https://twitter.com/cdathuraliya | Blog http://cdathuraliya.tumblr.com/ -- Regards, Thushan Ganegedara School of IT University of Sydney, Australia ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [AF] Improvement of AF Wall using Web Sockets and Nginx
Hi Manjula,
I have sent an invite for tomorrow morning at 11 for the POC demo.
Thanks.
On Tue, Aug 11, 2015 at 9:47 AM, Manjula Rathnayake manju...@wso2.com
wrote:
Hi Sabra,
Great progress on the POC. Can we have a demo on Wednesday morning through
hangouts?
After that we can look into the next steps such as load testing POC setup
and finally integrating it with AF wall.
thank you.
On Sun, Aug 9, 2015 at 7:33 AM, Sabra Ossen sabra...@gmail.com wrote:
Hi All,
I have completed the NGINX and Websockets integration using WSO2 AS 5.3.0
Alpha. I have included the code in github at [1]. The websocket server
implemented using JSR 356 and the jax-rs service are both deployed in the
AS.
By using the curl client I am able to send and display messages in the
browser.
The *complete NGINX configuration* is as follows.
Create a file named astest.com in /etc/nginx/sites-available. The
content of astest.com should be as follows.
*upstream wso2.as.com http://wso2.as.com {ip_hash;*
*# WSO2 AS address is xx.xxx.xxx.xxx*
*server xx.xxx.xxx.xxx:9763;keepalive 8;}# the nginx server
instanceserver {listen 80;server_name as.wso2.com
http://as.wso2.com ;access_log /var/log/nginx/nginxtest.log;
location / { proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header Host $http_host; proxy_set_header X-NginX-Proxy
true; proxy_http_version 1.1; proxy_set_header Upgrade
$http_upgrade; proxy_set_header Connection upgrade; proxy_pass
http://wso2.as.com/ http://wso2.as.com/; proxy_redirect off;} }*
Execute the following commands.
*cd /etc/nginx/sites-enabledsudo ln -s
/etc/nginx/sites-available/astest.com http://astest.com astest.com
http://astest.com*
The above creates a symbolic link of the nginx server instance in
/etc/nginx/sites-enabled.
In order for the NGINX server instance to take effect I also appended the
following in the /etc/hosts file in my local machine.
*# nginx virtual servers*
*# Local machine ip is xx.xxx.xxx.xxx*
*xx.xxx.xxx.xxx as.wso2.com http://as.wso2.com*
Execute the following command.
*source /etc/hosts*
By using the curl client now we can successfully send and display
messages to the browser using the following command where the url is of the
following format http://as.wso2.com:80/FirstJaxRsService/{message};.
Note that in order for the browser to accept messages first a connection
needs to be opened.
*curl http://as.wso2.com:80/FirstJaxRsService/hello
http://as.wso2.com:80/FirstJaxRsService/hello*
[1] https://github.com/SabraO/WebsocketNginxintegration
Thanks and Regards.
On Wed, Jul 1, 2015 at 10:47 PM, Dimuthu Leelarathne dimut...@wso2.com
wrote:
Hi Sabra,
Yes. This looks good. Please proceed.
thanks,
dimuthu
On Tue, Jun 30, 2015 at 10:01 AM, Sabra Ossen sabra...@gmail.com
wrote:
Hi All,
During implementation an issue was raised on using the curl client to
send messages to the echo server. Therefore in order for the Java echo
server to be able to accept messages from the curl client I have included a
JAX- RS web service in between.
I have attached a diagram showing the updated design for the POC.
Regards.
Sabra.
On Fri, Jun 19, 2015 at 2:13 PM, Sabra Ossen sabra...@gmail.com
wrote:
Hi Manjula,
Okay, then I will focus on step 1 and 2. And I will also check if the
latest AS release supports web sockets, failing which I will proceed with
AS 5.1.0.
Thanks for the help.
Regards.
On Fri, Jun 19, 2015 at 11:26 AM, Manjula Rathnayake
manju...@wso2.com wrote:
Hi Sabra,
These notes cover most of the items of we discussed.
IMO, we do not need to consider step 3 at this point of POC. It is
more related to AF Wall functionality. After completing POC, we will
have a
demo and discuss next steps.
I was checking if latest application server supports web sockets but
for AS 5.1.0, I could find some samples at [1].
[1].
https://svn.wso2.org/repos/wso2/carbon/platform/tags/4.1.0/products/as/5.1.0/modules/samples/common/webapp/src/main/java/websocket/
thank you.
On Fri, Jun 19, 2015 at 11:18 AM, Sabra Ossen sabra...@gmail.com
wrote:
Hi All,
Currently in AF the FE (AF Wall) polls the BE (Social Component) to
identify and display notifications.
The method proposed below is for $subject. The PoC for $subject is
as follows.
*1) The curl client pushes data to the Java Echo Server (Hosted in
WSO2 AS) which then writes to the client browser through the web
socket.*
I have attached a screen shot of a diagram showing the design. Nginx is
used to emphasize on load balancing and as a proxy.
2) With the completion of the above step then we move on to the next
step of *creating a listener for the Social API replacing the Java
Echo Server* and then port the code to AF.
3) One issue raised during discussion of $subject was the
Re: [Dev] [C5] Clustering test-cases failing after upgrading to Hazelcast 3.5.0
+1, let's add a check for loopback address.
On Mon, Aug 10, 2015 at 5:50 PM, Aruna Karunarathna ar...@wso2.com wrote:
Hi all,
I am currently in the process of upgrading the hazelcast version to 3.5.0.
After the upgrade following test-cases are failing.
INFO: [127.0.0.1]:0 [wso2.wka.domain] [3.5] Hazelcast Shutdown is
completed in 358 ms.
Aug 10, 2015 5:36:44 PM com.hazelcast.core.LifecycleService
INFO: [127.0.0.1]:0 [wso2.wka.domain] [3.5] Address[127.0.0.1]:0 is
SHUTDOWN
Tests run: 64, Failures: 2, Errors: 0, Skipped: 4, Time elapsed: 11.755
sec FAILURE!
Results :
Failed tests:
testMulticastMembershipScheme(org.wso2.carbon.clustering.MulitcastMembershipSchemeTestCase):
expected:2 but was:1
testWKAMembershipScheme(org.wso2.carbon.clustering.WKAMembershipSchemeTestCase):
expected:2 but was:1
After further analyzing found that hazelcast doesn't accept localhost as
the hostName in 3.5 verssion. in Carbon 4 there is a warning defined if the
host-name is local. [1]
What would be the best way to fix this?. Shall we add a local host check
when initializing the instance [2]?.
if (localMemberHost != null*
!localMemberHost.equalsIgnoreCase(127.0.0.1) *
*!localMemberHost.equalsIgnoreCase(localhost)*) {
localMemberHost = localMemberHost.trim();
} else {
try {
localMemberHost = ClusterUtil.getIpAddress();
} catch (SocketException e) {
String msg = Could not set local member host;
logger.error(msg, e);
throw new ClusterInitializationException(msg, e);
}
}
[1].
https://github.com/wso2/carbon4-kernel/blob/master/core/org.wso2.carbon.core/src/main/java/org/wso2/carbon/core/clustering/hazelcast/HazelcastClusteringAgent.java#L131
[2].
https://github.com/wso2/carbon-kernel/blob/master/core/src/main/java/org/wso2/carbon/clustering/hazelcast/HazelcastClusteringAgent.java#L111
Regards,
Aruna
--
*Aruna Sujith Karunarathna *| Software Engineer
WSO2, Inc | lean. enterprise. middleware.
#20, Palm Grove, Colombo 03, Sri Lanka
Mobile: +94 71 9040362 | Work: +94 112145345
Email: ar...@wso2.com | Web: www.wso2.com
--
*Kishanthan Thangarajah*
Associate Technical Lead,
Platform Technologies Team,
WSO2, Inc.
lean.enterprise.middleware
Mobile - +94773426635
Blog - *http://kishanthan.wordpress.com http://kishanthan.wordpress.com*
Twitter - *http://twitter.com/kishanthan http://twitter.com/kishanthan*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [GSoC2015] d3js Moving SVG elements inside a transforming group
adding Dakshika. On Tue, Aug 11, 2015 at 2:59 PM, Mohamed Fawzan fawz...@gmail.com wrote: Hi, Can someone help on this SO question[1] http://stackoverflow.com/questions/31935084/d3js-moving-svg-elements-inside-a-transforming-group ? [1] - http://stackoverflow.com/questions/31935084/d3js-moving-svg-elements-inside-a-transforming-group -Regards -- Mohammed Fawzan Faculty of Engineering | UoP +94771121195 -- Mohammed Fawzan Faculty of Engineering | UoP +94771121195 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] BAM JMX Toolbox not showing stats
Hi Folks,
Trying to get the BAM JMX Toolkit working.
I can see all the stats flowing through to cassandra (from my esb). I can
see the hive script putting them into the local h2. I can see the stats in
the h2 but the pretty graphs are not being filled out - they show the
message No data available. Please visit our docs to see how to configure
JMX monitoring
I know that the page is connecting to the DB OK because it is retrieving
the information about which servers are in the DB. I've done some java
console debugging and can see the functions being called to reload the
iframes (debug in [1]) . However, I can see that a field - rname is not
filled out (comes out as a blank string) . This variable appears to have to
be loaded from a combo box - rname-dd.
However, index.jsp does not appear to have such a combo box !
Any ideas folks - is there a script not being loaded or something else?
thanks,
John.
[2]
function reloadIFrame(param){
var params = param || {};
var server = param.server || ;
var rname = param.rname || ;
var rtype = param.rtype || ;
var t = param.timeGroup || ;
$(iframe).each(function(){
//var id = $(this).attr('id');
var currentUrl = $(this).attr('src');
if(currentUrl.indexOf('?')){
var absUrl = currentUrl.split('?');
currentUrl = absUrl[0];
}
var newUrl = currentUrl+?server=+encodeURI(server)+rtype=+
encodeURI(rtype)+rname=+encodeURI(rname)+t=+t;
$(this).attr('src',newUrl);
});
John Hawkins
Director: Solutions Architecture
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [ML] Issue while loading the leaf dataset (misreading classes)
This issue occurs, if I turn the response variable to a categorical
variable. If I get the variable as a numerical variable, the values are
read correctly.
So I presume there is a fault in categorical conversion of the variable.
On Tue, Aug 11, 2015 at 7:11 PM, Thushan Ganegedara thu...@gmail.com
wrote:
I still get the same result
1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
1.0 1.0 1.0 12.012.012.012.012.012.0
12.012.012.012.013.013.013.013.013.013.0
13.013.013.013.014.014.014.014.014.0
14.014.014.015.015.015.015.015.015.0
15.015.015.015.015.015.016.016.016.016.0
16.016.016.016.017.017.017.017.017.0
17.017.017.017.017.018.018.018.018.0
18.018.018.018.018.018.018.019.019.019.0
19.019.019.019.019.019.019.019.019.0
19.019.02.0 2.0 2.0 2.0 2.0 2.0 2.0
2.0 2.0 2.0 2.0 2.0 2.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 4.0 4.0 4.0 4.0 4.0 4.0
4.0 4.0 4.0 4.0 4.0 4.0 5.0 5.0 5.0 5.0
5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0 5.0
6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0 6.0
6.0 6.0 6.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0
7.0 7.0 7.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0 3.0
3.0 3.0 3.0 3.0
On Tue, Aug 11, 2015 at 7:05 PM, Nirmal Fernando nir...@wso2.com wrote:
Can you use following code and try;
ListLabeledPoint points = labeledPoints.collect();
for(int i=0;ipoints.size();i++){
System.out.print(points.get(i).label() + \t);
}
On Tue, Aug 11, 2015 at 2:30 PM, Thushan Ganegedara thu...@gmail.com
wrote:
I used the following snippet
for(int i=0;ilabeledPoints.collect().size();i++){
System.out.print(labeledPoints.collect().get(i).label() +
\t);
}
in the public MLModel build() throws MLModelBuilderException in
DeeplearningModelBuilder.java
On Tue, Aug 11, 2015 at 6:17 PM, Nirmal Fernando nir...@wso2.com
wrote:
Hi thushan,
We need more info. What did you exactly print and where?
On Tue, Aug 11, 2015 at 12:47 PM, Thushan Ganegedara thu...@gmail.com
wrote:
Hi,
I found the potential cause of the poor accuracy for the leaf dataset.
It seems the data read into ML is wrong.
I have attached the data file as a CSV (classes are in the last column)
However, when I print out the labels of the read data (classes), it
looks something like below. Clearly there aren't this many 3.0 classes
and there should be classes up to 36.0.
Is this caused by a bug?
1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
1.0 1.0 1.0 1.0 12.012.012.012.012.0
12.012.012.012.012.013.013.013.013.0
13.013.0
13.013.013.013.014.014.014.014.0
14.014.014.014.015.015.015.015.015.0
15.015.015.015.015.015.015.016.016.0
16.016.0
16.016.016.016.017.017.017.017.0
17.017.017.017.017.017.018.018.018.0
18.018.018.018.018.018.018.018.019.0
19.019.0
19.019.019.019.019.019.019.019.0
19.019.019.02.0 2.0 2.0 2.0 2.0 2.0
2.0
[Dev] Please review and merge PR for IDENTITY-2781
Hi, Please review and merge the PR [1] as the fix for the public JIRA [2]. [1] https://github.com/wso2/carbon-identity/pull/776 [2] https://wso2.org/jira/browse/IDENTITY-2781 Thanks and Regards -- Indunil Upeksha Rathnayake Software Engineer | WSO2 Inc Emailindu...@wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Next carbon-deployment release is 4.5.0
Hi, This is to update that the next carbon-deployment release is 4.5.0. AS will need a Jaggery release on top of carbon-deployment 4.5.0 for the AS 5.3.0 beta release. Thanks, KasunG -- *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. email: kasung AT spamfree wso2.com linked-in: http://lk.linkedin.com/in/gajasinghe blog: http://kasunbg.org ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Please Review and Merge the Fix and the Test Case
The fix for the public JIRA [1] and the Test Case related to the Fix is in [2] and [3] respectively. $Subject. [1] https://wso2.org/jira/browse/APIMANAGER-4023 [2] https://github.com/wso2/carbon-apimgt/pull/884 [3] https://github.com/wso2/product-apim/pull/321 -- Thanks Regards, *Chamalee De Silva* Software Engineer *WS**O2* Inc. .:http://wso2.com Office :- *+94 11 2145345 %2B94%2011%202145345* mobile :- *+94 7 %2B94%2077%2027820391 4315942* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] carbon-registry 4.4.5 release
Hi Prasanna, On Tue, Aug 11, 2015 at 11:50 AM, Gokul Balakrishnan go...@wso2.com wrote: Sure Prasanna. We'll trigger fresh builds for DAS with this repo and check. On 11 August 2015 at 11:28, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, carbon-registry-4.4.5 release is uploaded to the nexus staging repo. [1]. @Anjana/Manu/UdaraR please verify your fixes adding the following repository[1]. We'll release it from the staging repo once you have verified. I have tested and class loading issue is longer there. [1] - http://maven.wso2.org/nexus/content/repositories/orgwso2carbonregistry-012/ Thanks On Tue, Aug 11, 2015 at 10:25 AM, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, I started the release prepare. As per the discussions had yesterday releasing with carbon-commons 4.4.4. Thanks Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 -- Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gokul Balakrishnan Senior Software Engineer, WSO2, Inc. http://wso2.com Mob: +94 77 593 5789 | +1 650 272 9927 -- Thanks Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] carbon-registry 4.4.5 release
Hi Prasanna, I've tested ES pack with carbon-registry 4.4.5. Works fine. Thanks! -Ayesha On Tue, Aug 11, 2015 at 5:57 PM, Prasanna Dangalla prasa...@wso2.com wrote: Hi Ayesha, You have to update the governance version into 4.5.2-SNAPSHOT. Thanks, On Tue, Aug 11, 2015 at 5:46 PM, Ayesha Dissanayaka aye...@wso2.com wrote: Hi Prasanna, Search is not working properly with ES. Issue mentioned in thread [1]. [1] [Dev] Registry search doesn't return the expected results with combinations of space and * Thanks! -Ayesha On Tue, Aug 11, 2015 at 5:33 PM, Inosh Goonewardena in...@wso2.com wrote: Correction: class loading issue is no longer there. On Tue, Aug 11, 2015 at 5:30 PM, Inosh Goonewardena in...@wso2.com wrote: Hi Prasanna, On Tue, Aug 11, 2015 at 11:50 AM, Gokul Balakrishnan go...@wso2.com wrote: Sure Prasanna. We'll trigger fresh builds for DAS with this repo and check. On 11 August 2015 at 11:28, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, carbon-registry-4.4.5 release is uploaded to the nexus staging repo. [1]. @Anjana/Manu/UdaraR please verify your fixes adding the following repository[1]. We'll release it from the staging repo once you have verified. I have tested and class loading issue is longer there. [1] - http://maven.wso2.org/nexus/content/repositories/orgwso2carbonregistry-012/ Thanks On Tue, Aug 11, 2015 at 10:25 AM, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, I started the release prepare. As per the discussions had yesterday releasing with carbon-commons 4.4.4. Thanks Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 -- Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gokul Balakrishnan Senior Software Engineer, WSO2, Inc. http://wso2.com Mob: +94 77 593 5789 | +1 650 272 9927 -- Thanks Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317 -- Thanks Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Ayesha Dissanayaka* Software Engineer, WSO2, Inc : http://wso2.com http://www.google.com/url?q=http%3A%2F%2Fwso2.comsa=Dsntz=1usg=AFQjCNEZvyc0uMD1HhBaEGCBxs6e9fBObg 20, Palmgrove Avenue, Colombo 3 E-Mail: aye...@wso2.com ayshsa...@gmail.com -- Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 -- *Ayesha Dissanayaka* Software Engineer, WSO2, Inc : http://wso2.com http://www.google.com/url?q=http%3A%2F%2Fwso2.comsa=Dsntz=1usg=AFQjCNEZvyc0uMD1HhBaEGCBxs6e9fBObg 20, Palmgrove Avenue, Colombo 3 E-Mail: aye...@wso2.com ayshsa...@gmail.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Next carbon-deployment release is 4.5.0
We need a test-utils release as well. Thanks. On Tue, Aug 11, 2015 at 6:40 PM, KasunG Gajasinghe kas...@wso2.com wrote: Hi, This is to update that the next carbon-deployment release is 4.5.0. AS will need a Jaggery release on top of carbon-deployment 4.5.0 for the AS 5.3.0 beta release. Thanks, KasunG -- *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. email: kasung AT spamfree wso2.com linked-in: http://lk.linkedin.com/in/gajasinghe blog: http://kasunbg.org -- *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. email: kasung AT spamfree wso2.com linked-in: http://lk.linkedin.com/in/gajasinghe blog: http://kasunbg.org ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [PR] Changes for Yammer Connector
Hi Malaka, Please find the pull request for $subject below: [1] https://github.com/wso2/esb-connectors/pull/261 Thanks. -- *S.Elilmatha* Associate Software Engineer, WSO2 Inc.; http://wso2.com lean.enterprise.middleware Mobile 0779842221. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [PR] Changes for Yammer Connector
Merged Please re upload the connector On Tue, Aug 11, 2015 at 3:48 PM, Elilmatha Sivanesan elilma...@wso2.com wrote: Hi Malaka, Please find the pull request for $subject below: [1] https://github.com/wso2/esb-connectors/pull/261 Thanks. -- *S.Elilmatha* Associate Software Engineer, WSO2 Inc.; http://wso2.com lean.enterprise.middleware Mobile 0779842221. -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ http://wso2.com/about/team/malaka-silva/ Save a tree -Conserve nature Save the world for your future. Print this email only if it is absolutely necessary. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] carbon-registry 4.4.5 release
Hi Ayesha, You have to update the governance version into 4.5.2-SNAPSHOT. Thanks, On Tue, Aug 11, 2015 at 5:46 PM, Ayesha Dissanayaka aye...@wso2.com wrote: Hi Prasanna, Search is not working properly with ES. Issue mentioned in thread [1]. [1] [Dev] Registry search doesn't return the expected results with combinations of space and * Thanks! -Ayesha On Tue, Aug 11, 2015 at 5:33 PM, Inosh Goonewardena in...@wso2.com wrote: Correction: class loading issue is no longer there. On Tue, Aug 11, 2015 at 5:30 PM, Inosh Goonewardena in...@wso2.com wrote: Hi Prasanna, On Tue, Aug 11, 2015 at 11:50 AM, Gokul Balakrishnan go...@wso2.com wrote: Sure Prasanna. We'll trigger fresh builds for DAS with this repo and check. On 11 August 2015 at 11:28, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, carbon-registry-4.4.5 release is uploaded to the nexus staging repo. [1]. @Anjana/Manu/UdaraR please verify your fixes adding the following repository[1]. We'll release it from the staging repo once you have verified. I have tested and class loading issue is longer there. [1] - http://maven.wso2.org/nexus/content/repositories/orgwso2carbonregistry-012/ Thanks On Tue, Aug 11, 2015 at 10:25 AM, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, I started the release prepare. As per the discussions had yesterday releasing with carbon-commons 4.4.4. Thanks Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 -- Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gokul Balakrishnan Senior Software Engineer, WSO2, Inc. http://wso2.com Mob: +94 77 593 5789 | +1 650 272 9927 -- Thanks Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317 -- Thanks Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Ayesha Dissanayaka* Software Engineer, WSO2, Inc : http://wso2.com http://www.google.com/url?q=http%3A%2F%2Fwso2.comsa=Dsntz=1usg=AFQjCNEZvyc0uMD1HhBaEGCBxs6e9fBObg 20, Palmgrove Avenue, Colombo 3 E-Mail: aye...@wso2.com ayshsa...@gmail.com -- Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] BAM adapters missing?
Hi Folks, I'm trying to set up an email output event adapter in BAM but there is no such adapter in the dropdown list. I only see, cassandra, http, JMS, kafka,logger. Someone else appears to have had the same problem [1]. All the documentation I read says that they should be there. Anyone know why we can't see them at all? [1] http://stackoverflow.com/questions/28726858/wso2-bam-2-5-0-output-adapters-are-missing many thanks, John. John Hawkins Director: Solutions Architecture ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [APIM-1.9.0] Add external API Stores
Hi, I was able to do the $subject by following [1]. In this approach configuration resides in the registry. I found another way of adding external API Stores which is used in API Manager 1.6.0 in [2]. I followed the same steps in API Manager 1.9.0. Although it list down external stores in the publisher, I am getting following error when trying to store an api. *ERROR - external:jag java.lang.NullPointerException: null* Does this second approach[2] support in API Manager 1.9.0? My intention is to automate of adding external API Stores. Therefore it is needed to add from configuration files rather than using registry resources. Is there any other approach I can follow? [1] - https://docs.wso2.com/display/AM190/Publish+to+multiple+external+API+stores [2] - https://docs.wso2.com/display/AM160/Publishing+to+API+Stores Thank you! -- *Pubudu Gunatilaka* Software Engineer WSO2, Inc.: http://wso2.com lean.enterprise.middleware mobile: +94 77 4078049 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [CEP] Help on TimeWindowProcessor
Hi Suho, The following is sample execution plan query. Here we are getting one result as value. Can I get three values using this kind of queries? *The Query* [1] https://github.com/apache/stratos/blob/master/extensions/cep/artifacts/executionplans/SecondDerivativeOfHealthRequest.xml from health_second_der_concat [health_description == 'memory_consumption'] *#window.stratos:secondDerivative(1 min, value)* select cluster_id, cluster_instance_id, network_partition_id, value as second_derivative_memory_consumption insert into second_derivative_memory_consumption_stats partition by health_second_der_cluster_partition; *The annotation in SecondDerivativeWindowProcessor* [2] https://github.com/apache/stratos/blob/master/extensions/cep/stratos-cep-extension/src/main/java/org/apache/stratos/cep/extension/SecondDerivativeFinderWindowProcessor.java @SiddhiExtension(namespace = stratos, function = secondDerivative) Here they are getting only one value. Can you point me out a way that I can have all three here? Thanks *T. Pranavan* *BSc Eng Undergraduate| Department of Computer Science Engineering ,University of Moratuwa* *Mobile| *0775136836 On 9 August 2015 at 09:27, Sriskandarajah Suhothayan s...@wso2.com wrote: Thats possible, you have to have 3 dummy fields on the input stream which you can populate at the window with the coefficients and output the events. Let me know if there are specific issues Suho On Sun, Aug 9, 2015 at 8:46 AM, Pranavan Theivendiram pranavan...@cse.mrt.ac.lk wrote: Hi Suho, In my case, I am generating a second order polynomial(Three coefficients). I am taking inputs of a 10 minute window.(A sliding window- every one minute , the window will be get update. New events will come into the window and the oldest events will get removed from the window) Thanks *T. Pranavan* *BSc Eng Undergraduate| Department of Computer Science Engineering ,University of Moratuwa* *Mobile| *0775136836 On 9 August 2015 at 08:40, Sriskandarajah Suhothayan s...@wso2.com wrote: Time window is to buffer events and expire based on some condition (time/length/etc), its not for creating new attributes by default. here the expired events are generated to inform the other processes the event have expired and hence they can do adjust their calculations based on that. If you dont have a avg() kind of aggregate functions on select then you dont need to send expired events. For you predictions how many inputs you have (input attributes used for production) and how many outputs will be generated (is it only one co efficient value)? If you are generating one value then you have to extend an Output aggregator. e.g.[1] Suho [1] https://svn.wso2.org/repos/wso2/carbon/platform/branches/turing/dependencies/commons/siddhi/2.0.0-wso2v5/modules/siddhi-core/src/main/java/org/wso2/siddhi/core/query/selector/attribute/handler/avg/AvgOutputAttributeAggregatorDouble.java On Sat, Aug 8, 2015 at 5:14 PM, Pranavan Theivendiram pranavan...@cse.mrt.ac.lk wrote: Hi All, I am working on writing a custom TimeWindowProcessor (SlidingWindow) to handle the curvefitting prediction. I followed the this implementation [1] and referred this documentation[2]. In my case, I need to get the events received during the 10 mins and use it for the calculation of the curve fitting and set the co efficient of curve fitting as a event. I am finding it hard to understand how the input events will reach the window processors and how the output events are passed throughout and what is the purpose of the processevent method. Processevent method is called in the run method on the expired events in the TimeWindowProcessor class. But that is not the case I wanted. I want to simply remove the expired events, but rather calculate the curve coefficients on active events and to send the coefficient as output events. I am bit confused in flow and out flow to the TimeWindowProcessor class. If anyone can directly point out the input events in the TimeWindowProcessor class that would be a great help for me.I really expect a help in the form of the tutorial or some explanations on this or pointing out some custom TimeWindowProcessor class. Note : I already have written evenformatters and executionplans. This is the point I got stucked. I really can`t find a good explanation about the TimeWindowProcessor class. [1] https://svn.wso2.org/repos/wso2/carbon/platform/branches/turing/dependencies/commons/siddhi/2.0.0-wso2v5/modules/siddhi-core/src/main/java/org/wso2/siddhi/core/query/processor/window/TimeWindowProcessor.java [2]https://docs.wso2.com/display/CEP300/Windows#Windows-timeWindow Thank you. *T. Pranavan* *BSc Eng Undergraduate| Department of Computer Science Engineering ,University of Moratuwa* *Mobile| *0775136836 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *S. Suhothayan*
Re: [Dev] [Architecture] Carbon Spark JDBC connector
Hi Niranda, Are we going to solve those limitations before the GA? Specially limitation no.2. Over time we can have stat table with thousands of records, so are we going to remove all the records and reinsert every time that spark script runs? Regards, Gihan On Tue, Aug 11, 2015 at 7:13 AM, Niranda Perera nira...@wso2.com wrote: Hi all, we have implemented a custom Spark JDBC connector to be used in the Carbon environment. this enables the following 1. Now, temporary tables can be created in the Spark environment by specifying an analytics datasource (configured by the analytics-datasources.xml) and a table 2. Spark uses SELECT 1 FROM $table LIMIT 1 query to check the existence of a table and the LIMIT query is not provided by all dbs. With the new connector, this query can be provided with as a config. (this config is still WIP) 3. Adding new spark dialects related for various dbs (WIP) the idea is to test this for the following dbs - mysql - h2 - mssql - oracle - postgres - db2 I have loosely tested the connector with MySQL, and I would like the APIM team to use it with the API usage stats use-case, and provide us some feedback. this connector can be accessed as follows. (docs are still not updated. I will do that ASAP) create temporary table temp_table using CarbonJDBC options (dataSource datasource name, tableName table name); select * from temp_table insert into/overwrite table temp_table some select statement known limitations 1. when creating a temp table, it should already be created in the underlying datasource 2. insert overwrite table deletes the existing table and creates it again would be very grateful if you could use this connector in your current JDBC use cases and provide us with feedback. best -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 https://twitter.com/N1R44 https://pythagoreanscript.wordpress.com/ ___ Architecture mailing list architect...@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Load test for File Connector
hi Vivek, This is a nice tutorial [1] about jmeter which I used to learn jmeter. Hope this help you too. [1] http://www.guru99.com/jmeter-performance-testing.html Thanks, On Tue, Aug 11, 2015 at 12:07 PM, Vivekananthan Sivanayagam vivekanant...@wso2.com wrote: Hi Malaka, Thank you. *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138 %2B94752786138* On Tue, Aug 11, 2015 at 12:01 PM, Malaka Silva mal...@wso2.com wrote: You can use soap ui or jmeter for this purpose. You can use console for monitoring [2] [1] http://www.soapui.org/Getting-Started/load-testing.html [2] http://docs.oracle.com/javase/6/docs/technotes/guides/management/jconsole.html On Tue, Aug 11, 2015 at 11:43 AM, Vivekananthan Sivanayagam vivekanant...@wso2.com wrote: Hi, I need to do the load testing for the operations(decompress file,read content inside compressed file and add file inside compressed folder) of the file connector. How can I do that? Any suggestion? *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138 %2B94752786138* -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ http://wso2.com/about/team/malaka-silva/ Save a tree -Conserve nature Save the world for your future. Print this email only if it is absolutely necessary. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Viraj Senevirathne Software Engineer; WSO2, Inc. Mobile : +94 71 818 4742 %2B94%20%280%29%20773%20451194 Email : vir...@wso2.com thili...@wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [CEP] Help on TimeWindowProcessor
Thanks suho. This what I am exactly looking for. :) *T. Pranavan* *BSc Eng Undergraduate| Department of Computer Science Engineering ,University of Moratuwa* *Mobile| *0775136836 On 11 August 2015 at 22:05, Sriskandarajah Suhothayan s...@wso2.com wrote: You could do some thing like below, and replace firstd, secondd, thirdd values within the extension with the computed results. define stream health_second_der_concat (cluster_id, cluster_instance_id, network_partition_id, value ) define stream health_second_der_concat_temp (cluster_id, cluster_instance_id, network_partition_id, value, firstd double, secondd double, thirdd double) from health_second_der_concat select cluster_id, cluster_instance_id, network_partition_id, 0.0 as firstd, 0.0 as secondd, 0.0 as thirdd insert into health_second_der_concat_temp from health_second_der_concat_temp [health_description == 'memory_consumption'] *#window.stratos:secondDerivative(1 min, value, *firstd, secondd, thirdd*)* select * insert into second_derivative_memory_consumption_stats partition by health_second_der_cluster_partition; On Tue, Aug 11, 2015 at 7:18 PM, Pranavan Theivendiram pranavan...@cse.mrt.ac.lk wrote: Hi Suho, The following is sample execution plan query. Here we are getting one result as value. Can I get three values using this kind of queries? *The Query* [1] https://github.com/apache/stratos/blob/master/extensions/cep/artifacts/executionplans/SecondDerivativeOfHealthRequest.xml from health_second_der_concat [health_description == 'memory_consumption'] *#window.stratos:secondDerivative(1 min, value)* select cluster_id, cluster_instance_id, network_partition_id, value as second_derivative_memory_consumption insert into second_derivative_memory_consumption_stats partition by health_second_der_cluster_partition; *The annotation in SecondDerivativeWindowProcessor* [2] https://github.com/apache/stratos/blob/master/extensions/cep/stratos-cep-extension/src/main/java/org/apache/stratos/cep/extension/SecondDerivativeFinderWindowProcessor.java @SiddhiExtension(namespace = stratos, function = secondDerivative) Here they are getting only one value. Can you point me out a way that I can have all three here? Thanks *T. Pranavan* *BSc Eng Undergraduate| Department of Computer Science Engineering ,University of Moratuwa* *Mobile| *0775136836 On 9 August 2015 at 09:27, Sriskandarajah Suhothayan s...@wso2.com wrote: Thats possible, you have to have 3 dummy fields on the input stream which you can populate at the window with the coefficients and output the events. Let me know if there are specific issues Suho On Sun, Aug 9, 2015 at 8:46 AM, Pranavan Theivendiram pranavan...@cse.mrt.ac.lk wrote: Hi Suho, In my case, I am generating a second order polynomial(Three coefficients). I am taking inputs of a 10 minute window.(A sliding window- every one minute , the window will be get update. New events will come into the window and the oldest events will get removed from the window) Thanks *T. Pranavan* *BSc Eng Undergraduate| Department of Computer Science Engineering ,University of Moratuwa* *Mobile| *0775136836 On 9 August 2015 at 08:40, Sriskandarajah Suhothayan s...@wso2.com wrote: Time window is to buffer events and expire based on some condition (time/length/etc), its not for creating new attributes by default. here the expired events are generated to inform the other processes the event have expired and hence they can do adjust their calculations based on that. If you dont have a avg() kind of aggregate functions on select then you dont need to send expired events. For you predictions how many inputs you have (input attributes used for production) and how many outputs will be generated (is it only one co efficient value)? If you are generating one value then you have to extend an Output aggregator. e.g.[1] Suho [1] https://svn.wso2.org/repos/wso2/carbon/platform/branches/turing/dependencies/commons/siddhi/2.0.0-wso2v5/modules/siddhi-core/src/main/java/org/wso2/siddhi/core/query/selector/attribute/handler/avg/AvgOutputAttributeAggregatorDouble.java On Sat, Aug 8, 2015 at 5:14 PM, Pranavan Theivendiram pranavan...@cse.mrt.ac.lk wrote: Hi All, I am working on writing a custom TimeWindowProcessor (SlidingWindow) to handle the curvefitting prediction. I followed the this implementation [1] and referred this documentation[2]. In my case, I need to get the events received during the 10 mins and use it for the calculation of the curve fitting and set the co efficient of curve fitting as a event. I am finding it hard to understand how the input events will reach the window processors and how the output events are passed throughout and what is the purpose of the processevent method. Processevent method is called in the run method on the expired events in the TimeWindowProcessor class. But that is not the case I wanted.
Re: [Dev] [CEP] Help on TimeWindowProcessor
You could do some thing like below, and replace firstd, secondd, thirdd values within the extension with the computed results. define stream health_second_der_concat (cluster_id, cluster_instance_id, network_partition_id, value ) define stream health_second_der_concat_temp (cluster_id, cluster_instance_id, network_partition_id, value, firstd double, secondd double, thirdd double) from health_second_der_concat select cluster_id, cluster_instance_id, network_partition_id, 0.0 as firstd, 0.0 as secondd, 0.0 as thirdd insert into health_second_der_concat_temp from health_second_der_concat_temp [health_description == 'memory_consumption'] *#window.stratos:secondDerivative(1 min, value, *firstd, secondd, thirdd*)* select * insert into second_derivative_memory_consumption_stats partition by health_second_der_cluster_partition; On Tue, Aug 11, 2015 at 7:18 PM, Pranavan Theivendiram pranavan...@cse.mrt.ac.lk wrote: Hi Suho, The following is sample execution plan query. Here we are getting one result as value. Can I get three values using this kind of queries? *The Query* [1] https://github.com/apache/stratos/blob/master/extensions/cep/artifacts/executionplans/SecondDerivativeOfHealthRequest.xml from health_second_der_concat [health_description == 'memory_consumption'] *#window.stratos:secondDerivative(1 min, value)* select cluster_id, cluster_instance_id, network_partition_id, value as second_derivative_memory_consumption insert into second_derivative_memory_consumption_stats partition by health_second_der_cluster_partition; *The annotation in SecondDerivativeWindowProcessor* [2] https://github.com/apache/stratos/blob/master/extensions/cep/stratos-cep-extension/src/main/java/org/apache/stratos/cep/extension/SecondDerivativeFinderWindowProcessor.java @SiddhiExtension(namespace = stratos, function = secondDerivative) Here they are getting only one value. Can you point me out a way that I can have all three here? Thanks *T. Pranavan* *BSc Eng Undergraduate| Department of Computer Science Engineering ,University of Moratuwa* *Mobile| *0775136836 On 9 August 2015 at 09:27, Sriskandarajah Suhothayan s...@wso2.com wrote: Thats possible, you have to have 3 dummy fields on the input stream which you can populate at the window with the coefficients and output the events. Let me know if there are specific issues Suho On Sun, Aug 9, 2015 at 8:46 AM, Pranavan Theivendiram pranavan...@cse.mrt.ac.lk wrote: Hi Suho, In my case, I am generating a second order polynomial(Three coefficients). I am taking inputs of a 10 minute window.(A sliding window- every one minute , the window will be get update. New events will come into the window and the oldest events will get removed from the window) Thanks *T. Pranavan* *BSc Eng Undergraduate| Department of Computer Science Engineering ,University of Moratuwa* *Mobile| *0775136836 On 9 August 2015 at 08:40, Sriskandarajah Suhothayan s...@wso2.com wrote: Time window is to buffer events and expire based on some condition (time/length/etc), its not for creating new attributes by default. here the expired events are generated to inform the other processes the event have expired and hence they can do adjust their calculations based on that. If you dont have a avg() kind of aggregate functions on select then you dont need to send expired events. For you predictions how many inputs you have (input attributes used for production) and how many outputs will be generated (is it only one co efficient value)? If you are generating one value then you have to extend an Output aggregator. e.g.[1] Suho [1] https://svn.wso2.org/repos/wso2/carbon/platform/branches/turing/dependencies/commons/siddhi/2.0.0-wso2v5/modules/siddhi-core/src/main/java/org/wso2/siddhi/core/query/selector/attribute/handler/avg/AvgOutputAttributeAggregatorDouble.java On Sat, Aug 8, 2015 at 5:14 PM, Pranavan Theivendiram pranavan...@cse.mrt.ac.lk wrote: Hi All, I am working on writing a custom TimeWindowProcessor (SlidingWindow) to handle the curvefitting prediction. I followed the this implementation [1] and referred this documentation[2]. In my case, I need to get the events received during the 10 mins and use it for the calculation of the curve fitting and set the co efficient of curve fitting as a event. I am finding it hard to understand how the input events will reach the window processors and how the output events are passed throughout and what is the purpose of the processevent method. Processevent method is called in the run method on the expired events in the TimeWindowProcessor class. But that is not the case I wanted. I want to simply remove the expired events, but rather calculate the curve coefficients on active events and to send the coefficient as output events. I am bit confused in flow and out flow to the TimeWindowProcessor class. If anyone can directly point out the input events
[Dev] Error when building Product-bam
Hi, i try to build latest DAS version from the master repo. but i got the following error. Does anyone know how to overcome this? Installation failed. The installable unit org.wso2.carbon.analytics.common.jmx.agent.feature.group/2.0.0.SNAPSHOT has not been found. Application failed, log file location: /home/rukshan/.m2/repository/org/eclipse/tycho/tycho-p2-runtime/0.13.0/eclipse/configuration/1439312226055.log [INFO] [INFO] Reactor Summary: [INFO] [INFO] WSO2 Data Analytics Server . SUCCESS [ 0.528 s] [INFO] WSO2 Data Analytics Server - Multi-tenant Dashboard SUCCESS [ 3.312 s] [INFO] WSO2 Data Analytics Server - Styles Parent . SUCCESS [ 0.018 s] [INFO] WSO2 Data Analytics Server - Product UI Styles . SUCCESS [ 1.746 s] [INFO] WSO2 Data Analytics Server - Multi-tenant UI Styles SUCCESS [ 1.018 s] [INFO] WSO2 Data Analytics Server - Features Parent ... SUCCESS [ 0.018 s] [INFO] WSO2 Data Analytics Server - Features .. SUCCESS [ 0.019 s] [INFO] WSO2 Data Analytics Server - Product Style Feature . SUCCESS [ 0.820 s] [INFO] WSO2 Data Analytics Server - Multi-tenant-Features . SUCCESS [ 0.022 s] [INFO] WSO2 Data Analytics Server - Multi-tenant Style Feature SUCCESS [ 1.141 s] [INFO] WSO2 Data Analytics Server - Multi-tenant Dashboard Feature SUCCESS [ 1.182 s] [INFO] WSO2 Data Analytics Server - Profile Generation FAILURE [ 21.677 s] [INFO] WSO2 Data Analytics Server - Samples ... SKIPPED [INFO] WSO2 Data Analytics Server - Sample Data Publishers SKIPPED [INFO] WSO2 Data Analytics Server - Sample Composite Applications SKIPPED [INFO] WSO2 Data Analytics Server - Distribution .. SKIPPED [INFO] WSO2 Data Analytics Server - Integration Tests . SKIPPED [INFO] WSO2 Data Analytics Server - Integration Test Common Module SKIPPED [INFO] WSO2 Data Analytics Server - Integration Test UI Pages SKIPPED [INFO] WSO2 Data Analytics Server - Integration Test Common Utils Module SKIPPED [INFO] WSO2 Data Analytics Server - Integration Test Module SKIPPED [INFO] WSO2 Data Analytics Server - Integration Test UI ... SKIPPED [INFO] WSO2 Data Analytics Server - Integration UI SKIPPED Thanks and Regards. -- Rukshan Chathuranga. Software Engineer. WSO2, Inc. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] carbon-registry 4.4.5 release
HI all, Since carbon-registry-4.4.5 works fine releasing it. Thanks On Tue, Aug 11, 2015 at 6:05 PM, Ayesha Dissanayaka aye...@wso2.com wrote: Hi Prasanna, I've tested ES pack with carbon-registry 4.4.5. Works fine. Thanks! -Ayesha On Tue, Aug 11, 2015 at 5:57 PM, Prasanna Dangalla prasa...@wso2.com wrote: Hi Ayesha, You have to update the governance version into 4.5.2-SNAPSHOT. Thanks, On Tue, Aug 11, 2015 at 5:46 PM, Ayesha Dissanayaka aye...@wso2.com wrote: Hi Prasanna, Search is not working properly with ES. Issue mentioned in thread [1]. [1] [Dev] Registry search doesn't return the expected results with combinations of space and * Thanks! -Ayesha On Tue, Aug 11, 2015 at 5:33 PM, Inosh Goonewardena in...@wso2.com wrote: Correction: class loading issue is no longer there. On Tue, Aug 11, 2015 at 5:30 PM, Inosh Goonewardena in...@wso2.com wrote: Hi Prasanna, On Tue, Aug 11, 2015 at 11:50 AM, Gokul Balakrishnan go...@wso2.com wrote: Sure Prasanna. We'll trigger fresh builds for DAS with this repo and check. On 11 August 2015 at 11:28, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, carbon-registry-4.4.5 release is uploaded to the nexus staging repo. [1]. @Anjana/Manu/UdaraR please verify your fixes adding the following repository[1]. We'll release it from the staging repo once you have verified. I have tested and class loading issue is longer there. [1] - http://maven.wso2.org/nexus/content/repositories/orgwso2carbonregistry-012/ Thanks On Tue, Aug 11, 2015 at 10:25 AM, Prasanna Dangalla prasa...@wso2.com wrote: Hi all, I started the release prepare. As per the discussions had yesterday releasing with carbon-commons 4.4.4. Thanks Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 -- Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Gokul Balakrishnan Senior Software Engineer, WSO2, Inc. http://wso2.com Mob: +94 77 593 5789 | +1 650 272 9927 -- Thanks Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317 -- Thanks Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Ayesha Dissanayaka* Software Engineer, WSO2, Inc : http://wso2.com http://www.google.com/url?q=http%3A%2F%2Fwso2.comsa=Dsntz=1usg=AFQjCNEZvyc0uMD1HhBaEGCBxs6e9fBObg 20, Palmgrove Avenue, Colombo 3 E-Mail: aye...@wso2.com ayshsa...@gmail.com -- Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 -- *Ayesha Dissanayaka* Software Engineer, WSO2, Inc : http://wso2.com http://www.google.com/url?q=http%3A%2F%2Fwso2.comsa=Dsntz=1usg=AFQjCNEZvyc0uMD1HhBaEGCBxs6e9fBObg 20, Palmgrove Avenue, Colombo 3 E-Mail: aye...@wso2.com ayshsa...@gmail.com -- Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] carbon-governance-4.5.2 release
Hi all, I started the release prepare. As per the discussions had yesterday releasing with carbon-commons 4.4.4 and released carbon-registry-4.4.5. Thanks Prasanna Dangalla Software Engineer, WSO2, Inc.; http://wso2.com/ lean.enterprise.middleware cell: +94 777 55 80 30 | +94 718 11 27 51 twitter: @prasa77 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] AXIOM issue in File Connector
Hi, I was checking the ESB File connector and found the following issue. In file connector we open the input stream to read the file and close it in the finally block. We are using the builder based on the content-type or file type. However expected behavior with axiom is it'll only build the structure at the time of consuming. This may happen later in the mediation flow or when sending the message. But by that time stream is already closed and only part of the message will be send. In order to fix this I have checked by adding [1]. This works for some files. However if there are large files and when using relaybuilder issue still exists. I have added [2] and it seems to be working fine. But this is not the best solution. Any idea about this? [1] documentElement.build(); [2] documentElement.toString(); Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ http://wso2.com/about/team/malaka-silva/ Save a tree -Conserve nature Save the world for your future. Print this email only if it is absolutely necessary. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Simple Tool to analyse jar files for packages they contains and OSGI bundles to see packages they export and import
Hi All, I have created a small java tool [1] to analyse OSGI bundles and analyse all kinds of jar files. Basically did this for two reasons. 1) When adopting the OSGI best practices, needed to find out whether final outcome of bundle contains correct information. (For this MetaInfoExtractor.java class can be used) 2) When debugging applications sometimes need to find what are the packages it contains. (This is not that important. but I faced with a situation where I couldn't find the bundle which contains specific package. So to resolve that created JarFileExtractor.java class) We can specify a jarFolderToBeAnalysed and tempFolder folder in the tool. What it does is, copy each and every jar inside jarFolderToBeAnalysed folder(Iterate through whole folder structure) to the tempFolder folder, analyse them inside tempFolder folder and create text files with the jar name in it. Note that this is a basic tool so you need to open that in a IDE and run it (Need to modify to work in CLI) Hope this will help people who faced with similar issues [1] - https://github.com/lankavitharana/JarAnalyser Thanks, -- Rajith Vitharana Software Engineer, WSO2 Inc. : wso2.com Mobile : +94715883223 Blog : http://lankavitharana.blogspot.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DEV][APPM] Can't call WebApps in Appm Internal deployment
Hi all,
I am setting up an APPM internal deployment with following components.
VM 1 : Store, Publisher, Gateway, IDP, svn
VM2 : Store, Publisher, Gateway, IDP, nginx, mysql server
Upto Now, environment has set up. But when I call webapp via gateway,, I
get following exception in gateway worker node.
TID: [0] [AM] [2015-08-12 03:01:08,700] ERROR
{org.apache.axis2.transport.base.threads.NativeWorkerPool} - Uncaught
exception {org.apache.axis2.transport.base.threads.NativeWorkerPool}
java.lang.NullPointerException
at
org.wso2.carbon.appmgt.gateway.handlers.security.saml2.SAML2AuthenticationHandler.isAllowAnonymousApplication(SAML2AuthenticationHandler.java:355)
at
org.wso2.carbon.appmgt.gateway.handlers.security.saml2.SAML2AuthenticationHandler.handleRequest(SAML2AuthenticationHandler.java:174)
at org.apache.synapse.rest.API.process(API.java:284)
at
org.apache.synapse.rest.RESTRequestHandler.dispatchToAPI(RESTRequestHandler.java:83)
at
org.apache.synapse.rest.RESTRequestHandler.process(RESTRequestHandler.java:64)
at
org.apache.synapse.core.axis2.Axis2SynapseEnvironment.injectMessage(Axis2SynapseEnvironment.java:220)
at
org.apache.synapse.core.axis2.SynapseMessageReceiver.receive(SynapseMessageReceiver.java:83)
at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
at
org.apache.synapse.transport.passthru.ServerWorker.processNonEntityEnclosingRESTHandler(ServerWorker.java:344)
at
org.apache.synapse.transport.passthru.ServerWorker.run(ServerWorker.java:168)
at
org.apache.axis2.transport.base.threads.NativeWorkerPool$1.run(NativeWorkerPool.java:172)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Is there any known reason for this?
Thanks,
--
Lakshani Gamage
*Software Engineer*
Mobile : +94 (0) 71 5478184 %2B94%20%280%29%20773%20451194
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV][APPM] Can't call WebApps in Appm Internal deployment
Hi,
It seems you have secured the App and trying to access it anonymously. Try
allowing anonymous access to the App .
Regards
On Wed, Aug 12, 2015 at 10:10 AM, Lakshani Gamage laksh...@wso2.com wrote:
Hi all,
I am setting up an APPM internal deployment with following components.
VM 1 : Store, Publisher, Gateway, IDP, svn
VM2 : Store, Publisher, Gateway, IDP, nginx, mysql server
Upto Now, environment has set up. But when I call webapp via gateway,, I
get following exception in gateway worker node.
TID: [0] [AM] [2015-08-12 03:01:08,700] ERROR
{org.apache.axis2.transport.base.threads.NativeWorkerPool} - Uncaught
exception {org.apache.axis2.transport.base.threads.NativeWorkerPool}
java.lang.NullPointerException
at
org.wso2.carbon.appmgt.gateway.handlers.security.saml2.SAML2AuthenticationHandler.isAllowAnonymousApplication(SAML2AuthenticationHandler.java:355)
at
org.wso2.carbon.appmgt.gateway.handlers.security.saml2.SAML2AuthenticationHandler.handleRequest(SAML2AuthenticationHandler.java:174)
at org.apache.synapse.rest.API.process(API.java:284)
at
org.apache.synapse.rest.RESTRequestHandler.dispatchToAPI(RESTRequestHandler.java:83)
at
org.apache.synapse.rest.RESTRequestHandler.process(RESTRequestHandler.java:64)
at
org.apache.synapse.core.axis2.Axis2SynapseEnvironment.injectMessage(Axis2SynapseEnvironment.java:220)
at
org.apache.synapse.core.axis2.SynapseMessageReceiver.receive(SynapseMessageReceiver.java:83)
at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
at
org.apache.synapse.transport.passthru.ServerWorker.processNonEntityEnclosingRESTHandler(ServerWorker.java:344)
at
org.apache.synapse.transport.passthru.ServerWorker.run(ServerWorker.java:168)
at
org.apache.axis2.transport.base.threads.NativeWorkerPool$1.run(NativeWorkerPool.java:172)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Is there any known reason for this?
Thanks,
--
Lakshani Gamage
*Software Engineer*
Mobile : +94 (0) 71 5478184 %2B94%20%280%29%20773%20451194
--
Yasassri Ratnayake
Software Engineer - QA
WSO2 Inc ; http://wso2.com
lean.enterprise.middleware
*Mobile : +94715933168*
*Blogs : http://yasassriratnayake.blogspot.com
http://yasassriratnayake.blogspot.com/*
*http://wso2logs.blogspot.com http://wso2logs.blogspot.com*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] unknown directive sticky when configuring Nginx
Hi,
I got the following error message when following [1] for Nignx
configuration.
$ sudo service nginx status
● nginx.service - A high performance web server and a reverse proxy server
Loaded: loaded (/lib/systemd/system/nginx.service; enabled)
Active: active (running) (Result: exit-code) since Wed 2015-08-12
10:12:56 IST; 25min ago
Process: 29227 ExecReload=/usr/sbin/nginx -g daemon on; master_process
on; -s reload (code=exited, status=1/FAILURE)
Process: 28190 ExecStart=/usr/sbin/nginx -g daemon on; master_process on;
(code=exited, status=0/SUCCESS)
Process: 28187 ExecStartPre=/usr/sbin/nginx -t -q -g daemon on;
master_process on; (code=exited, status=0/SUCCESS)
Main PID: 28191 (nginx)
CGroup: /system.slice/nginx.service
├─28191 nginx: master process /usr/sbin/nginx -g daemon on;
master_process on;
├─28192 nginx: worker process
├─28193 nginx: worker process
├─28194 nginx: worker process
└─28195 nginx: worker process
Aug 12 10:37:45 udarapc *nginx[29227]: nginx: [emerg] unknown directive
sticky in /etc/nginx/conf.d/is-wso2.conf:6*
Aug 12 10:37:45 udarapc systemd[1]: nginx.service: control process exited,
code=exited status=1
Aug 12 10:37:45 udarapc systemd[1]: Reload failed for A high performance
web server and a reverse proxy server.
Below is my Nginx configuration.
*is-wso2.conf content*
upstream ssl.wso2.as.com {
server 127.0.0.1:9443;
sticky learn create=$upstream_cookie_jsessionid
lookup=$cookie_jsessionid
zone=client_sessions:1m;
}
server {
listen 443;
server_name is.wso2.com;
ssl on;
ssl_certificate /etc/nginx/ssl/is.wso2.com.crt;
ssl_certificate_key /etc/nginx/ssl/is.wso2.com.key;
location / {
proxy_set_header X-Forwarded-Host $host;
proxy_set_header X-Forwarded-Server $host;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header Host $http_host;
proxy_read_timeout 5m;
proxy_send_timeout 5m;
proxy_pass https://ssl.wso2.is.com;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection upgrade;
}
}
[1] https://docs.wso2.com/display/CLUSTER420/Configuring+NGINX+Plus
--
Udara Liyanage
Software Engineer
WSO2, Inc.: http://wso2.com
lean. enterprise. middleware
web: http://udaraliyanage.wordpress.com
phone: +94 71 443 6897
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [APIM-1.9.0] Add external API Stores
Hi Pubudu, You have to set the className when adding a external store in APIM 1.9.0. so when you are adding your configuration to api-manager.xml make sure you have set the className. ExternalAPIStore id=Store1 type=wso2 className=org.wso2.carbon.apimgt.impl.publishers.WSO2APIPublisher Thanks, Sam On Tue, Aug 11, 2015 at 9:57 AM, Pubudu Gunatilaka pubu...@wso2.com wrote: Hi, I was able to do the $subject by following [1]. In this approach configuration resides in the registry. I found another way of adding external API Stores which is used in API Manager 1.6.0 in [2]. I followed the same steps in API Manager 1.9.0. Although it list down external stores in the publisher, I am getting following error when trying to store an api. *ERROR - external:jag java.lang.NullPointerException: null* Does this second approach[2] support in API Manager 1.9.0? My intention is to automate of adding external API Stores. Therefore it is needed to add from configuration files rather than using registry resources. Is there any other approach I can follow? [1] - https://docs.wso2.com/display/AM190/Publish+to+multiple+external+API+stores [2] - https://docs.wso2.com/display/AM160/Publishing+to+API+Stores Thank you! -- *Pubudu Gunatilaka* Software Engineer WSO2, Inc.: http://wso2.com lean.enterprise.middleware mobile: +94 77 4078049 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Sam Sivayogam* Software Engineer Mobile : +94 772 906 439 Office : +94 112 145 345 *WSO2, Inc. :** wso2.com http://wso2.com/* lean.enterprise.middleware. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] How can we pass parameters to WSO2 identity server Assertion Consumer URL
Hi, As explained in the SOF answer, you can use RelayState parameter for this purpose. In the SSO agent provided in WSO2 IS samples, there is a properties file for SSO configuration in each webapp. For eg: in travelocity.com sample [1], you can find SSO related configuration in travelocity.properties file in travelocity.com/WEB-INF/classes dir. There is a property named SAML.Request.Query.Param that you can use to pass additional parameters in HTTP URI format. If you need to pass dynamic parameters you will have to modify the SSO agent code [2]. [1] https://docs.wso2.com/display/IS500/Configuring+Single+Sign-On+with+SAML+2.0 [2] http://svn.wso2.org/repos/wso2/carbon/platform/branches/turing/products/is/5.0.0/modules/samples/sso/ Thanks. On Mon, Aug 10, 2015 at 4:31 PM, Akila Nimantha [IT/EKO/LOITS] aki...@lolctech.com wrote: Dear All, How can we pass parameters to WSO2 identity server Assertion Consumer URL. That means we need to get some parameters at the initial login to the web application. We found that we can use “RelayState” in the below URL but couldn’t find any example or sample code for this. http://stackoverflow.com/questions/23884307/how-to-pass-query-parameters-to-web-page-after-saml-sso-redirect-by-wso2-identit Regards, Akila Rathnayake Software Engineer This message (including any attachments) is intended only for the use of the individual or entity to which it is addressed and may contain information that is non-public, proprietary, privileged, confidential, and exempt from disclosure under applicable law or may constitute as attorney work product. If you are not the intended recipient, you are hereby notified that any use, dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, notify us immediately by telephone and (i) destroy this message if a facsimile or (ii) delete this message immediately if this is an electronic communication. Thank you. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Akila Ravihansa Perera WSO2 Inc.; http://wso2.com/ Blog: http://ravihansa3000.blogspot.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Load test for File Connector
Hi Viraj, Thank you *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138* On Tue, Aug 11, 2015 at 8:17 PM, Viraj Senevirathne vir...@wso2.com wrote: hi Vivek, This is a nice tutorial [1] about jmeter which I used to learn jmeter. Hope this help you too. [1] http://www.guru99.com/jmeter-performance-testing.html Thanks, On Tue, Aug 11, 2015 at 12:07 PM, Vivekananthan Sivanayagam vivekanant...@wso2.com wrote: Hi Malaka, Thank you. *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138 %2B94752786138* On Tue, Aug 11, 2015 at 12:01 PM, Malaka Silva mal...@wso2.com wrote: You can use soap ui or jmeter for this purpose. You can use console for monitoring [2] [1] http://www.soapui.org/Getting-Started/load-testing.html [2] http://docs.oracle.com/javase/6/docs/technotes/guides/management/jconsole.html On Tue, Aug 11, 2015 at 11:43 AM, Vivekananthan Sivanayagam vivekanant...@wso2.com wrote: Hi, I need to do the load testing for the operations(decompress file,read content inside compressed file and add file inside compressed folder) of the file connector. How can I do that? Any suggestion? *Thank youVivekananthan Sivanayagam* *Associate Software Engineer | WSO2* *E:vivekanant...@wso2.com e%3avivekanant...@wso2.com* *M:+94752786138 %2B94752786138* -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ http://wso2.com/about/team/malaka-silva/ Save a tree -Conserve nature Save the world for your future. Print this email only if it is absolutely necessary. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Viraj Senevirathne Software Engineer; WSO2, Inc. Mobile : +94 71 818 4742 %2B94%20%280%29%20773%20451194 Email : vir...@wso2.com thili...@wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
