[Architecture] Machine Learning using Apache Mahout for WSO2 BAM

2014-06-30 Thread Supun Sethunga
. The first step is completed for now. Any feedback is highly appreciated. Thanks, Supun -- *Supun Sethunga* Software Engineer WSO2, Inc. lean | enterprise | middleware Mobile : +94 716546324 ___ Architecture mailing list Architecture@wso2.org https://mail.wso2

Re: [Architecture] Machine Learning using Apache Mahout for WSO2 BAM

2014-07-23 Thread Supun Sethunga
, to a result there. A similar scenario is possible in Shark/MLlib integration. Cheers, Anjana. On Mon, Jun 30, 2014 at 12:28 PM, Supun Sethunga sup...@wso2.com wrote: Hi, Im working on the $subject, and the objective is to apply Machine Learning algorithms on the data stored by WSO2 BAM

Re: [Architecture] Machine Learning using Apache Mahout for WSO2 BAM

2014-07-23 Thread Supun Sethunga
for the purpose? Can explain a bit how it's done? On Wed, Jul 23, 2014 at 5:30 PM, Supun Sethunga sup...@wso2.com wrote: Hi, The back-end service for the $subject has been implemented. For the time being, it supports three algorithms (Naive Bayes, Logistic Regression and Multilayer

[Architecture] Sample Scenario of Machine Learning - With '0xdata'

2014-08-08 Thread Supun Sethunga
Hi, Attached is a sample end-to-end scenario on using 0xdata for Machine Learning. ​ Machine learning with 0xData - Sample Scenario https://docs.google.com/a/wso2.com/presentation/d/1Big1ul5Af7QA5yfycRpPMOoP7xvyoGZ3Alcf3X3Gfpc/edit?usp=drive_web ​ Regards, Supun -- *Supun Sethunga* Software

[Architecture] Machine Learning Workflow

2014-08-12 Thread Supun Sethunga
Hi Srinath, Attached is a proposed work-flow for the ML design came up by Lochana, Upul and me. Appreciate any comments. Regards, Supun -- *Supun Sethunga* Software Engineer WSO2, Inc. lean | enterprise | middleware Mobile : +94 716546324

Re: [Architecture] WSO2 Machine Learner - Project Concept

2014-10-29 Thread Supun Sethunga
On Wed, Oct 29, 2014 at 11:54 AM, Supun Sethunga sup...@wso2.com wrote: Hi, Follow are the features of the project concept of WSO2 ML. - Users start working on a data-set by creating a project, and importing a data-set to the project. - Project can have only one data-set

Re: [Architecture] ESB Mediator for WSO2 Machine Learner

2015-03-24 Thread Supun Sethunga
___ Architecture mailing list Architecture@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture ___ Architecture mailing list Architecture@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture -- *Supun Sethunga

[Architecture] WSO2 ML 1.0.0 Milestone 1 Released

2015-03-23 Thread Supun Sethunga
Flows - https://docs.wso2.com/display/ML100/Samples Please report any issues you may find in our Jira https://wso2.org/jira/browse/ML [1] https://github.com/wso2/product-ml/releases/download/1.0.0-m1/wso2ml-1.0.0-SNAPSHOT.zip Regards, -- *Supun Sethunga* Software Engineer WSO2, Inc. http://wso2

Re: [Architecture] ML Model Summary Illustration and Comparison

2015-04-30 Thread Supun Sethunga
[-strategy@, +architecture@] On Thu, Apr 30, 2015 at 5:58 PM, Srinath Perera srin...@wso2.com wrote: should go to arch@ On Thu, Apr 30, 2015 at 6:28 AM, Srinath Perera srin...@wso2.com wrote: Thanks Supun!! this looks good. --Srinath On Thu, Apr 30, 2015 at 6:25 AM, Supun Sethunga sup

Re: [Architecture] ML Model Summary Illustration and Comparison

2015-04-30 Thread Supun Sethunga
:33 AM, Supun Sethunga sup...@wso2.com wrote: [-strategy@, +architecture@] On Thu, Apr 30, 2015 at 5:58 PM, Srinath Perera srin...@wso2.com wrote: should go to arch@ On Thu, Apr 30, 2015 at 6:28 AM, Srinath Perera srin...@wso2.com wrote: Thanks Supun!! this looks good. --Srinath

Re: [Architecture] Time Series using Apache Spark

2015-08-12 Thread Supun Sethunga
/spark-timeseries/blob/master/src/main/scala/com/cloudera/sparkts/ARIMA.scala [2] https://docs.google.com/a/wso2.com/document/d/1pcGT620Fjms9gxmyn85mNP93oye_5xxCBhtqvE6iAAw/edit?usp=sharing Thanks, Supun On Wed, Jul 29, 2015 at 2:21 AM, Supun Sethunga sup...@wso2.com wrote: Sure Srinath

Re: [Architecture] Time Series using Apache Spark

2015-08-13 Thread Supun Sethunga
, as the data arrives. Is that possible to take the code from the project to do #3 as well? --Srinath On Thu, Aug 13, 2015 at 3:39 AM, Supun Sethunga sup...@wso2.com wrote: [Moving the discussion to arch@] Hi all, I looked into their code and infact they do have ARIMA implementation [1

[Architecture] Spark Pipeline Support for ML

2016-01-18 Thread Supun Sethunga
ark.client_2/src/main/java/SVMClassifier.java Regards, Supun -- *Supun Sethunga* Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise | middleware Mobile : +94 716546324 ___ Architecture mailing list Architecture@wso2.org https://mail.wso2.or

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-09 Thread Supun Sethunga
9', > 'payload': '*payload2*', > 'componentName': 'Proxy:TestProxy', > 'output-payload':'*payload2*' > }], > > 'payloads': { > '*payload1*': 'xml-payload-1', > '*payload2*': 'xml-payload-2', > } > } > > Thanks, > Sinthuja. > > On Wed, Feb 10, 2016 a

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-09 Thread Supun Sethunga
e message > payload. We can store the payload only for the mediators which alter the > message payload. And for others, we can put a reference to the previous > entry. By doing that we can save the memory to a great extent. > > Thanks. > > >> >> -- Forwarded m

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-09 Thread Supun Sethunga
t; > On Wed, Feb 10, 2016 at 11:26 AM, Sinthuja Ragendran <sinth...@wso2.com> > wrote: > >> Hi Supun, >> >> >> On Wed, Feb 10, 2016 at 11:14 AM, Supun Sethunga <sup...@wso2.com> wrote: >> >>> Hi Sinthuja, >>> >>> Agree on the

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-24 Thread Supun Sethunga
yze. > > Sanjiva. > > On Wed, Feb 24, 2016 at 2:48 PM, Supun Sethunga <sup...@wso2.com> wrote: > >> Hi Sanjiva, >> >> Yes we are indeed using a stream definition and publishing the events >> using Thrift. >> >> But in doing so, there were two

[Architecture] [ESB Analytics] Managing stats/graphs when Proxy/API is updated

2016-02-29 Thread Supun Sethunga
e on to let the user pick which version they want to view) Please let us know whether we can go with this approach, or if there are any concerns. [1] https://docs.google.com/document/d/15BdqOkQFZFYsfF0x7x4amgaIhZGoHkIwgKOoSI83ZzI/edit#heading=h.3nul0izb3nne Regards, Supun -- *Supun Sethung

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-24 Thread Supun Sethunga
, Sanjiva Weerawarana <sanj...@wso2.com> wrote: > Why are we inventing a new event format for this? Why not use a stream > definition and publish using Thrift? > > Sorry if I'm missing something here. > > On Fri, Feb 19, 2016 at 11:44 AM, Supun Sethunga <sup...@wso2.com>

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-15 Thread Supun Sethunga
beforePayload": null, "afterPayload": null, "contextPropertyMap": null, "transportPropertyMap": null, "children": 0, "entryPoint": "Test Proxy" }], "payloads": [{ "payload": "http://www.w3.org/2003/05/so

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-16 Thread Supun Sethunga
on.Constants.JSON_STRING" >- Supun, according to the stream definition ""children": 1," what it >represents ? > > > On Mon, Feb 15, 2016 at 9:15 PM, Supun Sethunga <sup...@wso2.com> wrote: > >> Hi Dunith, Gihan, >> >> As per th

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-18 Thread Supun Sethunga
data > communication. > > Will it be possible to define new type like "commpressedJSON" to achive > this? WDYT about this idea? > > Thank You, > > On Wed, Feb 17, 2016 at 9:38 AM, Supun Sethunga <sup...@wso2.com> wrote: > >> Hi Dushan, >> >> Supun, acc

Re: [Architecture] [ESB Analytics] Managing stats/graphs when Proxy/API is updated

2016-03-01 Thread Supun Sethunga
, Supun On Mon, Feb 29, 2016 at 5:56 PM, Supun Sethunga <sup...@wso2.com> wrote: > Hi all, > > We have run into few complications with respect to $subject. Let me > briefly explain the scenario. > > Currently ESB is sending a Unique message flow ID, Mediator index > (med

[Architecture] [esb-analytics] Individual Message Search

2016-03-29 Thread Supun Sethunga
like to know, when we are purging the raw data in DAS (say, per-event-data came few months back), does it also clear any indexed information as well, which originated from the purged data? Regards, Supun -- *Supun Sethunga* Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise

Re: [Architecture] [esb-analytics] Individual Message Search

2016-03-30 Thread Supun Sethunga
-envelope <http://www.w3.org/2003/05/soap-envelope>">* ** ** As you can see, the body is not there. So a user cannot really search for a message, at the proxy page (didn't test with a API though). Can you please have a look? Thanks, Supun On Wed, Mar 30, 2016 at 8:48 AM, Supun S

Re: [Architecture] [esb-analytics] Individual Message Search

2016-03-30 Thread Supun Sethunga
y empty soap envelope. For pass-through scenarios you can > observe the same. > > Thank You, > > On Wed, Mar 30, 2016 at 11:38 AM, Supun Sethunga <sup...@wso2.com> wrote: > >> Hi Viraj/Buddhima, >> >> When doing $subject, I noticed that for a message coming to a prox

Re: [Architecture] [esb-analytics] Individual Message Search

2016-03-29 Thread Supun Sethunga
o the index data as well will > be deleted. > > Cheers, > Anjana. > > On Tue, Mar 29, 2016 at 10:48 PM, Supun Sethunga <sup...@wso2.com> wrote: > >> Hi all, >> >> As came-up during previous meetings, there was a requirement to do >> $subj

Re: [Architecture] Deployable Artifact Model

2016-03-31 Thread Supun Sethunga
m/a/wso2.com/spreadsheets/d/1Lm5xSmXOG1dDEXGPOthI7nnsjwjKt-apwj77SjxB3Fg/edit?usp=sharing > > -- > *Nethaji Chandrasiri* > *Software Engineering* *Intern; WSO2, Inc.; http://wso2.com > <http://wso2.com/>* > Mobile : +94 (0) 779171059 <%2B94%20%280%29%20778%20800570> > Email : neth...@ws

[Architecture] [analytics-esb] Summary Stat Generation Mechanism

2016-04-20 Thread Supun Sethunga
*. As a further improvement, we would be trying out to do summarizing upto minute/hour level (eventually do all the summarizing using siddhi). [1] [Dev] ESB Analytics - Verifying the common production use cases [2] https://wso2.org/jira/browse/ANLYESB-15 Thanks, Supun -- *Supun Sethunga* Software

Re: [Architecture] [VOTE] Release WSO2 Machine Learner 1.1.1 RC1

2016-08-01 Thread Supun Sethunga
[-] Calling off the vote as we have encountered some issues with the ml ui jaggery app. url mappings are broken. We will start a new vote soon. Regards, Supun On Sat, Jul 30, 2016 at 8:30 AM, Supun Sethunga <sup...@wso2.com> wrote: > Hi Devs, > > This is the 1st Release Candid

[Architecture] [VOTE] Release WSO2 Machine Learner 1.1.1 RC1

2016-07-29 Thread Supun Sethunga
=13175 [3] *https://github.com/wso2/product-ml/releases/tag/v1.1.1-rc1 <https://github.com/wso2/product-ml/releases/tag/v1.1.1-rc1>* Please vote as follows. [+] Stable - go ahead and release [-] Broken - do not release (please explain why) Thanks, WSO2 ML Team -- *Supun Sethunga* Senior So

Re: [Architecture] APIM Analytics - Performance Results

2016-08-19 Thread Supun Sethunga
, Sanjeewa Malalgoda <sanje...@wso2.com> wrote: > > > On Tue, Aug 16, 2016 at 10:43 PM, Harsha Kumara <hars...@wso2.com> wrote: > >> >> >> On Tue, Aug 16, 2016 at 5:29 PM, Supun Sethunga <sup...@wso2.com> wrote: >> >>> Hi all, >>

[Architecture] APIM Analytics - Performance Results

2016-08-16 Thread Supun Sethunga
template, including the advanced details about the setups and the configs. [1] https://docs.google.com/spreadsheets/d/1vVRPp8b31DccJ1A6p9MRGxzmLAX2yiGAebT25kpsLzg/edit#gid=0 Regards, Supun -- *Supun Sethunga* Senior Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise | middleware

[Architecture] [VOTE] Release WSO2 Machine Learner 1.2.0 RC1

2016-09-06 Thread Supun Sethunga
.org/jira/issues/?filter=13325 [3] https://github.com/wso2/product-ml/releases/tag/v1.2.0-rc1 Please vote as follows. [+] Stable - go ahead and release [-] Broken - do not release (please explain why) Thanks, WSO2 ML Team -- *Supun Sethunga* Senior Software Engineer WSO2, Inc. http://wso2.com

[Architecture] Training ML Models with Python on DAS/Analytics Tables

2016-09-14 Thread Supun Sethunga
, and then train sklearn algorithms on top of that. A sample python script can b found at [1]. [1] https://github.com/SupunS/play-ground/blob/master/pyspark/PySpark-Sample.ipynb -- *Supun Sethunga* Senior Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise | middleware Mobile : +94

Re: [Architecture] Training ML Models with Python on DAS/Analytics Tables

2016-09-14 Thread Supun Sethunga
p 15, 2016 at 11:23 AM, Supun Sethunga <sup...@wso2.com> wrote: > Yes, python script also works, without the notebook. > > in python script (.py) scenario, there will be no sparkContext created by > default. Can run the scipt as follows: > > > On Thu, Sep 15, 2016 at 9:55

Re: [Architecture] [Progress] Use Machine Learning for Predictive Maintenance

2016-09-19 Thread Supun Sethunga
ngineer* > *WSO2* > m: 0715894672 > a: No 3/56, Aluthgama Rd, Elpitiya. > e: rosh...@wso2.com > <https://web.facebook.com/alwisroshan> <https://twitter.com/rm_alwis> > <https://lk.linkedin.com/in/roshanalwis> > > > _

[Architecture] WSO2 Machine Learner (ML) 1.2.0 Released!

2016-09-15 Thread Supun Sethunga
eers who build the technology. For more details and to take advantage of this unique opportunity please visit http://wso2.com/support. Regards, ~ WSO2 ML Team ~ -- *Supun Sethunga* Senior Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise | middleware Mobile : +94