Hi Srinath and Nirmal, I have integrated the my samoa predictive analysis topologies with the cep with siddhi extension developed. As you asked me, i have verified the output of my samoa streaming clustering topology with the previously build Spark streaming Clustering analysis. Results are almost same and is converging. As a example if i used two algorithms spark mini-batch clustering and samoa kernal clustering for streaming clustering analysis outcomes are as follows in my streaming extensions.
Spark Streaming Clustering center 0: 440.873301276124,25.477847235065635,64.20812280377294,1010.9613963380791,67.80943221749587 center 1: 470.25742216416273,12.785760940561731,42.586181145220955,1015.9444850860008,79.6946897452645 Samoa Streaming Clustering Center :0: 442.06527377405365,25.51594930115884,60.35312500444376,1010.6246222277139,61.262047085828065 Center :1: 469.66365199261037,12.6577054812157,43.59210147812603,1014.3543441369945,76.81973235658958 you can see that cluster centers are almost same.This is with 5 attributes and two clusters. As long as we have large batch size and number of increasing number of retraining, the results are converging. Now i am trying to integrate this with carbon-ml and trying to fix couple of issues in the integration. I will also prepare the documentation.thank you. And i have create new repository [1] to put essential classes. regards, Mahesh. [1] https://github.com/dananjayamahesh/streaming On Fri, Aug 5, 2016 at 6:47 PM, Nirmal Fernando <[email protected]> wrote: > Mahesh, > > Your issue is not clear. What're you exactly trying ? carbon-ml is our git > repo and if you mean to say about the server you're running, please use the > term 'ML server'. Please summarize the problem and the steps you've done. > Please use the point form. > > Thanks. > > On Fri, Aug 5, 2016 at 6:43 PM, Mahesh Dananjaya < > [email protected]> wrote: > >> Hi Nirmal, >> can those things be caused by permission requirements? >> BR, >> Mahesh. >> >> On Fri, Aug 5, 2016 at 5:39 PM, Mahesh Dananjaya < >> [email protected]> wrote: >> >>> Hi Nirmal, >>> Yes i have added samoa dependencies in carbon-ml and it is working fine. >>> These exceptions are coming for the my classes that are inside ml. when i >>> used classes in samoa like org.apache.samoa.tasks.ClusteringEvaluation >>> it is working fine and run. And also same classes that i developed are >>> running fine in my other extensions outside carbon-ml, which are developed >>> as regular extensions. i am checking this further. thank you. >>> regards, >>> Mahesh. >>> >>> On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando <[email protected]> wrote: >>> >>>> Did you add samoa jars in ML? >>>> >>>> On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya < >>>> [email protected]> wrote: >>>> >>>>> Hi Supun, >>>>> This is the error i am getting while run the extension in the cabon-ml >>>>> side, >>>>> plase reffer to link [1] for the class. >>>>> >>>>> ERROR >>>>> {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder} >>>>> - Fail to initialize the task >>>>> >>>>> java.lang.Exception: Class not found: StreamingClusteringTask >>>>> >>>>> at com.github.javacliparser.ClassOption.cliStringToObject(Class >>>>> Option.java:136) >>>>> >>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>>>> gClusteringTaskBuilder.initClusteringTask(StreamingClusterin >>>>> gTaskBuilder.java:129) >>>>> >>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>>>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild >>>>> er.java:100) >>>>> >>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>>>> gClustering.run(StreamingClustering.java:77) >>>>> >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> >>>>> [2016-08-04 16:23:07,437] INFO {org.wso2.carbon.ml.siddhi.ext >>>>> ension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to >>>>> initialize the taskjava.lang.Exception: Class not found: >>>>> StreamingClusteringTask >>>>> >>>>> +++++++Please refeer link [1] for the StreamingClusteringTask.++++++++ >>>>> >>>>> Then again for StreamingClusteringStream class while i bypass the >>>>> String query in the initTask(). please refer link [2] for the class. >>>>> >>>>> Exception in thread "Thread-60" java.lang.IllegalArgumentException: >>>>> Problems with option: streamTrain >>>>> >>>>> at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl >>>>> assOption.java:64) >>>>> >>>>> at com.github.javacliparser.AbstractOption.resetToDefault(Abstr >>>>> actOption.java:90) >>>>> >>>>> at com.github.javacliparser.AbstractClassOption.<init>(Abstract >>>>> ClassOption.java:84) >>>>> >>>>> at com.github.javacliparser.AbstractClassOption.<init>(Abstract >>>>> ClassOption.java:63) >>>>> >>>>> at com.github.javacliparser.ClassOption.<init>(ClassOption.java:38) >>>>> >>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>>>> gClusteringTask.<init>(StreamingClusteringTask.java:52) >>>>> >>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>>>> gClusteringTaskBuilder.initClusteringTask(StreamingClusterin >>>>> gTaskBuilder.java:140) >>>>> >>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>>>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild >>>>> er.java:103) >>>>> >>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>>>> gClustering.run(StreamingClustering.java:77) >>>>> >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> >>>>> Caused by: java.lang.Exception: Class not found: >>>>> org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>>>> gClusteringStream >>>>> >>>>> at com.github.javacliparser.ClassOption.cliStringToObject(Class >>>>> Option.java:136) >>>>> >>>>> at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl >>>>> assOption.java:61) >>>>> >>>>> ... 9 more >>>>> >>>>> >>>>> Those Class Not Found Exceptions are at runtime. Do i have do anything >>>>> on the carbon-ml side for this.My samoa cores can be found in [3]. Those >>>>> are working fine and no Class Not Found Exceptions arrive when running >>>>> outside the carbon-ml. >>>>> >>>>> >>>>> thank you. >>>>> >>>>> regards, >>>>> >>>>> Mahesh. >>>>> >>>>> >>>>> >>>>> [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ >>>>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte >>>>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre >>>>> aming/samoa/StreamingClusteringTask.java >>>>> >>>>> [2] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ >>>>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte >>>>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre >>>>> aming/samoa/StreamingClusteringTask.java >>>>> >>>>> [3] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ >>>>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte >>>>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre >>>>> aming/samoa >>>>> >>>>> On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi Mahesh, >>>>>> >>>>>> samoa dependency version in siddhi-extension should be >>>>>> *0.4.0-incubating-SNAPSHOT*. That should solve the issue >>>>>> >>>>>> Regards, >>>>>> Supun >>>>>> >>>>>> On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi all, >>>>>>> samoa is in my local repository and dependencies works fine with all >>>>>>> other extensions that add samoa 0.4.0-incubator dependencies. But only >>>>>>> when >>>>>>> i build carbon-ml, it gives priority for the remote repository for >>>>>>> looking >>>>>>> samoa. SO any help with this to give priority for local m2 repo before >>>>>>> carbon-ml building is looking for the remote one. I am getting the error >>>>>>> because of this. maven option -U also not seems to be working here. any >>>>>>> help please. >>>>>>> >>>>>>> [ERROR] Failed to execute goal on project >>>>>>> org.wso2.carbon.ml.siddhi.extension: Could not resolve dependencies >>>>>>> for project org.wso2.carbon.ml:org.wso2.ca >>>>>>> rbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT: The following >>>>>>> artifacts could not be resolved: >>>>>>> org.apache.samoa:samoa-api:jar:0.4.0-incubating, >>>>>>> org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not find >>>>>>> artifact org.apache.samoa:samoa-api:jar:0.4.0-incubating in >>>>>>> wso2-nexus (http://maven.wso2.org/nexus/content/groups/wso2-public/) >>>>>>> >>>>>>> Since samoa will be used for future work, is it possible to add that >>>>>>> in the relevant wso2 repo. Because there are still no samoa >>>>>>> 0.4.0-incubator >>>>>>> maven repo. only 0.3.0. we cannot continue our work with the 0.3.0 >>>>>>> since it >>>>>>> is outdated. >>>>>>> >>>>>>> thank you. >>>>>>> regards, >>>>>>> Mahesh. >>>>>>> >>>>>>> On Wed, Aug 3, 2016 at 4:29 PM, Miyuru Dayarathna <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> Adding Jayan to this email thread. >>>>>>>> >>>>>>>> -- >>>>>>>> Thanks, >>>>>>>> Miyuru Dayarathna >>>>>>>> Senior Technical Lead >>>>>>>> Mobile: +94713527783 >>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>> >>>>>>>> On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga <[email protected]> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi Mahesh, >>>>>>>>> >>>>>>>>> you should build carbon-ml *without *-U option. -U means you >>>>>>>>> force mvn to look for updates in remote repo. Rather run it with -o >>>>>>>>> option. >>>>>>>>> Also, can you double check whether the dependencies are defined >>>>>>>>> correctly >>>>>>>>> (group Id's, versions etc). >>>>>>>>> >>>>>>>>> Alternatively, it seems there is a samoa released version in mvn >>>>>>>>> repo. Maybe you could try that one as well. But that's v0.3.0.. >>>>>>>>> >>>>>>>>> [1] https://mvnrepository.com/artifact/org.apache.samoa >>>>>>>>> >>>>>>>>> On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Hi Supun, >>>>>>>>>> I just neeed a little help. I am in the process of integrating my >>>>>>>>>> samoa core functions and extension into carbon-ml's siddhi >>>>>>>>>> extension. For >>>>>>>>>> samoa i am using locally built samoa project to provide samoa 0.4.0 >>>>>>>>>> dependencies,since we dont have it in the maven repo or else where. >>>>>>>>>> But >>>>>>>>>> when i build carbon-ml by adding samoa dependencies, it seems to be >>>>>>>>>> maven >>>>>>>>>> search for remote location, not the local maven repo first. I am >>>>>>>>>> running >>>>>>>>>> maven with -U option. But still the problems occurs. Is there any >>>>>>>>>> specific >>>>>>>>>> thing in carbon-ml like settings to search remote before local one? >>>>>>>>>> I just >>>>>>>>>> need to give local maven repo for the dependency. My extension >>>>>>>>>> seperately >>>>>>>>>> working fine, so there is no problem wihat the local dependencies >>>>>>>>>> outside >>>>>>>>>> carbon-ml. So can you please help me with this.thank you. >>>>>>>>>> regards, >>>>>>>>>> Mahesh. >>>>>>>>>> >>>>>>>>>> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera <[email protected] >>>>>>>>>> > wrote: >>>>>>>>>> >>>>>>>>>>> Hi Mahesh, >>>>>>>>>>> >>>>>>>>>>> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi All, >>>>>>>>>>>> I am onto connecting cep streams with samoa streams to data >>>>>>>>>>>> analysis using samoa framework. To connect samoa with cep siddhi >>>>>>>>>>>> event >>>>>>>>>>>> streams what i we can do is that try to convert cep streams into >>>>>>>>>>>> samoa >>>>>>>>>>>> streams or else writing wrpper for samoa for cep streasm to be >>>>>>>>>>>> used. In >>>>>>>>>>>> both cases i have to covert siddhi cep streasm into samoa streams. >>>>>>>>>>>> Samoa is >>>>>>>>>>>> using MOA to analyse data. Moo contains ML framework to analyse >>>>>>>>>>>> stream >>>>>>>>>>>> data. Samoa is wrapping MOA withsome of its classes. >>>>>>>>>>>> >>>>>>>>>>>> Samoa streams is based on MOA, Instance and InstanceStreams. >>>>>>>>>>>> Samoa see streams as a stream of instances [1]. So if we are going >>>>>>>>>>>> to >>>>>>>>>>>> convert cep events into samoa instances , it will take time. But >>>>>>>>>>>> if we have >>>>>>>>>>>> some similarity between cep siddhi streams and samoa streasm we >>>>>>>>>>>> can reduce >>>>>>>>>>>> the time. >>>>>>>>>>>> 1. What is the underlying infrastructure for cep siddhi >>>>>>>>>>>> streasm.? >>>>>>>>>>>> 2. Are there anything as Instances or InstanceStreams kind of >>>>>>>>>>>> implmentation underlying cep streams? >>>>>>>>>>>> 3. How can i get more underestanding on CEP siddhi streams. >>>>>>>>>>>> >>>>>>>>>>>> On the other hand i can use my cep siddhi extension and put >>>>>>>>>>>> those events into event queue and convert them into samoa >>>>>>>>>>>> instances and >>>>>>>>>>>> feed them into samoa streaming ml topologies. >>>>>>>>>>>> >>>>>>>>>>> I think this is OK. I assume this is much easier. Let's do this >>>>>>>>>>> and check the performance. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>> There is another option. In Samoa what they are basically doing >>>>>>>>>>>> is that wrapping MOA ML framework and write some classes for build >>>>>>>>>>>> streaming ml topologies. So as the other option i can wrap samoa >>>>>>>>>>>> moa with >>>>>>>>>>>> my design and use moa ml framework directly. (No need for Samoa >>>>>>>>>>>> extension). >>>>>>>>>>>> I have building some topologies to streaming data analysis [2]. >>>>>>>>>>>> Main >>>>>>>>>>>> problem is that lack of documentation. Anyway i had go through >>>>>>>>>>>> their whole >>>>>>>>>>>> samoa design.thank you. >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> If we use MOA directly, would we loose the distributed support >>>>>>>>>>> in SAOMA. Let's do a call when you can, so we can dsicuss this in >>>>>>>>>>> detail. >>>>>>>>>>> >>>>>>>>>>> --Srinath >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>> regards, >>>>>>>>>>>> Mahesh. >>>>>>>>>>>> >>>>>>>>>>>> [1] https://github.com/apache/incu >>>>>>>>>>>> bator-samoa/blob/master/samoa-api/src/main/java/org/apache/s >>>>>>>>>>>> amoa/streams/clustering/ClusteringStream.java >>>>>>>>>>>> [2] https://github.com/dananjayama >>>>>>>>>>>> hesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java >>>>>>>>>>>> /org/gsoc/samoa/streaming >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi Maheshakya, >>>>>>>>>>>>> Samoa modules built as topologies that connect streams with >>>>>>>>>>>>> the internal processors. I have already written some examples to >>>>>>>>>>>>> test the >>>>>>>>>>>>> ML algorithms and samoa analysis topologies. What we need to done >>>>>>>>>>>>> is mostly >>>>>>>>>>>>> developing a wrapper around samoa topologies to connect their >>>>>>>>>>>>> input and >>>>>>>>>>>>> output streams with our cep streams. So i am currently going >>>>>>>>>>>>> through their >>>>>>>>>>>>> stream architecture to connect our streams with their streams. >>>>>>>>>>>>> Couple of >>>>>>>>>>>>> examples exapaining samoa ml topologies and streaming can be >>>>>>>>>>>>> found in my >>>>>>>>>>>>> git hub repo [1]. Samoa using MOA ml algorithms by wrapping them >>>>>>>>>>>>> with their >>>>>>>>>>>>> classes. Initailly i am trying to develop a KMeansClustering >>>>>>>>>>>>> analysis with >>>>>>>>>>>>> cep streams with samoa ml topologies. >>>>>>>>>>>>> And also i could not find a maven repo for samoa 0.4.0 >>>>>>>>>>>>> incubating. So i am currently using my local m2 repo's samoa >>>>>>>>>>>>> 0..4.0 >>>>>>>>>>>>> incubating for my dependencies to work. The local one is built by >>>>>>>>>>>>> original >>>>>>>>>>>>> samoa source.thank you. >>>>>>>>>>>>> >>>>>>>>>>>>> regards, >>>>>>>>>>>>> Mahesh. >>>>>>>>>>>>> >>>>>>>>>>>>> [1] https://github.com/dananjayama >>>>>>>>>>>>> hesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java >>>>>>>>>>>>> /org/gsoc/samoa/streaming >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi Mahesh, >>>>>>>>>>>>>> >>>>>>>>>>>>>> Can you please share your samoa project? >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya < >>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> ---------- Forwarded message ---------- >>>>>>>>>>>>>>> From: Mahesh Dananjaya <[email protected]> >>>>>>>>>>>>>>> Date: Sun, Jul 17, 2016 at 11:18 AM >>>>>>>>>>>>>>> Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic >>>>>>>>>>>>>>> with online data for WSO2 Machine Learner-Samoa Integration >>>>>>>>>>>>>>> To: Maheshakya Wijewardena <[email protected]> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi Maheshakaya, >>>>>>>>>>>>>>> just need a little help. In Samoa when we want to run a >>>>>>>>>>>>>>> class what is does it used this commands [1], >>>>>>>>>>>>>>> 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar >>>>>>>>>>>>>>> "ClusteringEvaluation" >>>>>>>>>>>>>>> 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar >>>>>>>>>>>>>>> "PrequentialEvaluation -d /tmp/dump.csv -i 1000000 -f 100000 -l >>>>>>>>>>>>>>> (classifiers.trees.VerticalHoeffdingTree -p 4) -s >>>>>>>>>>>>>>> (generators.RandomTreeGenerator -c 2 -o 10 -u 10)" >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> what is does is call a class named LocalDoTask [4] and pass >>>>>>>>>>>>>>> this string as argument.After that that LocalDoTask call the >>>>>>>>>>>>>>> relevent Tasks >>>>>>>>>>>>>>> such as ClusteringEvaluation or PrequentialEvaluation. [2]. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Now i have add samoa dependencies to my new maven project, >>>>>>>>>>>>>>> where i used original samoa source to write examples and test >>>>>>>>>>>>>>> then >>>>>>>>>>>>>>> earlier.Now i want to push them into my new java project with >>>>>>>>>>>>>>> samoa >>>>>>>>>>>>>>> dependencies. I added dependency and it was built fine. Now i >>>>>>>>>>>>>>> am calling my >>>>>>>>>>>>>>> local DoTask.java [3] file as same as i did with samoa with, >>>>>>>>>>>>>>> java -cp target/streaming-1.0-SNAPSHOT.jar >>>>>>>>>>>>>>> org.gsoc.samoa.streaming.DoTask >>>>>>>>>>>>>>> "org.gsoc.samoa.streaming.ClusteringEvaluation" >>>>>>>>>>>>>>> But seems to be i am incorrect in some place. >>>>>>>>>>>>>>> Error: A JNI error has occurred, please check your >>>>>>>>>>>>>>> installation and try again >>>>>>>>>>>>>>> Exception in thread "main" java.lang.NoClassDefFoundError: >>>>>>>>>>>>>>> org/apache/samoa/topology/ComponentFactory >>>>>>>>>>>>>>> at java.lang.Class.getDeclaredMethods0(Native Method) >>>>>>>>>>>>>>> at java.lang.Class.privateGetDecl >>>>>>>>>>>>>>> aredMethods(Class.java:2701) >>>>>>>>>>>>>>> at java.lang.Class.privateGetMeth >>>>>>>>>>>>>>> odRecursive(Class.java:3048) >>>>>>>>>>>>>>> at java.lang.Class.getMethod0(Class.java:3018) >>>>>>>>>>>>>>> at java.lang.Class.getMethod(Class.java:1784) >>>>>>>>>>>>>>> at sun.launcher.LauncherHelper.va >>>>>>>>>>>>>>> lidateMainClass(LauncherHelper.java:544) >>>>>>>>>>>>>>> at sun.launcher.LauncherHelper.ch >>>>>>>>>>>>>>> eckAndLoadMain(LauncherHelper.java:526) >>>>>>>>>>>>>>> Caused by: java.lang.ClassNotFoundException: >>>>>>>>>>>>>>> org.apache.samoa.topology.ComponentFactory >>>>>>>>>>>>>>> at java.net.URLClassLoader.findCl >>>>>>>>>>>>>>> ass(URLClassLoader.java:381) >>>>>>>>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424) >>>>>>>>>>>>>>> at sun.misc.Launcher$AppClassLoad >>>>>>>>>>>>>>> er.loadClass(Launcher.java:331) >>>>>>>>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >>>>>>>>>>>>>>> ... 7 more >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> can i actually call the Task like this. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> BR, >>>>>>>>>>>>>>> Mahesh. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> [1] https://samoa.incubator.apache >>>>>>>>>>>>>>> .org/documentation/Prequential-Evaluation-Task.html >>>>>>>>>>>>>>> [2] https://github.com/apache/incu >>>>>>>>>>>>>>> bator-samoa/blob/releases/0.4.0-incubating-RC0/samoa-api/src >>>>>>>>>>>>>>> /main/java/org/apache/samoa/tasks/ClusteringEvaluation.java >>>>>>>>>>>>>>> [3] https://github.com/dananjayama >>>>>>>>>>>>>>> hesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java >>>>>>>>>>>>>>> /org/gsoc/samoa/streaming >>>>>>>>>>>>>>> [4] https://github.com/apache/incu >>>>>>>>>>>>>>> bator-samoa/tree/releases/0.4.0-incubating-RC0/samoa-local/s >>>>>>>>>>>>>>> rc/main/java/org/apache/samoa >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Thu, Jul 14, 2016 at 3:47 PM, Mahesh Dananjaya < >>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi srinath, >>>>>>>>>>>>>>>> sure.i am working on it.thank you. >>>>>>>>>>>>>>>> regards, >>>>>>>>>>>>>>>> Mahesh. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Thu, Jul 14, 2016 at 11:12 AM, Srinath Perera < >>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Hi Mahesh, >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Let's focus on getting SAOMA work with CEP. It is OK to be >>>>>>>>>>>>>>>>> limited to few algorithms. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> --Srinath >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> On Thu, Jul 14, 2016 at 10:49 AM, Mahesh Dananjaya < >>>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Hi Maheshakya, >>>>>>>>>>>>>>>>>> I think we can build new tasks [1] like the one in >>>>>>>>>>>>>>>>>> execution plan in cep with samoa. I will try to build a one. >>>>>>>>>>>>>>>>>> regards, >>>>>>>>>>>>>>>>>> Mahesh. >>>>>>>>>>>>>>>>>> [1] https://samoa.incubator.apache >>>>>>>>>>>>>>>>>> .org/documentation/Developing-New-Tasks-in-SAMOA.html >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> On Thu, Jul 14, 2016 at 10:35 AM, Mahesh Dananjaya < >>>>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Hi Maheshakya, >>>>>>>>>>>>>>>>>>> I am building and running samoa to see its >>>>>>>>>>>>>>>>>>> functionality. In samoa still we have limited supports in >>>>>>>>>>>>>>>>>>> algorithms. Samoa >>>>>>>>>>>>>>>>>>> supports only classification and clustering with streams. >>>>>>>>>>>>>>>>>>> It also use kind >>>>>>>>>>>>>>>>>>> of StreamProcessor, like the one we use in StreamProcessor >>>>>>>>>>>>>>>>>>> extension. I >>>>>>>>>>>>>>>>>>> was getting started with Samoa referring to this page [1]. >>>>>>>>>>>>>>>>>>> Then i ran >>>>>>>>>>>>>>>>>>> couple of examples to identified the flow. Samoa use hadoop >>>>>>>>>>>>>>>>>>> framework >>>>>>>>>>>>>>>>>>> instead spark for distribution. But i am using it in a >>>>>>>>>>>>>>>>>>> local mode. When i >>>>>>>>>>>>>>>>>>> see the Samoa core there is only limited algorithms. IMO if >>>>>>>>>>>>>>>>>>> we are going to >>>>>>>>>>>>>>>>>>> use Samoa we have to limit the functionality and >>>>>>>>>>>>>>>>>>> algorithms [2]. When i go >>>>>>>>>>>>>>>>>>> to developer corner in [3], it seems to be something like >>>>>>>>>>>>>>>>>>> CEP extension >>>>>>>>>>>>>>>>>>> that we are using currenlty. SO in Samoa though the >>>>>>>>>>>>>>>>>>> algorihtms are limited, >>>>>>>>>>>>>>>>>>> they have implemented streaming support for them. Therefore >>>>>>>>>>>>>>>>>>> if we integrate >>>>>>>>>>>>>>>>>>> it into CEP we have to look for how to handle streams and >>>>>>>>>>>>>>>>>>> algorithms in >>>>>>>>>>>>>>>>>>> Samoa side. Is it good for your side to have both hadoop >>>>>>>>>>>>>>>>>>> and spark running >>>>>>>>>>>>>>>>>>> background.thank you. >>>>>>>>>>>>>>>>>>> regards, >>>>>>>>>>>>>>>>>>> Mahesh. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> [1] https://samoa.incubator.apache >>>>>>>>>>>>>>>>>>> .org/documentation/Home.html >>>>>>>>>>>>>>>>>>> [2] https://samoa.incubator.apache >>>>>>>>>>>>>>>>>>> .org/documentation/api/current/index.html >>>>>>>>>>>>>>>>>>> [3] https://samoa.incubator.apache >>>>>>>>>>>>>>>>>>> .org/documentation/SAMOA-Topology.html >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>> ============================ >>>>>>>>>>>>>>>>> Srinath Perera, Ph.D. >>>>>>>>>>>>>>>>> http://people.apache.org/~hemapani/ >>>>>>>>>>>>>>>>> http://srinathsview.blogspot.com/ >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>>>>> Dev mailing list >>>>>>>>>>>>>>> [email protected] >>>>>>>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> Pruthuvi Maheshakya Wijewardena >>>>>>>>>>>>>> >>>>>>>>>>>>>> [email protected] >>>>>>>>>>>>>> +94711228855 >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> ============================ >>>>>>>>>>> Srinath Perera, Ph.D. >>>>>>>>>>> http://people.apache.org/~hemapani/ >>>>>>>>>>> http://srinathsview.blogspot.com/ >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> *Supun Sethunga* >>>>>>>>> Senior Software Engineer >>>>>>>>> WSO2, Inc. >>>>>>>>> http://wso2.com/ >>>>>>>>> lean | enterprise | middleware >>>>>>>>> Mobile : +94 716546324 >>>>>>>>> Blog: http://supunsetunga.blogspot.com >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Thanks, >>>>>>>> Miyuru Dayarathna >>>>>>>> Senior Technical Lead >>>>>>>> Mobile: +94713527783 >>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> *Supun Sethunga* >>>>>> Senior Software Engineer >>>>>> WSO2, Inc. >>>>>> http://wso2.com/ >>>>>> lean | enterprise | middleware >>>>>> Mobile : +94 716546324 >>>>>> Blog: http://supunsetunga.blogspot.com >>>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> >>>> Thanks & regards, >>>> Nirmal >>>> >>>> Team Lead - WSO2 Machine Learner >>>> Associate Technical Lead - Data Technologies Team, WSO2 Inc. >>>> Mobile: +94715779733 >>>> Blog: http://nirmalfdo.blogspot.com/ >>>> >>>> >>>> >>> >> > > > -- > > Thanks & regards, > Nirmal > > Team Lead - WSO2 Machine Learner > Associate Technical Lead - Data Technologies Team, WSO2 Inc. > Mobile: +94715779733 > Blog: http://nirmalfdo.blogspot.com/ > > >
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
