Hi Mahesh,
Couple of issues I noticed:
- Your siddhi-extension is using spark 1.6.1 dependency. But in the
logs, it says the version of spark is 1.4.1. You can see the following line
in the logs.
*TID: [-1234] [] [2016-08-08 13:05:11,699] INFO
{org.apache.spark.SparkContext} - Running Spark version 1.4.1 *
- In each of the extension, you are starting a spark-context, and a new
spark application. But spark only allows to create one spark context per
JVM.
Can you fix those and check whether the issue is still exists? Also please
use a fresh CEP pack when testing. For now, you can avoid the second issue
by creating only one execution plan and calling only one algorithm at a
time.
Btw, it would be easy for us to reproduce the issue and check whats
happening, if you can include all dependencies inside the jar itself.
Otherwise, it's a nightmare to find and add the missing dependencies one by
one.
Regards,
Supun
On Mon, Aug 8, 2016 at 3:43 PM, Mahesh Dananjaya <[email protected]>
wrote:
> Hi supun
> this is the log file.This happens only when i use the cep to invoke the
> extension.thank you.
> regards,
> Mahesh.
>
> On Mon, Aug 8, 2016 at 1:32 PM, Mahesh Dananjaya <
> [email protected]> wrote:
>
>> Hi supun,
>> this is the cep log file.thank you.
>> Mahesh.
>>
>> On Mon, Aug 8, 2016 at 11:03 AM, Mahesh Dananjaya <
>> [email protected]> wrote:
>>
>>> Hi supun,
>>> I think i have fixed couple of previous errors. Now my samoa extension
>>> is working fine with cep. But i am getting a exception with my spark
>>> streaming ml extensions. It was working fine and i did not do any changes
>>> to my previously developed streaming extensions. This error is occured in
>>> the line,
>>>
>>> conf = new SparkConf().setMaster("local[*]").setAppName("Linear
>>> Regression Example").set("spark.driver.allowMultipleContexts", "true")
>>> ;
>>> sc = new JavaSparkContext(conf);
>>>
>>> This what i get and cep server is crashed.
>>> ERROR {org.apache.spark.ui.SparkUI} - Failed to bind SparkUI
>>> javax.servlet.UnavailableException: Servlet class
>>> com.sun.jersey.spi.container.servlet.ServletContainer is not a
>>> javax.servlet.Servlet
>>> at org.spark-project.jetty.servlet.ServletHolder.checkServletTy
>>> pe(ServletHolder.java:438)
>>> at org.spark-project.jetty.servlet.ServletHolder.doStart(Servle
>>> tHolder.java:316)
>>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta
>>> rt(AbstractLifeCycle.java:64)
>>> at org.spark-project.jetty.servlet.ServletHandler.initialize(Se
>>> rvletHandler.java:791)
>>> at org.spark-project.jetty.servlet.ServletContextHandler.startC
>>> ontext(ServletContextHandler.java:265)
>>> at org.spark-project.jetty.server.handler.ContextHandler.doStar
>>> t(ContextHandler.java:717)
>>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta
>>> rt(AbstractLifeCycle.java:64)
>>> at org.spark-project.jetty.server.handler.HandlerCollection.doS
>>> tart(HandlerCollection.java:229)
>>> at org.spark-project.jetty.server.handler.ContextHandlerCollect
>>> ion.doStart(ContextHandlerCollection.java:172)
>>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta
>>> rt(AbstractLifeCycle.java:64)
>>> at org.spark-project.jetty.server.handler.HandlerWrapper.doStar
>>> t(HandlerWrapper.java:95)
>>> at org.spark-project.jetty.server.Server.doStart(Server.java:282)
>>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta
>>> rt(AbstractLifeCycle.java:64)
>>> at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUti
>>> ls$$connect$1(JettyUtils.scala:228)
>>> at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.s
>>> cala:238)
>>> at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.s
>>> cala:238)
>>> at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.ap
>>> ply$mcVI$sp(Utils.scala:1991)
>>> at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
>>> at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1982)
>>> at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.
>>> scala:238)
>>> at org.apache.spark.ui.WebUI.bind(WebUI.scala:117)
>>> at org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext
>>> .scala:448)
>>> at org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext
>>> .scala:448)
>>> at scala.Option.foreach(Option.scala:236)
>>> at org.apache.spark.SparkContext.<init>(SparkContext.scala:448)
>>> at org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkC
>>> ontext.scala:61)
>>> at org.gsoc.siddhi.extension.streaming.StreamingKMeansClusterin
>>> g.<init>(StreamingKMeansClustering.java:60)
>>> at org.gsoc.siddhi.extension.streaming.StreamingKMeansClusterin
>>> gStreamProcessor.init(StreamingKMeansClusteringStreamProcessor.java:68)
>>> at org.wso2.siddhi.core.query.processor.stream.AbstractStreamPr
>>> ocessor.initProcessor(AbstractStreamProcessor.java:65)
>>> at org.wso2.siddhi.core.util.parser.SingleInputStreamParser.gen
>>> erateProcessor(SingleInputStreamParser.java:182)
>>> at org.wso2.siddhi.core.util.parser.SingleInputStreamParser.par
>>> seInputStream(SingleInputStreamParser.java:93)
>>> at org.wso2.siddhi.core.util.parser.InputStreamParser.parse(Inp
>>> utStreamParser.java:58)
>>> at org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryPars
>>> er.java:85)
>>> at org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(E
>>> xecutionPlanParser.java:145)
>>> at org.wso2.siddhi.core.SiddhiManager.validateExecutionPlan(Sid
>>> dhiManager.java:69)
>>> at org.wso2.siddhi.core.SiddhiManager.validateExecutionPlan(Sid
>>> dhiManager.java:75)
>>> at org.wso2.carbon.event.processor.core.internal.util.helper.Ev
>>> entProcessorHelper.validateExecutionPlan(EventProcessorHelper.java:191)
>>> at org.wso2.carbon.event.processor.core.internal.CarbonEventPro
>>> cessorService.validateExecutionPlan(CarbonEventProcessorServ
>>> ice.java:493)
>>> at org.wso2.carbon.event.processor.admin.EventProcessorAdminSer
>>> vice.validateExecutionPlan(EventProcessorAdminService.java:329)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAcce
>>> ssorImpl.java:62)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe
>>> thodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:497)
>>> at org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RP
>>> CUtil.java:212)
>>> at org.apache.axis2.rpc.receivers.RPCMessageReceiver.invokeBusi
>>> nessLogic(RPCMessageReceiver.java:117)
>>> at org.apache.axis2.receivers.AbstractInOutMessageReceiver.invo
>>> keBusinessLogic(AbstractInOutMessageReceiver.java:40)
>>> at org.apache.axis2.receivers.AbstractMessageReceiver.receive(A
>>> bstractMessageReceiver.java:110)
>>> at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
>>> at org.apache.axis2.transport.local.LocalTransportReceiver.proc
>>> essMessage(LocalTransportReceiver.java:169)
>>> at org.apache.axis2.transport.local.LocalTransportReceiver.proc
>>> essMessage(LocalTransportReceiver.java:82)
>>> at org.wso2.carbon.core.transports.local.CarbonLocalTransportSe
>>> nder.finalizeSendWithToAddress(CarbonLocalTransportSender.java:45)
>>> at org.apache.axis2.transport.local.LocalTransportSender.invoke
>>> (LocalTransportSender.java:77)
>>> at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442)
>>> at org.apache.axis2.description.OutInAxisOperationClient.send(O
>>> utInAxisOperation.java:430)
>>> at org.apache.axis2.description.OutInAxisOperationClient.execut
>>> eImpl(OutInAxisOperation.java:225)
>>> at org.apache.axis2.client.OperationClient.execute(OperationCli
>>> ent.java:149)
>>> at org.wso2.carbon.event.processor.stub.EventProcessorAdminServ
>>> iceStub.validateExecutionPlan(EventProcessorAdminServiceStub.java:2207)
>>> at org.apache.jsp.eventprocessor.validate_005fsiddhi_005fquerie
>>> s_005fajaxprocessor_jsp._jspService(validate_005fsiddhi_
>>> 005fqueries_005fajaxprocessor_jsp.java:73)
>>> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.ja
>>> va:70)
>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>>> at org.apache.jasper.servlet.JspServletWrapper.service(JspServl
>>> etWrapper.java:432)
>>> at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServl
>>> et.java:395)
>>> at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:339)
>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>>> at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155)
>>> at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.j
>>> ava:80)
>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>>> at org.eclipse.equinox.http.helper.ContextPathServletAdaptor.se
>>> rvice(ContextPathServletAdaptor.java:37)
>>> at org.eclipse.equinox.http.servlet.internal.ServletRegistratio
>>> n.service(ServletRegistration.java:61)
>>> at org.eclipse.equinox.http.servlet.internal.ProxyServlet.proce
>>> ssAlias(ProxyServlet.java:128)
>>> at org.eclipse.equinox.http.servlet.internal.ProxyServlet.servi
>>> ce(ProxyServlet.java:68)
>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>>> at org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service
>>> (DelegationServlet.java:68)
>>> at org.apache.catalina.core.ApplicationFilterChain.internalDoFi
>>> lter(ApplicationFilterChain.java:303)
>>> at org.apache.catalina.core.ApplicationFilterChain.doFilter(App
>>> licationFilterChain.java:208)
>>> at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilte
>>> r.java:52)
>>> at org.apache.catalina.core.ApplicationFilterChain.internalDoFi
>>> lter(ApplicationFilterChain.java:241)
>>> at org.apache.catalina.core.ApplicationFilterChain.doFilter(App
>>> licationFilterChain.java:208)
>>> at org.wso2.carbon.ui.filters.CSRFPreventionFilter.doFilter(CSR
>>> FPreventionFilter.java:88)
>>> at org.apache.catalina.core.ApplicationFilterChain.internalDoFi
>>> lter(ApplicationFilterChain.java:241)
>>> at org.apache.catalina.core.ApplicationFilterChain.doFilter(App
>>> licationFilterChain.java:208)
>>> at org.wso2.carbon.ui.filters.CRLFPreventionFilter.doFilter(CRL
>>> FPreventionFilter.java:59)
>>> at org.apache.catalina.core.ApplicationFilterChain.internalDoFi
>>> lter(ApplicationFilterChain.java:241)
>>> at org.apache.catalina.core.ApplicationFilterChain.doFilter(App
>>> licationFilterChain.java:208)
>>> at org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilte
>>> r(CharacterSetFilter.java:61)
>>> at org.apache.catalina.core.ApplicationFilterChain.internalDoFi
>>> lter(ApplicationFilterChain.java:241)
>>> at org.apache.catalina.core.ApplicationFilterChain.doFilter(App
>>> licationFilterChain.java:208)
>>> at org.apache.catalina.core.StandardWrapperValve.invoke(Standar
>>> dWrapperValve.java:220)
>>> at org.apache.catalina.core.StandardContextValve.invoke(Standar
>>> dContextValve.java:122)
>>> at org.apache.catalina.authenticator.AuthenticatorBase.invoke(A
>>> uthenticatorBase.java:504)
>>> at org.apache.catalina.core.StandardHostValve.invoke(StandardHo
>>> stValve.java:170)
>>> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorRepo
>>> rtValve.java:103)
>>> at org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInv
>>> ocation(CompositeValve.java:99)
>>> at org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke
>>> (CarbonTomcatValve.java:47)
>>> at org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(Tena
>>> ntLazyLoaderValve.java:57)
>>> at org.wso2.carbon.event.receiver.core.internal.tenantmgt.Tenan
>>> tLazyLoaderValve.invoke(TenantLazyLoaderValve.java:48)
>>> at org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invok
>>> eValves(TomcatValveContainer.java:47)
>>> at org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(Comp
>>> ositeValve.java:62)
>>> at org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetection
>>> Valve.invoke(CarbonStuckThreadDetectionValve.java:159)
>>> at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogVa
>>> lve.java:950)
>>> at org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.
>>> invoke(CarbonContextCreatorValve.java:57)
>>> at org.apache.catalina.core.StandardEngineValve.invoke(Standard
>>> EngineValve.java:116)
>>> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAd
>>> apter.java:421)
>>> at org.apache.coyote.http11.AbstractHttp11Processor.process(Abs
>>> tractHttp11Processor.java:1074)
>>> at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler
>>> .process(AbstractProtocol.java:611)
>>> at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun
>>> (NioEndpoint.java:1739)
>>> at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(N
>>> ioEndpoint.java:1698)
>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool
>>> Executor.java:1142)
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo
>>> lExecutor.java:617)
>>> at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.r
>>> un(TaskThread.java:61)
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>> thank you.
>>> Mahesh.
>>>
>>> On Mon, Aug 8, 2016 at 10:49 AM, Mahesh Dananjaya <
>>> [email protected]> wrote:
>>>
>>>> Hi Srinath and Nirmal,
>>>> I have integrated the my samoa predictive analysis topologies with the
>>>> cep with siddhi extension developed. As you asked me, i have verified the
>>>> output of my samoa streaming clustering topology with the previously build
>>>> Spark streaming Clustering analysis. Results are almost same and is
>>>> converging. As a example if i used two algorithms spark mini-batch
>>>> clustering and samoa kernal clustering for streaming clustering analysis
>>>> outcomes are as follows in my streaming extensions.
>>>>
>>>> Spark Streaming Clustering
>>>> center 0: 440.873301276124,25.477847235065635,64.20812280377294,1010.9
>>>> 613963380791,67.80943221749587
>>>> center 1: 470.25742216416273,12.785760940561731,42.586181145220955,101
>>>> 5.9444850860008,79.6946897452645
>>>>
>>>> Samoa Streaming Clustering
>>>> Center :0: 442.06527377405365,25.51594930115884,60.35312500444376,1010.
>>>> 6246222277139,61.262047085828065
>>>> Center :1: 469.66365199261037,12.6577054812157,43.59210147812603,1014.3
>>>> 543441369945,76.81973235658958
>>>>
>>>> you can see that cluster centers are almost same.This is with 5
>>>> attributes and two clusters. As long as we have large batch size and number
>>>> of increasing number of retraining, the results are converging. Now i am
>>>> trying to integrate this with carbon-ml and trying to fix couple of issues
>>>> in the integration. I will also prepare the documentation.thank you. And i
>>>> have create new repository [1] to put essential classes.
>>>> regards,
>>>> Mahesh.
>>>> [1] https://github.com/dananjayamahesh/streaming
>>>>
>>>>
>>>> On Fri, Aug 5, 2016 at 6:47 PM, Nirmal Fernando <[email protected]>
>>>> wrote:
>>>>
>>>>> Mahesh,
>>>>>
>>>>> Your issue is not clear. What're you exactly trying ? carbon-ml is our
>>>>> git repo and if you mean to say about the server you're running, please
>>>>> use
>>>>> the term 'ML server'. Please summarize the problem and the steps you've
>>>>> done. Please use the point form.
>>>>>
>>>>> Thanks.
>>>>>
>>>>> On Fri, Aug 5, 2016 at 6:43 PM, Mahesh Dananjaya <
>>>>> [email protected]> wrote:
>>>>>
>>>>>> Hi Nirmal,
>>>>>> can those things be caused by permission requirements?
>>>>>> BR,
>>>>>> Mahesh.
>>>>>>
>>>>>> On Fri, Aug 5, 2016 at 5:39 PM, Mahesh Dananjaya <
>>>>>> [email protected]> wrote:
>>>>>>
>>>>>>> Hi Nirmal,
>>>>>>> Yes i have added samoa dependencies in carbon-ml and it is working
>>>>>>> fine. These exceptions are coming for the my classes that are inside ml.
>>>>>>> when i used classes in samoa like
>>>>>>> org.apache.samoa.tasks.ClusteringEvaluation
>>>>>>> it is working fine and run. And also same classes that i developed are
>>>>>>> running fine in my other extensions outside carbon-ml, which are
>>>>>>> developed
>>>>>>> as regular extensions. i am checking this further. thank you.
>>>>>>> regards,
>>>>>>> Mahesh.
>>>>>>>
>>>>>>> On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando <[email protected]>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Did you add samoa jars in ML?
>>>>>>>>
>>>>>>>> On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya <
>>>>>>>> [email protected]> wrote:
>>>>>>>>
>>>>>>>>> Hi Supun,
>>>>>>>>> This is the error i am getting while run the extension in the
>>>>>>>>> cabon-ml side,
>>>>>>>>> plase reffer to link [1] for the class.
>>>>>>>>>
>>>>>>>>> ERROR
>>>>>>>>> {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder}
>>>>>>>>> - Fail to initialize the task
>>>>>>>>>
>>>>>>>>> java.lang.Exception: Class not found: StreamingClusteringTask
>>>>>>>>>
>>>>>>>>> at com.github.javacliparser.ClassOption.cliStringToObject(Class
>>>>>>>>> Option.java:136)
>>>>>>>>>
>>>>>>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>>>>>>>> gClusteringTaskBuilder.initClusteringTask(StreamingClusterin
>>>>>>>>> gTaskBuilder.java:129)
>>>>>>>>>
>>>>>>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>>>>>>>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild
>>>>>>>>> er.java:100)
>>>>>>>>>
>>>>>>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>>>>>>>> gClustering.run(StreamingClustering.java:77)
>>>>>>>>>
>>>>>>>>> at java.lang.Thread.run(Thread.java:745)
>>>>>>>>>
>>>>>>>>> [2016-08-04 16:23:07,437] INFO {org.wso2.carbon.ml.siddhi.ext
>>>>>>>>> ension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to
>>>>>>>>> initialize the taskjava.lang.Exception: Class not found:
>>>>>>>>> StreamingClusteringTask
>>>>>>>>>
>>>>>>>>> +++++++Please refeer link [1] for the
>>>>>>>>> StreamingClusteringTask.++++++++
>>>>>>>>>
>>>>>>>>> Then again for StreamingClusteringStream class while i bypass the
>>>>>>>>> String query in the initTask(). please refer link [2] for the class.
>>>>>>>>>
>>>>>>>>> Exception in thread "Thread-60" java.lang.IllegalArgumentException:
>>>>>>>>> Problems with option: streamTrain
>>>>>>>>>
>>>>>>>>> at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl
>>>>>>>>> assOption.java:64)
>>>>>>>>>
>>>>>>>>> at com.github.javacliparser.AbstractOption.resetToDefault(Abstr
>>>>>>>>> actOption.java:90)
>>>>>>>>>
>>>>>>>>> at com.github.javacliparser.AbstractClassOption.<init>(Abstract
>>>>>>>>> ClassOption.java:84)
>>>>>>>>>
>>>>>>>>> at com.github.javacliparser.AbstractClassOption.<init>(Abstract
>>>>>>>>> ClassOption.java:63)
>>>>>>>>>
>>>>>>>>> at com.github.javacliparser.ClassOption.<init>(ClassOption.java
>>>>>>>>> :38)
>>>>>>>>>
>>>>>>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>>>>>>>> gClusteringTask.<init>(StreamingClusteringTask.java:52)
>>>>>>>>>
>>>>>>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>>>>>>>> gClusteringTaskBuilder.initClusteringTask(StreamingClusterin
>>>>>>>>> gTaskBuilder.java:140)
>>>>>>>>>
>>>>>>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>>>>>>>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild
>>>>>>>>> er.java:103)
>>>>>>>>>
>>>>>>>>> at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>>>>>>>> gClustering.run(StreamingClustering.java:77)
>>>>>>>>>
>>>>>>>>> at java.lang.Thread.run(Thread.java:745)
>>>>>>>>>
>>>>>>>>> Caused by: java.lang.Exception: Class not found:
>>>>>>>>> org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>>>>>>>> gClusteringStream
>>>>>>>>>
>>>>>>>>> at com.github.javacliparser.ClassOption.cliStringToObject(Class
>>>>>>>>> Option.java:136)
>>>>>>>>>
>>>>>>>>> at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl
>>>>>>>>> assOption.java:61)
>>>>>>>>>
>>>>>>>>> ... 9 more
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Those Class Not Found Exceptions are at runtime. Do i have do
>>>>>>>>> anything on the carbon-ml side for this.My samoa cores can be found
>>>>>>>>> in [3].
>>>>>>>>> Those are working fine and no Class Not Found Exceptions arrive when
>>>>>>>>> running outside the carbon-ml.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> thank you.
>>>>>>>>>
>>>>>>>>> regards,
>>>>>>>>>
>>>>>>>>> Mahesh.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_
>>>>>>>>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
>>>>>>>>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre
>>>>>>>>> aming/samoa/StreamingClusteringTask.java
>>>>>>>>>
>>>>>>>>> [2] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_
>>>>>>>>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
>>>>>>>>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre
>>>>>>>>> aming/samoa/StreamingClusteringTask.java
>>>>>>>>>
>>>>>>>>> [3] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_
>>>>>>>>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
>>>>>>>>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre
>>>>>>>>> aming/samoa
>>>>>>>>>
>>>>>>>>> On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga <[email protected]>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Mahesh,
>>>>>>>>>>
>>>>>>>>>> samoa dependency version in siddhi-extension should be
>>>>>>>>>> *0.4.0-incubating-SNAPSHOT*. That should solve the issue
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Supun
>>>>>>>>>>
>>>>>>>>>> On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya <
>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi all,
>>>>>>>>>>> samoa is in my local repository and dependencies works fine with
>>>>>>>>>>> all other extensions that add samoa 0.4.0-incubator dependencies.
>>>>>>>>>>> But only
>>>>>>>>>>> when i build carbon-ml, it gives priority for the remote repository
>>>>>>>>>>> for
>>>>>>>>>>> looking samoa. SO any help with this to give priority for local m2
>>>>>>>>>>> repo
>>>>>>>>>>> before carbon-ml building is looking for the remote one. I am
>>>>>>>>>>> getting the
>>>>>>>>>>> error because of this. maven option -U also not seems to be working
>>>>>>>>>>> here.
>>>>>>>>>>> any help please.
>>>>>>>>>>>
>>>>>>>>>>> [ERROR] Failed to execute goal on project
>>>>>>>>>>> org.wso2.carbon.ml.siddhi.extension: Could not resolve
>>>>>>>>>>> dependencies for project org.wso2.carbon.ml:org.wso2.ca
>>>>>>>>>>> rbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT: The following
>>>>>>>>>>> artifacts could not be resolved:
>>>>>>>>>>> org.apache.samoa:samoa-api:jar:0.4.0-incubating,
>>>>>>>>>>> org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not
>>>>>>>>>>> find artifact org.apache.samoa:samoa-api:jar:0.4.0-incubating
>>>>>>>>>>> in wso2-nexus (http://maven.wso2.org/nexus/c
>>>>>>>>>>> ontent/groups/wso2-public/)
>>>>>>>>>>>
>>>>>>>>>>> Since samoa will be used for future work, is it possible to add
>>>>>>>>>>> that in the relevant wso2 repo. Because there are still no samoa
>>>>>>>>>>> 0.4.0-incubator maven repo. only 0.3.0. we cannot continue our work
>>>>>>>>>>> with
>>>>>>>>>>> the 0.3.0 since it is outdated.
>>>>>>>>>>>
>>>>>>>>>>> thank you.
>>>>>>>>>>> regards,
>>>>>>>>>>> Mahesh.
>>>>>>>>>>>
>>>>>>>>>>> On Wed, Aug 3, 2016 at 4:29 PM, Miyuru Dayarathna <
>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Adding Jayan to this email thread.
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>> Miyuru Dayarathna
>>>>>>>>>>>> Senior Technical Lead
>>>>>>>>>>>> Mobile: +94713527783
>>>>>>>>>>>> Blog: http://miyurublog.blogspot.com
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga <[email protected]
>>>>>>>>>>>> > wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Mahesh,
>>>>>>>>>>>>>
>>>>>>>>>>>>> you should build carbon-ml *without *-U option. -U means you
>>>>>>>>>>>>> force mvn to look for updates in remote repo. Rather run it with
>>>>>>>>>>>>> -o option.
>>>>>>>>>>>>> Also, can you double check whether the dependencies are defined
>>>>>>>>>>>>> correctly
>>>>>>>>>>>>> (group Id's, versions etc).
>>>>>>>>>>>>>
>>>>>>>>>>>>> Alternatively, it seems there is a samoa released version in
>>>>>>>>>>>>> mvn repo. Maybe you could try that one as well. But that's
>>>>>>>>>>>>> v0.3.0..
>>>>>>>>>>>>>
>>>>>>>>>>>>> [1] https://mvnrepository.com/artifact/org.apache.samoa
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya <
>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi Supun,
>>>>>>>>>>>>>> I just neeed a little help. I am in the process of
>>>>>>>>>>>>>> integrating my samoa core functions and extension into
>>>>>>>>>>>>>> carbon-ml's siddhi
>>>>>>>>>>>>>> extension. For samoa i am using locally built samoa project to
>>>>>>>>>>>>>> provide
>>>>>>>>>>>>>> samoa 0.4.0 dependencies,since we dont have it in the maven repo
>>>>>>>>>>>>>> or else
>>>>>>>>>>>>>> where. But when i build carbon-ml by adding samoa dependencies,
>>>>>>>>>>>>>> it seems to
>>>>>>>>>>>>>> be maven search for remote location, not the local maven repo
>>>>>>>>>>>>>> first. I am
>>>>>>>>>>>>>> running maven with -U option. But still the problems occurs. Is
>>>>>>>>>>>>>> there any
>>>>>>>>>>>>>> specific thing in carbon-ml like settings to search remote
>>>>>>>>>>>>>> before local
>>>>>>>>>>>>>> one? I just need to give local maven repo for the dependency. My
>>>>>>>>>>>>>> extension
>>>>>>>>>>>>>> seperately working fine, so there is no problem wihat the local
>>>>>>>>>>>>>> dependencies outside carbon-ml. So can you please help me with
>>>>>>>>>>>>>> this.thank
>>>>>>>>>>>>>> you.
>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>> Mahesh.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera <
>>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi Mahesh,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya <
>>>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>>> I am onto connecting cep streams with samoa streams to data
>>>>>>>>>>>>>>>> analysis using samoa framework. To connect samoa with cep
>>>>>>>>>>>>>>>> siddhi event
>>>>>>>>>>>>>>>> streams what i we can do is that try to convert cep streams
>>>>>>>>>>>>>>>> into samoa
>>>>>>>>>>>>>>>> streams or else writing wrpper for samoa for cep streasm to
>>>>>>>>>>>>>>>> be used. In
>>>>>>>>>>>>>>>> both cases i have to covert siddhi cep streasm into samoa
>>>>>>>>>>>>>>>> streams. Samoa is
>>>>>>>>>>>>>>>> using MOA to analyse data. Moo contains ML framework to
>>>>>>>>>>>>>>>> analyse stream
>>>>>>>>>>>>>>>> data. Samoa is wrapping MOA withsome of its classes.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Samoa streams is based on MOA, Instance and
>>>>>>>>>>>>>>>> InstanceStreams. Samoa see streams as a stream of instances
>>>>>>>>>>>>>>>> [1]. So if we
>>>>>>>>>>>>>>>> are going to convert cep events into samoa instances , it will
>>>>>>>>>>>>>>>> take time.
>>>>>>>>>>>>>>>> But if we have some similarity between cep siddhi streams and
>>>>>>>>>>>>>>>> samoa streasm
>>>>>>>>>>>>>>>> we can reduce the time.
>>>>>>>>>>>>>>>> 1. What is the underlying infrastructure for cep siddhi
>>>>>>>>>>>>>>>> streasm.?
>>>>>>>>>>>>>>>> 2. Are there anything as Instances or InstanceStreams kind
>>>>>>>>>>>>>>>> of implmentation underlying cep streams?
>>>>>>>>>>>>>>>> 3. How can i get more underestanding on CEP siddhi streams.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On the other hand i can use my cep siddhi extension and put
>>>>>>>>>>>>>>>> those events into event queue and convert them into samoa
>>>>>>>>>>>>>>>> instances and
>>>>>>>>>>>>>>>> feed them into samoa streaming ml topologies.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I think this is OK. I assume this is much easier. Let's do
>>>>>>>>>>>>>>> this and check the performance.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> There is another option. In Samoa what they are basically
>>>>>>>>>>>>>>>> doing is that wrapping MOA ML framework and write some classes
>>>>>>>>>>>>>>>> for build
>>>>>>>>>>>>>>>> streaming ml topologies. So as the other option i can wrap
>>>>>>>>>>>>>>>> samoa moa with
>>>>>>>>>>>>>>>> my design and use moa ml framework directly. (No need for
>>>>>>>>>>>>>>>> Samoa extension).
>>>>>>>>>>>>>>>> I have building some topologies to streaming data analysis
>>>>>>>>>>>>>>>> [2]. Main
>>>>>>>>>>>>>>>> problem is that lack of documentation. Anyway i had go through
>>>>>>>>>>>>>>>> their whole
>>>>>>>>>>>>>>>> samoa design.thank you.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> If we use MOA directly, would we loose the distributed
>>>>>>>>>>>>>>> support in SAOMA. Let's do a call when you can, so we can
>>>>>>>>>>>>>>> dsicuss this in
>>>>>>>>>>>>>>> detail.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --Srinath
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>>>> Mahesh.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> [1] https://github.com/apache/incu
>>>>>>>>>>>>>>>> bator-samoa/blob/master/samoa-
>>>>>>>>>>>>>>>> api/src/main/java/org/apache/s
>>>>>>>>>>>>>>>> amoa/streams/clustering/ClusteringStream.java
>>>>>>>>>>>>>>>> [2] https://github.com/dananjayama
>>>>>>>>>>>>>>>> hesh/GSOC2016/tree/master/gsoc
>>>>>>>>>>>>>>>> /samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya <
>>>>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Hi Maheshakya,
>>>>>>>>>>>>>>>>> Samoa modules built as topologies that connect streams
>>>>>>>>>>>>>>>>> with the internal processors. I have already written some
>>>>>>>>>>>>>>>>> examples to test
>>>>>>>>>>>>>>>>> the ML algorithms and samoa analysis topologies. What we need
>>>>>>>>>>>>>>>>> to done is
>>>>>>>>>>>>>>>>> mostly developing a wrapper around samoa topologies to
>>>>>>>>>>>>>>>>> connect their input
>>>>>>>>>>>>>>>>> and output streams with our cep streams. So i am currently
>>>>>>>>>>>>>>>>> going through
>>>>>>>>>>>>>>>>> their stream architecture to connect our streams with their
>>>>>>>>>>>>>>>>> streams. Couple
>>>>>>>>>>>>>>>>> of examples exapaining samoa ml topologies and streaming can
>>>>>>>>>>>>>>>>> be found in my
>>>>>>>>>>>>>>>>> git hub repo [1]. Samoa using MOA ml algorithms by wrapping
>>>>>>>>>>>>>>>>> them with their
>>>>>>>>>>>>>>>>> classes. Initailly i am trying to develop a KMeansClustering
>>>>>>>>>>>>>>>>> analysis with
>>>>>>>>>>>>>>>>> cep streams with samoa ml topologies.
>>>>>>>>>>>>>>>>> And also i could not find a maven repo for samoa 0.4.0
>>>>>>>>>>>>>>>>> incubating. So i am currently using my local m2 repo's samoa
>>>>>>>>>>>>>>>>> 0..4.0
>>>>>>>>>>>>>>>>> incubating for my dependencies to work. The local one is
>>>>>>>>>>>>>>>>> built by original
>>>>>>>>>>>>>>>>> samoa source.thank you.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>>>>> Mahesh.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> [1] https://github.com/dananjayama
>>>>>>>>>>>>>>>>> hesh/GSOC2016/tree/master/gsoc
>>>>>>>>>>>>>>>>> /samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena <
>>>>>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Hi Mahesh,
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Can you please share your samoa project?
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya <
>>>>>>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> ---------- Forwarded message ----------
>>>>>>>>>>>>>>>>>>> From: Mahesh Dananjaya <[email protected]>
>>>>>>>>>>>>>>>>>>> Date: Sun, Jul 17, 2016 at 11:18 AM
>>>>>>>>>>>>>>>>>>> Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive
>>>>>>>>>>>>>>>>>>> analytic with online data for WSO2 Machine Learner-Samoa
>>>>>>>>>>>>>>>>>>> Integration
>>>>>>>>>>>>>>>>>>> To: Maheshakya Wijewardena <[email protected]>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Hi Maheshakaya,
>>>>>>>>>>>>>>>>>>> just need a little help. In Samoa when we want to run a
>>>>>>>>>>>>>>>>>>> class what is does it used this commands [1],
>>>>>>>>>>>>>>>>>>> 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
>>>>>>>>>>>>>>>>>>> "ClusteringEvaluation"
>>>>>>>>>>>>>>>>>>> 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
>>>>>>>>>>>>>>>>>>> "PrequentialEvaluation -d /tmp/dump.csv -i 1000000 -f
>>>>>>>>>>>>>>>>>>> 100000 -l
>>>>>>>>>>>>>>>>>>> (classifiers.trees.VerticalHoeffdingTree -p 4) -s
>>>>>>>>>>>>>>>>>>> (generators.RandomTreeGenerator -c 2 -o 10 -u 10)"
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> what is does is call a class named LocalDoTask [4] and
>>>>>>>>>>>>>>>>>>> pass this string as argument.After that that LocalDoTask
>>>>>>>>>>>>>>>>>>> call the relevent
>>>>>>>>>>>>>>>>>>> Tasks such as ClusteringEvaluation or
>>>>>>>>>>>>>>>>>>> PrequentialEvaluation. [2].
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Now i have add samoa dependencies to my new maven
>>>>>>>>>>>>>>>>>>> project, where i used original samoa source to write
>>>>>>>>>>>>>>>>>>> examples and test then
>>>>>>>>>>>>>>>>>>> earlier.Now i want to push them into my new java project
>>>>>>>>>>>>>>>>>>> with samoa
>>>>>>>>>>>>>>>>>>> dependencies. I added dependency and it was built fine. Now
>>>>>>>>>>>>>>>>>>> i am calling my
>>>>>>>>>>>>>>>>>>> local DoTask.java [3] file as same as i did with samoa with,
>>>>>>>>>>>>>>>>>>> java -cp target/streaming-1.0-SNAPSHOT.jar
>>>>>>>>>>>>>>>>>>> org.gsoc.samoa.streaming.DoTask
>>>>>>>>>>>>>>>>>>> "org.gsoc.samoa.streaming.ClusteringEvaluation"
>>>>>>>>>>>>>>>>>>> But seems to be i am incorrect in some place.
>>>>>>>>>>>>>>>>>>> Error: A JNI error has occurred, please check your
>>>>>>>>>>>>>>>>>>> installation and try again
>>>>>>>>>>>>>>>>>>> Exception in thread "main" java.lang.NoClassDefFoundError:
>>>>>>>>>>>>>>>>>>> org/apache/samoa/topology/ComponentFactory
>>>>>>>>>>>>>>>>>>> at java.lang.Class.getDeclaredMethods0(Native
>>>>>>>>>>>>>>>>>>> Method)
>>>>>>>>>>>>>>>>>>> at java.lang.Class.privateGetDecl
>>>>>>>>>>>>>>>>>>> aredMethods(Class.java:2701)
>>>>>>>>>>>>>>>>>>> at java.lang.Class.privateGetMeth
>>>>>>>>>>>>>>>>>>> odRecursive(Class.java:3048)
>>>>>>>>>>>>>>>>>>> at java.lang.Class.getMethod0(Class.java:3018)
>>>>>>>>>>>>>>>>>>> at java.lang.Class.getMethod(Class.java:1784)
>>>>>>>>>>>>>>>>>>> at sun.launcher.LauncherHelper.va
>>>>>>>>>>>>>>>>>>> lidateMainClass(LauncherHelper.java:544)
>>>>>>>>>>>>>>>>>>> at sun.launcher.LauncherHelper.ch
>>>>>>>>>>>>>>>>>>> eckAndLoadMain(LauncherHelper.java:526)
>>>>>>>>>>>>>>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>>>>>>>>>>>>>>> org.apache.samoa.topology.ComponentFactory
>>>>>>>>>>>>>>>>>>> at java.net.URLClassLoader.findCl
>>>>>>>>>>>>>>>>>>> ass(URLClassLoader.java:381)
>>>>>>>>>>>>>>>>>>> at java.lang.ClassLoader.loadClas
>>>>>>>>>>>>>>>>>>> s(ClassLoader.java:424)
>>>>>>>>>>>>>>>>>>> at sun.misc.Launcher$AppClassLoad
>>>>>>>>>>>>>>>>>>> er.loadClass(Launcher.java:331)
>>>>>>>>>>>>>>>>>>> at java.lang.ClassLoader.loadClas
>>>>>>>>>>>>>>>>>>> s(ClassLoader.java:357)
>>>>>>>>>>>>>>>>>>> ... 7 more
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> can i actually call the Task like this.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> BR,
>>>>>>>>>>>>>>>>>>> Mahesh.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> [1] https://samoa.incubator.apache
>>>>>>>>>>>>>>>>>>> .org/documentation/Prequential-Evaluation-Task.html
>>>>>>>>>>>>>>>>>>> [2] https://github.com/apache/incu
>>>>>>>>>>>>>>>>>>> bator-samoa/blob/releases/0.4.
>>>>>>>>>>>>>>>>>>> 0-incubating-RC0/samoa-api/src
>>>>>>>>>>>>>>>>>>> /main/java/org/apache/samoa/ta
>>>>>>>>>>>>>>>>>>> sks/ClusteringEvaluation.java
>>>>>>>>>>>>>>>>>>> [3] https://github.com/dananjayama
>>>>>>>>>>>>>>>>>>> hesh/GSOC2016/tree/master/gsoc
>>>>>>>>>>>>>>>>>>> /samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>>>>>>>>>>>>>>>>>>> [4] https://github.com/apache/incu
>>>>>>>>>>>>>>>>>>> bator-samoa/tree/releases/0.4.
>>>>>>>>>>>>>>>>>>> 0-incubating-RC0/samoa-local/s
>>>>>>>>>>>>>>>>>>> rc/main/java/org/apache/samoa
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> On Thu, Jul 14, 2016 at 3:47 PM, Mahesh Dananjaya <
>>>>>>>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> Hi srinath,
>>>>>>>>>>>>>>>>>>>> sure.i am working on it.thank you.
>>>>>>>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>>>>>>>> Mahesh.
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> On Thu, Jul 14, 2016 at 11:12 AM, Srinath Perera <
>>>>>>>>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> Hi Mahesh,
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> Let's focus on getting SAOMA work with CEP. It is OK
>>>>>>>>>>>>>>>>>>>>> to be limited to few algorithms.
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> --Srinath
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> On Thu, Jul 14, 2016 at 10:49 AM, Mahesh Dananjaya <
>>>>>>>>>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> Hi Maheshakya,
>>>>>>>>>>>>>>>>>>>>>> I think we can build new tasks [1] like the one in
>>>>>>>>>>>>>>>>>>>>>> execution plan in cep with samoa. I will try to build a
>>>>>>>>>>>>>>>>>>>>>> one.
>>>>>>>>>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>>>>>>>>>> Mahesh.
>>>>>>>>>>>>>>>>>>>>>> [1] https://samoa.incubator.apache
>>>>>>>>>>>>>>>>>>>>>> .org/documentation/Developing-New-Tasks-in-SAMOA.html
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> On Thu, Jul 14, 2016 at 10:35 AM, Mahesh Dananjaya <
>>>>>>>>>>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Hi Maheshakya,
>>>>>>>>>>>>>>>>>>>>>>> I am building and running samoa to see its
>>>>>>>>>>>>>>>>>>>>>>> functionality. In samoa still we have limited supports
>>>>>>>>>>>>>>>>>>>>>>> in algorithms. Samoa
>>>>>>>>>>>>>>>>>>>>>>> supports only classification and clustering with
>>>>>>>>>>>>>>>>>>>>>>> streams. It also use kind
>>>>>>>>>>>>>>>>>>>>>>> of StreamProcessor, like the one we use in
>>>>>>>>>>>>>>>>>>>>>>> StreamProcessor extension. I
>>>>>>>>>>>>>>>>>>>>>>> was getting started with Samoa referring to this page
>>>>>>>>>>>>>>>>>>>>>>> [1]. Then i ran
>>>>>>>>>>>>>>>>>>>>>>> couple of examples to identified the flow. Samoa use
>>>>>>>>>>>>>>>>>>>>>>> hadoop framework
>>>>>>>>>>>>>>>>>>>>>>> instead spark for distribution. But i am using it in a
>>>>>>>>>>>>>>>>>>>>>>> local mode. When i
>>>>>>>>>>>>>>>>>>>>>>> see the Samoa core there is only limited algorithms.
>>>>>>>>>>>>>>>>>>>>>>> IMO if we are going to
>>>>>>>>>>>>>>>>>>>>>>> use Samoa we have to limit the functionality and
>>>>>>>>>>>>>>>>>>>>>>> algorithms [2]. When i go
>>>>>>>>>>>>>>>>>>>>>>> to developer corner in [3], it seems to be something
>>>>>>>>>>>>>>>>>>>>>>> like CEP extension
>>>>>>>>>>>>>>>>>>>>>>> that we are using currenlty. SO in Samoa though the
>>>>>>>>>>>>>>>>>>>>>>> algorihtms are limited,
>>>>>>>>>>>>>>>>>>>>>>> they have implemented streaming support for them.
>>>>>>>>>>>>>>>>>>>>>>> Therefore if we integrate
>>>>>>>>>>>>>>>>>>>>>>> it into CEP we have to look for how to handle streams
>>>>>>>>>>>>>>>>>>>>>>> and algorithms in
>>>>>>>>>>>>>>>>>>>>>>> Samoa side. Is it good for your side to have both
>>>>>>>>>>>>>>>>>>>>>>> hadoop and spark running
>>>>>>>>>>>>>>>>>>>>>>> background.thank you.
>>>>>>>>>>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>>>>>>>>>>> Mahesh.
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> [1] https://samoa.incubator.apache
>>>>>>>>>>>>>>>>>>>>>>> .org/documentation/Home.html
>>>>>>>>>>>>>>>>>>>>>>> [2] https://samoa.incubator.apache
>>>>>>>>>>>>>>>>>>>>>>> .org/documentation/api/current/index.html
>>>>>>>>>>>>>>>>>>>>>>> [3] https://samoa.incubator.apache
>>>>>>>>>>>>>>>>>>>>>>> .org/documentation/SAMOA-Topology.html
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>> ============================
>>>>>>>>>>>>>>>>>>>>> Srinath Perera, Ph.D.
>>>>>>>>>>>>>>>>>>>>> http://people.apache.org/~hemapani/
>>>>>>>>>>>>>>>>>>>>> http://srinathsview.blogspot.com/
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>>>>>>>> Dev mailing list
>>>>>>>>>>>>>>>>>>> [email protected]
>>>>>>>>>>>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>> Pruthuvi Maheshakya Wijewardena
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> [email protected]
>>>>>>>>>>>>>>>>>> +94711228855
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>> ============================
>>>>>>>>>>>>>>> Srinath Perera, Ph.D.
>>>>>>>>>>>>>>> http://people.apache.org/~hemapani/
>>>>>>>>>>>>>>> http://srinathsview.blogspot.com/
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> *Supun Sethunga*
>>>>>>>>>>>>> Senior Software Engineer
>>>>>>>>>>>>> WSO2, Inc.
>>>>>>>>>>>>> http://wso2.com/
>>>>>>>>>>>>> lean | enterprise | middleware
>>>>>>>>>>>>> Mobile : +94 716546324
>>>>>>>>>>>>> Blog: http://supunsetunga.blogspot.com
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>> Miyuru Dayarathna
>>>>>>>>>>>> Senior Technical Lead
>>>>>>>>>>>> Mobile: +94713527783
>>>>>>>>>>>> Blog: http://miyurublog.blogspot.com
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> *Supun Sethunga*
>>>>>>>>>> Senior Software Engineer
>>>>>>>>>> WSO2, Inc.
>>>>>>>>>> http://wso2.com/
>>>>>>>>>> lean | enterprise | middleware
>>>>>>>>>> Mobile : +94 716546324
>>>>>>>>>> Blog: http://supunsetunga.blogspot.com
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> Thanks & regards,
>>>>>>>> Nirmal
>>>>>>>>
>>>>>>>> Team Lead - WSO2 Machine Learner
>>>>>>>> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
>>>>>>>> Mobile: +94715779733
>>>>>>>> Blog: http://nirmalfdo.blogspot.com/
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Thanks & regards,
>>>>> Nirmal
>>>>>
>>>>> Team Lead - WSO2 Machine Learner
>>>>> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
>>>>> Mobile: +94715779733
>>>>> Blog: http://nirmalfdo.blogspot.com/
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
--
*Supun Sethunga*
Senior Software Engineer
WSO2, Inc.
http://wso2.com/
lean | enterprise | middleware
Mobile : +94 716546324
Blog: http://supunsetunga.blogspot.com
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
