Hi Mahesh, Can you summarize the work we have done so far and the remaining work items please?
Thanks. On Tue, Jun 21, 2016 at 5:56 PM, Mahesh Dananjaya <dananjayamah...@gmail.com > wrote: > Hi Maheshakya, > I have updated the repo [2] and upto date documents can be found at > [1].thank you. > regards, > Mahesh. > [1] > https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/siddhi/extension/streaming > [2] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ml6_cml > > > On Tue, Jun 21, 2016 at 5:08 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> >> ---------- Forwarded message ---------- >> From: Mahesh Dananjaya <dananjayamah...@gmail.com> >> Date: Tue, Jun 21, 2016 at 5:08 PM >> Subject: Re: [Dev] Fwd: GSOC2016: [ML][CEP] Predictive analytic with >> online data for WSO2 Machine Learner >> To: Maheshakya Wijewardena <mahesha...@wso2.com> >> >> >> Hi Maheshakya, >> new query is like this adding spport for moving window methods. >> >> >> @Import('LinRegInput:1.0.1') >> define stream LinRegInput (salary double, rbi double, walks double, >> strikeouts double, errors double); >> >> @Export('LinRegOutput:1.0.1') >> define stream LinRegOutput (mse double); >> >> from LinRegInput#ml:streamlinreg(1, 2, 4, 100, 0.00000001, 1.0, 0.95, >> salary, rbi, walks, strikeouts, errors) >> select * >> insert into mse; >> 1=learnType >> 2=windowShift >> 4=batchSize....... >> >> windowShift is added to configure the amount of shift. i have added >> log.infe(mse) to view the MSE. >> Mahesh. >> >> On Tue, Jun 21, 2016 at 2:33 PM, Maheshakya Wijewardena < >> mahesha...@wso2.com> wrote: >> >>> Hi Mahesh, >>> >>> If you are installing features from new p2 repo into a new CEP pack, >>> then you wont need to replace those jars. >>> If you have already installed those in the CEP from a previous p2-repo, >>> then you have to un-install those features and reinstall with new p2 repo. >>> But you don't need to do this because you can just replace the jar. It's >>> easy. >>> >>> Best regards. >>> >>> On Tue, Jun 21, 2016 at 2:26 PM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> >>>> Hi Maheshakya, >>>> If i built the carbon-ml then product-ml and point new p2 repository to >>>> cep features, do i need to copy that >>>> org.wso2.carbon.ml.siddhi.extension1.1..... thing into >>>> cep_home/repository/component/... place. >>>> regards, >>>> Mahesh. >>>> >>>> On Thu, Jun 16, 2016 at 6:39 PM, Mahesh Dananjaya < >>>> dananjayamah...@gmail.com> wrote: >>>> >>>>> In MLModelhandler there's persistModel method >>>>> debug that method while trying to train a model from ML >>>>> you can see the steps it takes >>>>> don't use deep learning algorithm >>>>> any other algorithm would work >>>>> from line 777 is the section for creating the serializable object from >>>>> trained model and saving it >>>>> >>>>> >>>>> I think you don't need to directly use ML model handler >>>>> you need to use the code in that for persisting models in the >>>>> streaming algorithm >>>>> so you can add a utils class in the streaming folder >>>>> then add the persisting logic there >>>>> ignore the deeplearning section in that >>>>> only forcus on persisting spark mod >>>>> >>>>> On Wed, Jun 15, 2016 at 4:11 PM, Mahesh Dananjaya < >>>>> dananjayamah...@gmail.com> wrote: >>>>> >>>>>> Hi Maheshakya, >>>>>> I pushed the StreamingLinearRegression modules into my forked >>>>>> carbon-ml repo at branch wso2_gsoc_ml6_cml [1]. I am working on >>>>>> persisting >>>>>> model.thank you. >>>>>> Mahesh. >>>>>> [1] https://github.com/dananjayamahesh/carbon-ml >>>>>> >>>>>> On Tue, Jun 14, 2016 at 5:56 PM, Mahesh Dananjaya < >>>>>> dananjayamah...@gmail.com> wrote: >>>>>> >>>>>>> yes >>>>>>> you should develop in tha fork repo >>>>>>> clone your forked repo >>>>>>> then go into that >>>>>>> then add upstream repo as original wso2 repo >>>>>>> see the remote tracking branchs by >>>>>>> git remote -v >>>>>>> you will see the origin as your forked repo >>>>>>> to add upstream >>>>>>> git remote add upstream <wso2 repo> >>>>>>> when you change something create a new branch by >>>>>>> git checkout -b new_branch_name >>>>>>> then add and commit to this branch >>>>>>> after that push to the forked by >>>>>>> git push origin new_branch_name >>>>>>> >>>>>>> On Tue, Jun 14, 2016 at 5:32 PM, Mahesh Dananjaya < >>>>>>> dananjayamah...@gmail.com> wrote: >>>>>>> >>>>>>>> Hi Maheshakya, >>>>>>>> the above error is due to a simple mistake of not providing my >>>>>>>> local p2 repo.Now it is working and i debugged the >>>>>>>> StreamingLinearRegression model cep. >>>>>>>> regards, >>>>>>>> Mahesh. >>>>>>>> >>>>>>>> On Tue, Jun 14, 2016 at 3:19 PM, Mahesh Dananjaya < >>>>>>>> dananjayamah...@gmail.com> wrote: >>>>>>>> >>>>>>>>> Hi Maheshakya, >>>>>>>>> I did what you recommend. But when i am adding the query the >>>>>>>>> following error is appearing. >>>>>>>>> No extension exist for StreamFunctionExtension{namespace='ml'} in >>>>>>>>> execution plan "NewExecutionPlan" >>>>>>>>> >>>>>>>>> *My query is as follows, >>>>>>>>> @Import('LinRegInput:1.0.0') >>>>>>>>> define stream LinRegInput (salary double, rbi double, walks >>>>>>>>> double, strikeouts double, errors double); >>>>>>>>> >>>>>>>>> @Export('LinRegOutput:1.0.0') >>>>>>>>> define stream LinRegOutput (mse double); >>>>>>>>> >>>>>>>>> from LinRegInput#ml:streamlinreg(0, 2, 100, 0.00000001, 1.0, 0.95, >>>>>>>>> salary, rbi, walks, strikeouts, errors) >>>>>>>>> select * >>>>>>>>> insert into mse; >>>>>>>>> >>>>>>>>> I have added my files as follows, >>>>>>>>> >>>>>>>>> org.wso2.carbon.ml.siddhi.extension.streaming.StreamingLinearRegression; >>>>>>>>> org.wso2.carbon.ml.siddhi.extension.streaming.algorithm.StreamingLinearModel; >>>>>>>>> >>>>>>>>> and add following lines to ml.siddhiext >>>>>>>>> >>>>>>>>> streamlinreg=org.wso2.carbon.ml.siddhi.extension.streaming.StreamingLinearRegressionStreamProcessor >>>>>>>>> >>>>>>>>> .Then i build the carbon-ml. The replace the jar file you asked me >>>>>>>>> replace with the name changed.any thoughts? >>>>>>>>> regards, >>>>>>>>> Mahesh. >>>>>>>>> >>>>>>>>> On Tue, Jun 14, 2016 at 2:43 PM, Maheshakya Wijewardena < >>>>>>>>> mahesha...@wso2.com> wrote: >>>>>>>>> >>>>>>>>>> Hi Mahesh, >>>>>>>>>> >>>>>>>>>> You don't need to add new p2 repo. >>>>>>>>>> In the <CEP_HOME>/repository/components/plugins folder, you will >>>>>>>>>> find org.wso2.carbon.ml.siddhi.extension_some_version.jar. Replace >>>>>>>>>> this >>>>>>>>>> with >>>>>>>>>> carbon-ml/components/extensions/org.wso2.carbon.ml.siddhi.extension/target/org.wso2.carbon.ml.siddhi.extension-1.1.2-SNAPSHOT.jar. >>>>>>>>>> First rename this jar in the target folder to the jar name in the >>>>>>>>>> plugins >>>>>>>>>> folder then replace (Make sure, otherwise will not work). >>>>>>>>>> Your updates will be there in the CEP after this. >>>>>>>>>> >>>>>>>>>> Best regards. >>>>>>>>>> >>>>>>>>>> On Tue, Jun 14, 2016 at 2:37 PM, Mahesh Dananjaya < >>>>>>>>>> dananjayamah...@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Maheshakya, >>>>>>>>>>> Do i need to add p2 local repos of ML into CEP after i made >>>>>>>>>>> changes to ml extensions. Or will it be automatically updated. I am >>>>>>>>>>> trying >>>>>>>>>>> to debug my extension with the cep.thank you. >>>>>>>>>>> regards, >>>>>>>>>>> Mahesh. >>>>>>>>>>> >>>>>>>>>>> On Tue, Jun 14, 2016 at 1:57 PM, Maheshakya Wijewardena < >>>>>>>>>>> mahesha...@wso2.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Mahesh when you add your work to carbon-ml follow the bellow >>>>>>>>>>>> guidelines, it will help to keep the code clean. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> - Add only the sources code file you have newly added or >>>>>>>>>>>> changed. >>>>>>>>>>>> - Do not use add . (add all) command in git. Only use add >>>>>>>>>>>> filename >>>>>>>>>>>> >>>>>>>>>>>> I have seen in your gsoc repo that there are gitignore files, >>>>>>>>>>>> idea related files and the target folder is there. These should >>>>>>>>>>>> not be in >>>>>>>>>>>> the source code, only the source files you add. >>>>>>>>>>>> >>>>>>>>>>>> - Commit when you have done some major activity. Do not add >>>>>>>>>>>> commits always when you make a change. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Tue, Jun 14, 2016 at 12:22 PM, Mahesh Dananjaya < >>>>>>>>>>>> dananjayamah...@gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi Maheshakya, >>>>>>>>>>>>> May i seperately put the classes to ml and extensions in >>>>>>>>>>>>> carbon-core. I can put Streaming Extensions to extensions and >>>>>>>>>>>>> Algorithms/StreamingLinear Regression and StreamingKMeans in ml >>>>>>>>>>>>> core. what >>>>>>>>>>>>> is the suitable format. I will commit my changes today as >>>>>>>>>>>>> seperate branch >>>>>>>>>>>>> in my forked carbon-ml local repo.thank you. >>>>>>>>>>>>> regards, >>>>>>>>>>>>> Mahesh. >>>>>>>>>>>>> p.s: better if you can meet me via hangout. >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> Pruthuvi Maheshakya Wijewardena >>>>>>>>>>>> mahesha...@wso2.com >>>>>>>>>>>> +94711228855 >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Pruthuvi Maheshakya Wijewardena >>>>>>>>>> mahesha...@wso2.com >>>>>>>>>> +94711228855 >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >>> >>> -- >>> Pruthuvi Maheshakya Wijewardena >>> mahesha...@wso2.com >>> +94711228855 >>> >>> >>> >> >> > > _______________________________________________ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanks & regards, Nirmal Team Lead - WSO2 Machine Learner Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
