---------- Forwarded message ----------
From: Mahesh Dananjaya <dananjayamah...@gmail.com>
Date: Tue, Jun 21, 2016 at 5:08 PM
Subject: Re: [Dev] Fwd: GSOC2016: [ML][CEP] Predictive analytic with online
data for WSO2 Machine Learner
To: Maheshakya Wijewardena <mahesha...@wso2.com>
Hi Maheshakya,
new query is like this adding spport for moving window methods.
@Import('LinRegInput:1.0.1')
define stream LinRegInput (salary double, rbi double, walks double,
strikeouts double, errors double);
@Export('LinRegOutput:1.0.1')
define stream LinRegOutput (mse double);
from LinRegInput#ml:streamlinreg(1, 2, 4, 100, 0.00000001, 1.0, 0.95,
salary, rbi, walks, strikeouts, errors)
select *
insert into mse;
1=learnType
2=windowShift
4=batchSize.......
windowShift is added to configure the amount of shift. i have added
log.infe(mse) to view the MSE.
Mahesh.
On Tue, Jun 21, 2016 at 2:33 PM, Maheshakya Wijewardena <mahesha...@wso2.com
> wrote:
> Hi Mahesh,
>
> If you are installing features from new p2 repo into a new CEP pack, then
> you wont need to replace those jars.
> If you have already installed those in the CEP from a previous p2-repo,
> then you have to un-install those features and reinstall with new p2 repo.
> But you don't need to do this because you can just replace the jar. It's
> easy.
>
> Best regards.
>
> On Tue, Jun 21, 2016 at 2:26 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi Maheshakya,
>> If i built the carbon-ml then product-ml and point new p2 repository to
>> cep features, do i need to copy that
>> org.wso2.carbon.ml.siddhi.extension1.1..... thing into
>> cep_home/repository/component/... place.
>> regards,
>> Mahesh.
>>
>> On Thu, Jun 16, 2016 at 6:39 PM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> In MLModelhandler there's persistModel method
>>> debug that method while trying to train a model from ML
>>> you can see the steps it takes
>>> don't use deep learning algorithm
>>> any other algorithm would work
>>> from line 777 is the section for creating the serializable object from
>>> trained model and saving it
>>>
>>>
>>> I think you don't need to directly use ML model handler
>>> you need to use the code in that for persisting models in the streaming
>>> algorithm
>>> so you can add a utils class in the streaming folder
>>> then add the persisting logic there
>>> ignore the deeplearning section in that
>>> only forcus on persisting spark mod
>>>
>>> On Wed, Jun 15, 2016 at 4:11 PM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>
>>>> Hi Maheshakya,
>>>> I pushed the StreamingLinearRegression modules into my forked carbon-ml
>>>> repo at branch wso2_gsoc_ml6_cml [1]. I am working on persisting
>>>> model.thank you.
>>>> Mahesh.
>>>> [1] https://github.com/dananjayamahesh/carbon-ml
>>>>
>>>> On Tue, Jun 14, 2016 at 5:56 PM, Mahesh Dananjaya <
>>>> dananjayamah...@gmail.com> wrote:
>>>>
>>>>> yes
>>>>> you should develop in tha fork repo
>>>>> clone your forked repo
>>>>> then go into that
>>>>> then add upstream repo as original wso2 repo
>>>>> see the remote tracking branchs by
>>>>> git remote -v
>>>>> you will see the origin as your forked repo
>>>>> to add upstream
>>>>> git remote add upstream <wso2 repo>
>>>>> when you change something create a new branch by
>>>>> git checkout -b new_branch_name
>>>>> then add and commit to this branch
>>>>> after that push to the forked by
>>>>> git push origin new_branch_name
>>>>>
>>>>> On Tue, Jun 14, 2016 at 5:32 PM, Mahesh Dananjaya <
>>>>> dananjayamah...@gmail.com> wrote:
>>>>>
>>>>>> Hi Maheshakya,
>>>>>> the above error is due to a simple mistake of not providing my local
>>>>>> p2 repo.Now it is working and i debugged the StreamingLinearRegression
>>>>>> model cep.
>>>>>> regards,
>>>>>> Mahesh.
>>>>>>
>>>>>> On Tue, Jun 14, 2016 at 3:19 PM, Mahesh Dananjaya <
>>>>>> dananjayamah...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Maheshakya,
>>>>>>> I did what you recommend. But when i am adding the query the
>>>>>>> following error is appearing.
>>>>>>> No extension exist for StreamFunctionExtension{namespace='ml'} in
>>>>>>> execution plan "NewExecutionPlan"
>>>>>>>
>>>>>>> *My query is as follows,
>>>>>>> @Import('LinRegInput:1.0.0')
>>>>>>> define stream LinRegInput (salary double, rbi double, walks double,
>>>>>>> strikeouts double, errors double);
>>>>>>>
>>>>>>> @Export('LinRegOutput:1.0.0')
>>>>>>> define stream LinRegOutput (mse double);
>>>>>>>
>>>>>>> from LinRegInput#ml:streamlinreg(0, 2, 100, 0.00000001, 1.0, 0.95,
>>>>>>> salary, rbi, walks, strikeouts, errors)
>>>>>>> select *
>>>>>>> insert into mse;
>>>>>>>
>>>>>>> I have added my files as follows,
>>>>>>>
>>>>>>> org.wso2.carbon.ml.siddhi.extension.streaming.StreamingLinearRegression;
>>>>>>> org.wso2.carbon.ml.siddhi.extension.streaming.algorithm.StreamingLinearModel;
>>>>>>>
>>>>>>> and add following lines to ml.siddhiext
>>>>>>>
>>>>>>> streamlinreg=org.wso2.carbon.ml.siddhi.extension.streaming.StreamingLinearRegressionStreamProcessor
>>>>>>>
>>>>>>> .Then i build the carbon-ml. The replace the jar file you asked me
>>>>>>> replace with the name changed.any thoughts?
>>>>>>> regards,
>>>>>>> Mahesh.
>>>>>>>
>>>>>>> On Tue, Jun 14, 2016 at 2:43 PM, Maheshakya Wijewardena <
>>>>>>> mahesha...@wso2.com> wrote:
>>>>>>>
>>>>>>>> Hi Mahesh,
>>>>>>>>
>>>>>>>> You don't need to add new p2 repo.
>>>>>>>> In the <CEP_HOME>/repository/components/plugins folder, you will
>>>>>>>> find org.wso2.carbon.ml.siddhi.extension_some_version.jar. Replace this
>>>>>>>> with
>>>>>>>> carbon-ml/components/extensions/org.wso2.carbon.ml.siddhi.extension/target/org.wso2.carbon.ml.siddhi.extension-1.1.2-SNAPSHOT.jar.
>>>>>>>> First rename this jar in the target folder to the jar name in the
>>>>>>>> plugins
>>>>>>>> folder then replace (Make sure, otherwise will not work).
>>>>>>>> Your updates will be there in the CEP after this.
>>>>>>>>
>>>>>>>> Best regards.
>>>>>>>>
>>>>>>>> On Tue, Jun 14, 2016 at 2:37 PM, Mahesh Dananjaya <
>>>>>>>> dananjayamah...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi Maheshakya,
>>>>>>>>> Do i need to add p2 local repos of ML into CEP after i made
>>>>>>>>> changes to ml extensions. Or will it be automatically updated. I am
>>>>>>>>> trying
>>>>>>>>> to debug my extension with the cep.thank you.
>>>>>>>>> regards,
>>>>>>>>> Mahesh.
>>>>>>>>>
>>>>>>>>> On Tue, Jun 14, 2016 at 1:57 PM, Maheshakya Wijewardena <
>>>>>>>>> mahesha...@wso2.com> wrote:
>>>>>>>>>
>>>>>>>>>> Mahesh when you add your work to carbon-ml follow the bellow
>>>>>>>>>> guidelines, it will help to keep the code clean.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> - Add only the sources code file you have newly added or
>>>>>>>>>> changed.
>>>>>>>>>> - Do not use add . (add all) command in git. Only use add
>>>>>>>>>> filename
>>>>>>>>>>
>>>>>>>>>> I have seen in your gsoc repo that there are gitignore files,
>>>>>>>>>> idea related files and the target folder is there. These should not
>>>>>>>>>> be in
>>>>>>>>>> the source code, only the source files you add.
>>>>>>>>>>
>>>>>>>>>> - Commit when you have done some major activity. Do not add
>>>>>>>>>> commits always when you make a change.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Tue, Jun 14, 2016 at 12:22 PM, Mahesh Dananjaya <
>>>>>>>>>> dananjayamah...@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Maheshakya,
>>>>>>>>>>> May i seperately put the classes to ml and extensions in
>>>>>>>>>>> carbon-core. I can put Streaming Extensions to extensions and
>>>>>>>>>>> Algorithms/StreamingLinear Regression and StreamingKMeans in ml
>>>>>>>>>>> core. what
>>>>>>>>>>> is the suitable format. I will commit my changes today as seperate
>>>>>>>>>>> branch
>>>>>>>>>>> in my forked carbon-ml local repo.thank you.
>>>>>>>>>>> regards,
>>>>>>>>>>> Mahesh.
>>>>>>>>>>> p.s: better if you can meet me via hangout.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Pruthuvi Maheshakya Wijewardena
>>>>>>>>>> mahesha...@wso2.com
>>>>>>>>>> +94711228855
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Pruthuvi Maheshakya Wijewardena
>>>>>>>> mahesha...@wso2.com
>>>>>>>> +94711228855
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
>
> --
> Pruthuvi Maheshakya Wijewardena
> mahesha...@wso2.com
> +94711228855
>
>
>
_______________________________________________
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
