Hi Mahesh,
> Is is vital to use those local repo in my upcoming implementation? Yes. The remote p2-repo contains the p2-repos of released versions. What you have to develop on is the current master of the carbon-ml and product-ml. You can try out with the modification I have suggested. In the meantime, I'll verify whether the current repos are working as expected. And also i am trying to debug the carbon-ml org.wso2.carbon.ml.core by > putting some break point in the spark/algorithms/Linear Regression It's great that you have started looking at the implementation of linear regression as well. Put break points in train methods in LinearRegression class. This is being used when you run linear regression from UI. I can see some comments left behind for streaming algo as well.thank you You may be referring to the linear regression with SGD model. Here, there's no retraining with streaming data involved. The SGD with minibatches is used to train the model with the data set only once. What you have to do is create a similar mechanism to involve streaming data and retrain models. We will get to that part once you get comfortable with siddhi extensions. BTW, is it possible for you to join a call on this Friday or in the next week. We'll try to resolve your current issues and discuss further on project. Best regards. On Tue, May 3, 2016 at 1:03 PM, Mahesh Dananjaya <[email protected]> wrote: > Hi maheshakya, > Is it ok to go with p2 repo at > http://product-dist.wso2.com/p2/carbon/releases/wilkes/features/ rather > than the P2-repo at product-ml/modules/p2-profile/target/p2-repo in local > repo.What is the impact?.Is is vital to use those local repo in my upcoming > implementation?so i was trying to give remote p2 repo to cep built by > source and trying to debug the cep ml extension and got the same error as > yesterday. But pre-built product is working fine. Therefore now i am > trying as you described in the last email. > > And also i am trying to debug the carbon-ml org.wso2.carbon.ml.core by > putting some break point in the spark/algorithms/Linear Regression. I am > trying to trigger it with product-ml project with data set. Does that > Linear Regression also in UI is consuming that spark algorithms or is it in > another place? I can see some comments left behind for streaming algo as > well.thank you. > BR, > Mahesh. > > On Tue, May 3, 2016 at 9:35 AM, Maheshakya Wijewardena < > [email protected]> wrote: > >> Hi Mahesh, >> >> The earlier error you have mentioned may occur due to the incompatible >> Siddhi versions in ML p2-repo and CEP, when you add the p2-repo from >> prodcut-ml you built. >> Current siddhi version in product-cep is 3.0.6-SNAPSHOT[1], but in ML >> it's 3.0.2. >> >> Can you try changing the siddhi.version in carbon-ml/pom.xml to >> 3.0.6-SNAPSHOT, build carbon-ml, then build product-ml again. After this, >> add p2-repo as a local repository again to fresh CEP pack and try it out. >> >> Best regards. >> >> On Mon, May 2, 2016 at 7:02 PM, Mahesh Dananjaya < >> [email protected]> wrote: >> >>> Hi Maheshakya, >>> now i remotely debug the CEP extension for ML Prediction. What i did >>> was, i have all the pre-build version of CEP and ML. Therefore i used that >>> built CEP and did the same thing that i was doing with the source code. I >>> think the only change i did was install those packages from remote p2 repo. >>> This was work fine and i debugged the carbon-ml >>> org.wso2.carbon.ml.siddhi.extension as described in the [1]. So now i have >>> to try same thing with the build by source content.thank you. >>> >>> [1] >>> https://docs.wso2.com/display/ML110/WSO2+CEP+Extension+for+ML+Predictions#WSO2CEPExtensionforMLPredictions-Siddhisyntaxfortheextension >>> >>> BR, >>> Mahesh >>> >>> On Mon, Apr 25, 2016 at 5:49 PM, Maheshakya Wijewardena < >>> [email protected]> wrote: >>> >>>> Hi Mahesh, >>>> >>>> Congratulations and welcome to GSoC 2016. You did a great job in >>>> preparing the proposal. Now it's time to dig deep and get started with the >>>> project. >>>> >>>> First of all you need to familiarize with the code base. We have agreed >>>> to implement this with CEP event streams. We already have a CEP extension >>>> for predictions [1][2]. Go through this implementation and familiarize your >>>> self with that. You need to understand how: >>>> >>>> 1. Even streams are consumed >>>> 2. predictions are made from individual event >>>> 3. Results are sent back >>>> >>>> Get WSO2 ML and CEP sources (You may use latest released version of >>>> CEP) and build the products. Get both carbon-ml[3] and product-ml[4] >>>> masters and create new branches for your work from masters. >>>> >>>> After you build the products, you may need to do remote debugging[5] to >>>> understand the flow. So please follow an example of real time prediction >>>> with ML with debugging and get some idea. The component you need to debug >>>> is org.wso2.carbon.ml.siddhi.extension. >>>> >>>> Next tasks would be implementing online learning algorithms in plain >>>> java with spark ml lib and integrating those to ML. We also need to come up >>>> with a proper and detailed architecture to employ those algorithms in ML. >>>> Getting familiar with the aforementioned sections would give you some >>>> insight on how this should be implemented. >>>> >>>> So please try to get a quick grasp then you can start the >>>> implementation. Let us know if you have any questions or you get stuck >>>> somewhere. >>>> >>>> Also, please always add WSO2 developer's list as well when you >>>> communicate with us regarding the project so that you can get opinions and >>>> feedback from others as well. >>>> >>>> Best regards. >>>> >>>> [1] >>>> https://docs.wso2.com/display/ML110/WSO2+CEP+Extension+for+ML+Predictions#WSO2CEPExtensionforMLPredictions-Siddhisyntaxfortheextension >>>> >>>> [2] >>>> https://github.com/wso2/carbon-ml/tree/master/components/extensions/org.wso2.carbon.ml.siddhi.extension >>>> >>>> [3] https://github.com/wso2/carbon-ml >>>> >>>> [4] https://github.com/wso2/product-ml >>>> >>>> [5] https://dzone.com/articles/how-debug-wso2-carbon-kernel >>>> >>>> >>>> On Mon, Apr 25, 2016 at 3:33 PM, Mahesh Dananjaya < >>>> [email protected]> wrote: >>>> >>>>> Hi, >>>>> thank you for accepting my GSOC 2016 proposal and i am looking forward >>>>> for the further instruction and project continuation. thank you very much. >>>>> regards, >>>>> Mahesh. >>>>> >>>>> -- >>>> Pruthuvi Maheshakya Wijewardena >>>> [email protected] >>>> +94711228855 >>>> >>>> >>>> >>> >> >> >> -- >> Pruthuvi Maheshakya Wijewardena >> [email protected] >> +94711228855 >> >> >> > -- Pruthuvi Maheshakya Wijewardena [email protected] +94711228855
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
