Hi Maheshakya, thank you.that's good. i have been trying to fix that for couple of days. please inform me when it will be fixed.now i have been testing the ML algorithms and trying to identify the flow and the hierarchy. is that "Put break points in train methods in Linear Regression class" means the spark/algorithms/ LinearRegrassion.java class in the org.wso2.carbon.ml.core? is that the correct file? And also i am planning to write some programs to use apache spark mllib algorithms. and i refer to [1] and some wso2 documentations to get some idea about ML structure.thank you.
BR, Mahesh. [1]nirmalfdo.blogspot.com On Tue, May 3, 2016 at 4:36 PM, Maheshakya Wijewardena <[email protected]> wrote: > Hi Mahesh, > > I have checked. It seems the issue you have encountered is cause only in > the current development branch of the product-cep. It doesn't identify the > ML siddhi extension as an extension. ML siddhi extension works fine in the > latest release of CEP (4.1.0) [1]. > Until we figure out the reason and come up with a solution, can you use > the latest CEP release for your work. It's fine to use that since you > haven't started actual development yet. > > Best regards. > > [1] http://wso2.com/products/complex-event-processor/ > > On Tue, May 3, 2016 at 3:19 PM, Maheshakya Wijewardena < > [email protected]> wrote: > >> Hi Mahesh, >> >> >>> Is is vital to use those local repo in my upcoming implementation? >> >> >> Yes. The remote p2-repo contains the p2-repos of released versions. What >> you have to develop on is the current master of the carbon-ml and >> product-ml. You can try out with the modification I have suggested. In the >> meantime, I'll verify whether the current repos are working as expected. >> >> And also i am trying to debug the carbon-ml org.wso2.carbon.ml.core by >>> putting some break point in the spark/algorithms/Linear Regression >> >> >> It's great that you have started looking at the implementation of linear >> regression as well. Put break points in train methods in LinearRegression >> class. This is being used when you run linear regression from UI. >> >> I can see some comments left behind for streaming algo as well.thank you >> >> >> You may be referring to the linear regression with SGD model. Here, >> there's no retraining with streaming data involved. The SGD with >> minibatches is used to train the model with the data set only once. >> What you have to do is create a similar mechanism to involve streaming >> data and retrain models. We will get to that part once you get comfortable >> with siddhi extensions. >> >> BTW, is it possible for you to join a call on this Friday or in the next >> week. We'll try to resolve your current issues and discuss further on >> project. >> >> Best regards. >> >> On Tue, May 3, 2016 at 1:03 PM, Mahesh Dananjaya < >> [email protected]> wrote: >> >>> Hi maheshakya, >>> Is it ok to go with p2 repo at >>> http://product-dist.wso2.com/p2/carbon/releases/wilkes/features/ rather >>> than the P2-repo at product-ml/modules/p2-profile/target/p2-repo in local >>> repo.What is the impact?.Is is vital to use those local repo in my upcoming >>> implementation?so i was trying to give remote p2 repo to cep built by >>> source and trying to debug the cep ml extension and got the same error as >>> yesterday. But pre-built product is working fine. Therefore now i am >>> trying as you described in the last email. >>> >>> And also i am trying to debug the carbon-ml org.wso2.carbon.ml.core by >>> putting some break point in the spark/algorithms/Linear Regression. I am >>> trying to trigger it with product-ml project with data set. Does that >>> Linear Regression also in UI is consuming that spark algorithms or is it in >>> another place? I can see some comments left behind for streaming algo as >>> well.thank you. >>> BR, >>> Mahesh. >>> >>> On Tue, May 3, 2016 at 9:35 AM, Maheshakya Wijewardena < >>> [email protected]> wrote: >>> >>>> Hi Mahesh, >>>> >>>> The earlier error you have mentioned may occur due to the incompatible >>>> Siddhi versions in ML p2-repo and CEP, when you add the p2-repo from >>>> prodcut-ml you built. >>>> Current siddhi version in product-cep is 3.0.6-SNAPSHOT[1], but in ML >>>> it's 3.0.2. >>>> >>>> Can you try changing the siddhi.version in carbon-ml/pom.xml to >>>> 3.0.6-SNAPSHOT, build carbon-ml, then build product-ml again. After this, >>>> add p2-repo as a local repository again to fresh CEP pack and try it out. >>>> >>>> Best regards. >>>> >>>> On Mon, May 2, 2016 at 7:02 PM, Mahesh Dananjaya < >>>> [email protected]> wrote: >>>> >>>>> Hi Maheshakya, >>>>> now i remotely debug the CEP extension for ML Prediction. What i did >>>>> was, i have all the pre-build version of CEP and ML. Therefore i used that >>>>> built CEP and did the same thing that i was doing with the source code. I >>>>> think the only change i did was install those packages from remote p2 >>>>> repo. >>>>> This was work fine and i debugged the carbon-ml >>>>> org.wso2.carbon.ml.siddhi.extension as described in the [1]. So now i have >>>>> to try same thing with the build by source content.thank you. >>>>> >>>>> [1] >>>>> https://docs.wso2.com/display/ML110/WSO2+CEP+Extension+for+ML+Predictions#WSO2CEPExtensionforMLPredictions-Siddhisyntaxfortheextension >>>>> >>>>> BR, >>>>> Mahesh >>>>> >>>>> On Mon, Apr 25, 2016 at 5:49 PM, Maheshakya Wijewardena < >>>>> [email protected]> wrote: >>>>> >>>>>> Hi Mahesh, >>>>>> >>>>>> Congratulations and welcome to GSoC 2016. You did a great job in >>>>>> preparing the proposal. Now it's time to dig deep and get started with >>>>>> the >>>>>> project. >>>>>> >>>>>> First of all you need to familiarize with the code base. We have >>>>>> agreed to implement this with CEP event streams. We already have a CEP >>>>>> extension for predictions [1][2]. Go through this implementation and >>>>>> familiarize your self with that. You need to understand how: >>>>>> >>>>>> 1. Even streams are consumed >>>>>> 2. predictions are made from individual event >>>>>> 3. Results are sent back >>>>>> >>>>>> Get WSO2 ML and CEP sources (You may use latest released version of >>>>>> CEP) and build the products. Get both carbon-ml[3] and product-ml[4] >>>>>> masters and create new branches for your work from masters. >>>>>> >>>>>> After you build the products, you may need to do remote debugging[5] >>>>>> to understand the flow. So please follow an example of real time >>>>>> prediction >>>>>> with ML with debugging and get some idea. The component you need to debug >>>>>> is org.wso2.carbon.ml.siddhi.extension. >>>>>> >>>>>> Next tasks would be implementing online learning algorithms in plain >>>>>> java with spark ml lib and integrating those to ML. We also need to come >>>>>> up >>>>>> with a proper and detailed architecture to employ those algorithms in ML. >>>>>> Getting familiar with the aforementioned sections would give you some >>>>>> insight on how this should be implemented. >>>>>> >>>>>> So please try to get a quick grasp then you can start the >>>>>> implementation. Let us know if you have any questions or you get stuck >>>>>> somewhere. >>>>>> >>>>>> Also, please always add WSO2 developer's list as well when you >>>>>> communicate with us regarding the project so that you can get opinions >>>>>> and >>>>>> feedback from others as well. >>>>>> >>>>>> Best regards. >>>>>> >>>>>> [1] >>>>>> https://docs.wso2.com/display/ML110/WSO2+CEP+Extension+for+ML+Predictions#WSO2CEPExtensionforMLPredictions-Siddhisyntaxfortheextension >>>>>> >>>>>> [2] >>>>>> https://github.com/wso2/carbon-ml/tree/master/components/extensions/org.wso2.carbon.ml.siddhi.extension >>>>>> >>>>>> [3] https://github.com/wso2/carbon-ml >>>>>> >>>>>> [4] https://github.com/wso2/product-ml >>>>>> >>>>>> [5] https://dzone.com/articles/how-debug-wso2-carbon-kernel >>>>>> >>>>>> >>>>>> On Mon, Apr 25, 2016 at 3:33 PM, Mahesh Dananjaya < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi, >>>>>>> thank you for accepting my GSOC 2016 proposal and i am looking >>>>>>> forward for the further instruction and project continuation. thank you >>>>>>> very much. >>>>>>> regards, >>>>>>> Mahesh. >>>>>>> >>>>>>> -- >>>>>> Pruthuvi Maheshakya Wijewardena >>>>>> [email protected] >>>>>> +94711228855 >>>>>> >>>>>> >>>>>> >>>>> >>>> >>>> >>>> -- >>>> Pruthuvi Maheshakya Wijewardena >>>> [email protected] >>>> +94711228855 >>>> >>>> >>>> >>> >> >> >> -- >> Pruthuvi Maheshakya Wijewardena >> [email protected] >> +94711228855 >> >> >> > > > -- > Pruthuvi Maheshakya Wijewardena > [email protected] > +94711228855 > > >
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
