Hi Maheshakya, I would like to know what is the structure of streaming data or what type of streaming data(video,image,etc) you except to handle here?
On Wed, Mar 23, 2016 at 11:01 AM, Supun Sethunga <[email protected]> wrote: > Hi Heshani, > > Have you started working on the project proposal? if so can you please > send us a draft to review? > > Thanks, > Supun > > On Thu, Mar 3, 2016 at 2:35 PM, Maheshakya Wijewardena < > [email protected]> wrote: > >> Hi Heshani, >> >> Please add WSO2 developers list as well when you are inquiring about >> projects because the community is interested in these projects and their >> input is vital and the decisions are made collaboratively. >> >> That said, about your request; this projects is targeted to be a GSoC >> project so the scope and the time line of the project should comply with >> the GSoC official time lines. So there should be a concrete goal and >> associated tasks that can be completed within that time frame. These tasks >> should be properly discussed with the community and finalized, so that they >> can go into the project proposal. >> If you want to continue this as your final year project, you should >> discuss about what more can be done (in addition to the components added in >> GSoC project) and also find a supervisor. But this should be done >> independently from the GSoC and you need to get approval from WSO2 for that. >> >> As a starting point (considering GSoC), you can download Machine Learner >> product, go through examples and quick start guide. >> Then you can try developing small ML applications with Spark ML lib and >> play around with Spark streaming as well. >> After getting some concrete idea, try to write a program using Spark >> Streaming and ML lib streaming linear regression, streaming k-means to >> train models with streaming data and share your you experience with us. >> >> Best regards. >> >> On Thu, Mar 3, 2016 at 12:23 PM, Heshani Herath < >> [email protected]> wrote: >> >>> Hi Maheshakya, >>> >>> I went through WSO2 ML details,as I'm doing this as the 4th year >>> research project I need more requirements to fit for the whole year, If >>> there are any requirements to be done please be kind enough to share with >>> me. >>> >>> Thank you! >>> >>> On Mon, Feb 29, 2016 at 3:19 PM, Maheshakya Wijewardena < >>> [email protected]> wrote: >>> >>>> Hi Heshani, >>>> >>>> Thank you for the interest for this project. >>>> >>>> WSO2 Machine Learner supports several learning algorithms at the >>>> moment[1]. This project intends is to leverage the existing algorithms in >>>> WSO2 Machine Learner to support streaming data. As an initiative, first you >>>> can get an idea about what WSO2 Machine Learner does and how it operates. >>>> You can download WSO2 Machine Learner from product page[2] and the the >>>> source code [3]. ML is using Apache Spark MLLib[4] for its' algorithms so >>>> it's better to read and understand what it does as well. >>>> >>>> In order to get an idea about the deliverables and the scope of this >>>> project, try to understand how Spark streaming[5] (see examples) handles >>>> streaming data. Also, have a look in the streaming algorithms[6][7] >>>> supported by MLLib. There are two approaches discussed to employ >>>> incremental learning in ML in the project proposals page. These streaming >>>> algorithms can be directly used in the first approach. For the other >>>> approach, the your implementation should contain a procedure to create mini >>>> batches from streaming data with relevant sizes (i.e. a moving window) and >>>> do periodic retraining of the same algorithm. >>>> >>>> To start with the project, you will need to come up with a suitable >>>> plan and an architecture first. >>>> >>>> Please watch the video referenced in the proposal (reference: 5). It >>>> will help you getting a better idea about machine learning algorithms with >>>> streaming data. >>>> >>>> Let us know if you need any help with these. >>>> >>>> Best regards >>>> >>>> [1] https://docs.wso2.com/display/ML110/Machine+Learner+Algorithms >>>> [2] http://wso2.com/products/machine-learner/ >>>> [3] >>>> https://docs.wso2.com/display/ML110/Building+from+Source#BuildingfromSource-Downloadingthesourcecheckout >>>> [4] https://spark.apache.org/docs/1.4.1/mllib-guide.html >>>> [5] >>>> https://spark.apache.org/docs/1.4.1/streaming-programming-guide.html >>>> [6] >>>> https://spark.apache.org/docs/1.4.1/mllib-linear-methods.html#streaming-linear-regression >>>> [7] >>>> https://spark.apache.org/docs/1.4.1/mllib-clustering.html#streaming-k-means >>>> >>>> On Mon, Feb 29, 2016 at 2:54 PM, Heshani Herath < >>>> [email protected]> wrote: >>>> >>>>> Hi, >>>>> >>>>> >>>>> https://docs.wso2.com/display/GSoC/Project+Proposals+for+2016#ProjectProposalsfor2016-Proposal6:[ML]PredictiveanalyticswithonlinedataforWSO2MachineLearner >>>>> >>>>> I'm a 4th year undergraduate from SLIIT faculty of >>>>> computing(specializing in Software Engineering) who is interested in doing >>>>> the aforementioned project as the final year research. I would like to >>>>> know >>>>> more details on this topic and the procedure to be followed when >>>>> implementing it. Please be kind enough to reply as soon as possible. >>>>> >>>>> Thank you >>>>> >>>>> -- >>>>> Best Regards, >>>>> Heshani Herath >>>>> >>>> >>>> >>>> >>>> -- >>>> Pruthuvi Maheshakya Wijewardena >>>> [email protected] >>>> +94711228855 >>>> >>>> >>>> >>> >>> >>> -- >>> Best Regards, >>> Heshani Herath >>> >> >> >> >> -- >> Pruthuvi Maheshakya Wijewardena >> [email protected] >> +94711228855 >> >> >> >> _______________________________________________ >> Dev mailing list >> [email protected] >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > *Supun Sethunga* > Software Engineer > WSO2, Inc. > http://wso2.com/ > lean | enterprise | middleware > Mobile : +94 716546324 > -- Best Regards, Heshani Herath
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
