Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Turik, Denis Today GA Grid was merged into Apache Ignite. Regards, Yury -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Yury, I have removed pom.good.xml from ml module. Regards Turik -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Turik, Also please remove pom.good.xml from ml module. Regards, Yury -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Yury, I have reviewed and removed unnecessary pom files. In addition, I have updated my branch from master. Thanks. Best, Turik -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Turik, I've made a review, please check it on the github, there is a question about pom files there. Also please update your branch from master. At this point we almost ready for merge. Regards, Yury -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

> > Based on Denis' request, I understand that Oleg/Yuri will handle merging > 'pull-request' into main codebase. Exactly, I'm expecting the same. -- Denis On Tue, Feb 27, 2018 at 1:22 PM, techbysample wrote: > Denis, > > Good to hear! I am glad that GA Grid will

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Denis, Good to hear! I am glad that GA Grid will officially become apart of Apache Ignite. Based on Denis' request, I understand that Oleg/Yuri will handle merging 'pull-request' into main codebase. Let me know if there is any action for me to take at this time. Also, Denis, I will be

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Turik, All, Congratulations, the vote passed by lazy consensus. Feel free to merge the pull-request into the main code base. Oleg, Yuri, should help with this. Ping me once this happens, I would discuss documentation and promotion related questions. Please help to brag about this:

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Denis, Great! Thanks for the update. Best, Turik Campbell -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Turik, All, The IP clearance form is ready [1], and the final vote on general@incubator is on the go [2]. Once the vote passes (72 hours), I'll finalize the process letting you know when the code can be merged. [1] http://incubator.apache.org/ip-clearance/ga-grid-ignite.html [2]

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Denis, Thank you for providing status update. I look forward to hearing from you. Best, Turik Campbell -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Guys, Having troubles connecting to ASF subversion to fill in the IP clearance form today. Something messy with a networking environment in my current workplace. Anyway, checked up that we have everything in place to complete the form and finish the process. Please don't merge the pull-request

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Denis, Thank's for following up.. Please let me know once the paperwork has been completed.. In addition, I agree with releasing GA Grid as part of ML framework in Ignite 2.5. Just let me know if you require additional information beyond what I have provided. Regards, Turik Campbell --

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Sorry guys, the latest replies skimmed through my radar. I’ll arrange some time this or next week to do the paperwork. Let’s plan to release the GA library as a part of ML framework in Ignite 2.5. Luckily, we have a plenty of time for that. — Denis > On Jan 31, 2018, at 5:00 AM, Yury Babak

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Denis, >From my point of view PR looks good and ready for merge. So we waiting notification from you that all paperwork is done. Regards, Yury. -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Denis, Hello. I sent the form previously on November 20, 2017 to secret...@apache.org and cc'd you at emails: dma...@gridgain.com, dma...@apache.org. Per the emails below, I understood the document was already received by Craig L Russell. Please advise if you still require additional

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Hi Turik, The next step is to file a software grant and navigate through the IP clearance process: http://incubator.apache.org/ip-clearance/ip-clearance-template.html Once this is done, the GA Grid will be officially

Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

Denis/Yury, Please advise on next steps. JIRA: https://issues.apache.org/jira/browse/IGNITE-6899 Per recent comments from Oleg Ignatenko: "...most recent change looks good to me: the typo in MovieFitnessFunction is fixed and the rest of code is the same as it was ie everything now looks

Re: GA Grid: Request to contribute GA library to Apache Ignite

Denis/Yury, Thank you both for your valuable feedback. I will begin reviewing software grant form and submit accordingly. Also, I have created account in JIRA and submitted request for contributor permission to dev list. In addition, I will follow steps related to creating a 'pull

Re: GA Grid: Request to contribute GA library to Apache Ignite

Turik, Basically, this all is being done in parallel: - submit the software grant form. - prepare and submit the pull-request for code review. - I’ll start filling in the IP clearance form after the steps above are completed. A PMC member has to do it. - once the pull-request is reviewed and

Re: GA Grid: Request to contribute GA library to Apache Ignite

Also please check the coding guideline - https://cwiki.apache.org/confluence/display/IGNITE/Coding+Guidelines Code in PR should fits to this guideline. Regards, Yury -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: GA Grid: Request to contribute GA library to Apache Ignite

Turik, For making pull-request you should perform the following steps: 1) create JIRA account(in case you dont have one) (https://issues.apache.org/jira) 1.1) write to dev-list and ask contributors permission. 2) assign the ticket which I`ve created for you

Re: GA Grid: Request to contribute GA library to Apache Ignite

Denis, Ok. It's not clear what stage we are in this process. Do I need to fill out the IP Clearance form here? http://incubator.apache.org/ip-clearance/ip-clearance-template.html If so, I will simply model what was done for Ignite Persistence Store. Also, What about the software grant form?

Re: GA Grid: Request to contribute GA library to Apache Ignite

In addition to that, we need to push GA grid through the IP clearance process: http://incubator.apache.org/ip-clearance/ip-clearance-template.html This is how an IP clearance form looked like and process happened when GridGain was donating Ignite persistence:

Re: GA Grid: Request to contribute GA library to Apache Ignite

Turik, >From my point of view our first step is add GA Grid as is into package org.apache.ignite.ml.genetic in ML module. It shouldn't be a problem, but before this we should check that GA Grid fits to our codestyle. So please prepare pull-request with GA Grid. Also if nobody object I will

Re: GA Grid: Request to contribute GA library to Apache Ignite

Yury, Thanks for feedback. I reviewed the Trainer API at: https://github.com/apache/ignite/blob/db7697b17cf6eb94754edb2b5e200655a3610dc1/modules/ml/src/main/java/org/apache/ignite/ml/Trainer.java and also recommend approach that new "GA trainers" should be implemented that will use GA Grid".

Re: GA Grid: Request to contribute GA library to Apache Ignite

Turik, 1) Yes, it`s correct. 2.a) Model API is available, Trainer API in PR(https://github.com/apache/ignite/pull/2936) which should be merged today or tomorrow. 2.b) Yes, Trainer generates Model. Here is the Trainer interface: public interface Trainer { public M train(T data); } Regards,

Re: GA Grid: Request to contribute GA library to Apache Ignite

Denis/Yury, I updated my previous post slightly, For clarity, Please simply respond to this post and disregard previous. Upon review of your previous comments, please respond to my feedback : 1. I believe GA Grid can be implemented in separate package within ML library and operate

Re: GA Grid: Request to contribute GA library to Apache Ignite

Denis/Yury, Upon review of your previous comments, please respond to my feedback : 1. I believe GA Grid can be implemented in separate package within ML library and operate independently of other algorithms for use cases where /only /GA is required. 2. I am still not totally clear

Re: GA Grid: Request to contribute GA library to Apache Ignite

Yury, Please see inline > On Nov 7, 2017, at 12:11 PM, Yury Babak wrote: > > Denis, > > Let me clarify. > > Firstly, here gene is a single model coefficient(neuron weight, etc), > chromosomes - whole model representation. > Sounds good. Actually a chromosome can be see

Re: GA Grid: Request to contribute GA library to Apache Ignite

Denis, Let me clarify. Firstly, here gene is a single model coefficient(neuron weight, etc), chromosomes - whole model representation. Secondly GA should be implementation of Trainer API for each ML algorithm such as regression, clusterization, NNs, etc. And last but not least genetic

Re: GA Grid: Request to contribute GA library to Apache Ignite

Yuri, Turik, Considering the concept the ML is built around, it should be straightforward to adopt the genetic algorithms to it. To be more specific, Genes and Chromosomes which are the central building blocks of GA turn out to be basic ML Models. All the standard genetic

Re: GA Grid: Request to contribute GA library to Apache Ignite

Turik, Basically we have two main concepts the model and the trainer. Each machine learning method generates some model which could predict some result based on learning dataset. This model is just a function and model training is minimization of loss function, difference between model

Re: GA Grid: Request to contribute GA library to Apache Ignite

Denis/Yury, I am in favor of the second approach. Also, I envision GA Grid implemented into a separate package within the ML module. If possible, It seem's the initial priority would be merging GA Grid into the ML module such that it operates independently. Next, we can discuss/prioritize how

Re: GA Grid: Request to contribute GA library to Apache Ignite

Yury, There is no rush. So if the community agrees to accept GA as a part of ML then I would go for the second suggested approach. Turik, what’d you think about the second approach? — Denis > On Nov 3, 2017, at 8:54 AM, Yury Babak wrote: > > Hi all, > > Please let me put

Re: GA Grid: Request to contribute GA library to Apache Ignite

Hi all, Please let me put some comments about GA Grid. Actually I like it, but currently it doesn't fit to our API. I`m not sure that we could merge GA Grid as is into ML module, but we see two possibilities. First is add GA Grid as separate module like ML module. Second is adapt this genetic

Re: GA Grid: Request to contribute GA library to Apache Ignite

Hi guys, Yes, in my opinion genetic algorithms developed by Turik perfectly fit our ML component as a separate package. Look, *ML* is a building block on top of Ignite distributed storage and compute grid. Same is true about GA grid. So, why don’t we merge GA into ML? Nikita, Yuri and the

Re: GA Grid: Request to contribute GA library to Apache Ignite

Dmitriy, Hello. Unfortunately, I am not sure that I fully understand your comments: "..Is my understanding correct that GA Grid is a vertical component for genetic algorithms? So far Ignite has been a horizontal product without any vertical functionality. I personally would like to keep it

Re: GA Grid: Request to contribute GA library to Apache Ignite

Hi Turik, Is my understanding correct that GA Grid is a vertical component for genetic algorithms? So far Ignite has been a horizontal product without any vertical functionality. I personally would like to keep it this way (other community members should chime in here). I personally think it is

GA Grid: Request to contribute GA library to Apache Ignite

Igniters, GA Grid (Beta) is an in memory Genetic Algorithm (GA) for Apache Ignite used to solve complex problems by simulating biological evolution. GA's are a form of Machine Learning (ML), excellent for finding an optimal solution, among possibly thousands (or more) candidate solutions for a