Re: How to update Documentation 2.8 docs? - IGNITE-8532 [ML] GA Grid - Implement Roulette Wheel Selection

[techbysample]

Dmitriy,

Thanks.  I will update ML documentation when it is available for my.

ticket: https://issues.apache.org/jira/browse/IGNITE-8532


Thanks.

Turik




--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: How to update Documentation 2.8 docs? - IGNITE-8532 [ML] GA Grid - Implement Roulette Wheel Selection

[techbysample]

Igniters,

Would you please advise on when 2.8 documentation will be available?

I need to make updates to Genetic Algorithm section of ML to support

ticket: https://issues.apache.org/jira/browse/IGNITE-8532

Best,
Turik



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

IGNITE-8532 [ML] GA Grid - Implement Roulette Wheel Selection

[techbysample]

Yury,

I will need to make an update to Genetic Algorithms section of Ignite ReadMe
documentation in support of this ticket. 

Please advise on when https://apacheignite.readme.io/v2.8/docs will be
available so I may update accordingly.

Best,
Turik



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: [VOTE] Apache Ignite 2.5.0 RC1

[techbysample]

+1

Verified build from source. Checked ML's genetic algorithms.

Regards,
Turik 



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Apache Ignite 2.5 release: Can IGNITE-8041 be included?

[techbysample]

Denis/Yury,

Can this ticket be include in 2.5?: 
This is very isolated, as I have added another example for GA Grid.
Ticket is presently planned for  2.6.

Ticket Number  
Description
https://issues.apache.org/jira/browse/IGNITE-8041 Add a GA Grid example that
solves 'Knapsack Problem' 


Please advise.

Best,
Turik 





--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

[GitHub] ignite pull request #3947: IGNITE-8041: Add a GA Grid example that solves 'K...

[techbysample]

GitHub user techbysample opened a pull request:

https://github.com/apache/ignite/pull/3947

IGNITE-8041: Add a GA Grid example that solves 'Knapsack Problem'

Add a GA Grid example that solves 'Knapsack Problem'

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/techbysample/ignite ignite-8041

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/3947.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3947


commit 9beafa738d8a60df5049f5d418f2742459dbafe1
Author: Turik Campbell <admin@...>
Date:   2018-05-03T02:51:22Z

IGNITE-8041: Add a GA Grid example that solves 'Knapsack Problem

commit f62a224877a2d7acadf92e532914196370970556
Author: Turik Campbell <admin@...>
Date:   2018-05-04T20:18:50Z

IGNITE-8041: Update terminate criteria to perform 30 generations

commit fdb3eddbe22344f0c36e1b04a233bd9860d934d8
Author: Turik Campbell <admin@...>
Date:   2018-05-04T21:20:20Z

IGNITE-8041: Merge branch 'master' into ignite-8041

commit 756633f8d3122bc2f2e5b700dc2d4a5e882f0686
Author: Turik Campbell <admin@...>
Date:   2018-05-04T21:26:12Z

IGNITE-8041: Updated comments to reflect GA Grid performing 30 genrations




---

Re: GA Grid Documentation for 2.5

[techbysample]

Akmal,

I have updated documentation for GA Grid in support of Ignite 2.5.

Please review.

https://issues.apache.org/jira/browse/IGNITE-8350

Best,
Turik





--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: GA Grid Documentation for 2.5

[techbysample]

Denis,

I am in the process of updating docs and just created ticket:

https://issues.apache.org/jira/browse/IGNITE-8350

I will assign to Akmal for final review once I have completed.

Best,
Turik



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

GA Grid: Can IGNITE-8242 be include in 2.5 release?

[techbysample]

Denis/Yury

Can ticket https://issues.apache.org/jira/browse/IGNITE-8242  be included
within 2.5 release?
Upon review of my tickets today, I noticed the fixed version was updated
from 2.5 to 2.6?

This ticket addresses a minor bug in GA Grid.

I have removed method GAGridUtils.getGenesForChromosome() as it is
problematic when Chromosome contains duplicate genes.

GAGridUtils.getGenesInOrderForChromosome() will be used instead.

Please advise.

Turik



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

[GitHub] ignite pull request #3813: IGNITE-8242: Remove method GAGridUtils.getGenesFo...

[techbysample]

GitHub user techbysample opened a pull request:

https://github.com/apache/ignite/pull/3813

IGNITE-8242: Remove method GAGridUtils.getGenesForChromosome() as pro…

Remove method GAGridUtils.getGenesForChromosome() as problematic when 
Chromosome contains duplicate genes. GAGridUtils.getGenesInOrderForChromosome() 
will be used instead.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/techbysample/ignite ignite-8242

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/3813.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3813


commit bf08d83546d9f11333894f88527d34cad2c5418b
Author: Turik Campbell <admin@...>
Date:   2018-04-13T01:27:57Z

IGNITE-8242: Remove method GAGridUtils.getGenesForChromosome() as 
problematic when Chromosome contains duplicate genes.
 GAGridUtils.getGenesInOrderForChromosome() will be used 
instead.




---

[GitHub] ignite pull request #3638: IGNITE-7916: GA Grid examples should be ready for...

[techbysample]

GitHub user techbysample opened a pull request:

https://github.com/apache/ignite/pull/3638

IGNITE-7916: GA Grid examples should be ready for auto run on TeamCity

 Removed Ignition.stop(true) to prevent shutdown of examples within build.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/techbysample/ignite ignite-7916

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/3638.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3638


commit 6da25a491721121490a5b868295e5496392fed22
Author: Turik Campbell <admin@...>
Date:   2018-03-14T23:15:04Z

IGNITE-7916: Removed Ignition.stop(true) to prevent shutdown of examples 
within build.

commit 7d5e74eb97e8a5ebbe9f2a640f9f36aae5adb2be
Author: Turik Campbell <admin@...>
Date:   2018-03-14T23:19:16Z

IGNITE-7916: Merge branch 'master' into ignite-7916




---

Re: Ignite contibutors page

[techbysample]

Denis,

Please add my name as well.

Best
Turik Campbell





--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Yury,

I have removed pom.good.xml from ml module.

Regards
Turik



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Yury,

I have reviewed and removed unnecessary pom files.

In addition, I have updated my branch from master.

Thanks.

Best,
Turik




--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis,

Good to hear!  I am glad that GA Grid will officially become apart of Apache
Ignite.

Based on Denis' request, I understand that Oleg/Yuri will handle merging
'pull-request' into main codebase.

Let me know if there is any action for me to take at this time.

Also, Denis, I will be reaching out to you very soon to discuss next steps.

Best,
Turik Campbell
NetMillennium, Inc.



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis,

Great! Thanks for the update.

Best,
Turik Campbell



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis,

Thank you for providing status update.  I look forward to hearing from you.

Best,
Turik Campbell



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis,

Thank's for following up.. Please let me know once the paperwork has been
completed..

In addition, I agree with releasing GA Grid as part of ML framework in
Ignite 2.5.

Just let me know if you require  additional information beyond what I have
provided.

Regards,
Turik Campbell





--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis,

Hello. 

I sent the form previously on  November 20, 2017 to secret...@apache.org and
cc'd  you at emails: dma...@gridgain.com, dma...@apache.org.

Per the emails below, I understood the document was already received by
Craig L Russell.

Please advise if you still require additional information from me.

Thank you.

Best,
Turik Campbell

On 2017-11-20 17:22, Turik Campbell wrote:
> To whom it may concern,
> 
> Attached you will find a copy of the 'Software Grant Agreement'
> to donate GA Grid to Apache Ignite.
> 
> Please advise.
> 
> Best,
> Turik Campbell
> NetMillennium, Inc.
> 866.300.2393
> 
> 

On 2017-11-20 18:37, Craig L Russell wrote:
> Dear Turik Campbell,
> 
> This message acknowledges receipt of the following document, which has
> been filed in the Apache Software Foundation records:
> 
>   Software Grant from NetMillennium, Inc.
> 
> -- Craig L Russell
> Secretary, Apache Software Foundation






--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Next Steps: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis/Yury, 

Please advise on next steps.

JIRA:  https://issues.apache.org/jira/browse/IGNITE-6899

Per recent comments from Oleg Ignatenko:

"...most recent change looks good to me: the typo in MovieFitnessFunction is
fixed and the rest of code is the same as it was ie everything now looks
right.."

Please advise.

Best,
Turik Campbell




--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

[GitHub] ignite pull request #3347: IGNITE-6899: Adding GA Grid to Apache Ignite ML m...

[techbysample]

GitHub user techbysample opened a pull request:

https://github.com/apache/ignite/pull/3347

IGNITE-6899: Adding GA Grid to Apache Ignite ML module

IGNITE-6899: Adding GA Grid to Apache Ignite ML module

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/techbysample/ignite ignite-6899

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/3347.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3347


commit 5c204d7b433f043fdce25be0330d7793767ea99f
Author: Turik Campbell <admin@...>
Date:   2018-01-09T22:06:18Z

IGNITE-6899: Adding GA Grid to Apache Ignite ML module




---

Re: Documentation for GA Grid: GA library to Apache Ignite

[techbysample]

Igor,

Thanks!  I am able to update page as expected now.

Best,
Turik 



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Documentation for GA Grid: GA library to Apache Ignite

[techbysample]

Denis,

Up on logging in, I do not see the Admin panel that you described.

I have attached a screen shot for you review.



 

There is only 'Suggest Edits' option.

Is there something I missed?

Please advise.

Best,
Turik



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Documentation for GA Grid: GA library to Apache Ignite

[techbysample]

Denis,

Thanks. In review, I noticed that  when I edit page:

"https://apacheignite.readme.io/v2.3/docs/genetic-algorithms;, my updates do
not appear instantly.

Is this the correct behavior of ReadMe?

I assumed that updates were 'instant' akin to blogging..

Please advise.

Regards,
Turik 



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Documentation for GA Grid: GA library to Apache Ignite

[techbysample]

Denis,

Where do you want me to implement documenation for GA Grid? 
(https://issues.apache.org/jira/browse/IGNITE-6899)
I have implemented examples, but believe more information is necessary..

IE: I see that when Persistent Store was implemented docs were
placed here:
https://cwiki.apache.org/confluence/display/IGNITE/Persistent+Store+Overview
But, not really sure.

Does it make since at this stage in process to implement on Ignite's ReadMe
pages?
If so,  I thought a section  called 'Genetic Algorithm (ie: GA Grid)' could 
go under the Machine Learning topic.
https://apacheignite.readme.io/docs/machine-learning


Please advise, and if necessary grant appropriate access.

Regards, 
Turik 



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis/Yury,

Thank you both for your valuable feedback.

I will begin reviewing software grant form and submit accordingly.

Also, I have created account in JIRA and submitted request for contributor
permission to 
dev list.

In addition, I will follow steps related to creating a 'pull request'
provide by Yury in post:
http://apache-ignite-developers.2346864.n4.nabble.com/template/NamlServlet.jtp?macro=print_post=24207

I will follow up if I have additional questions.


Best,
Turik





--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Request for Contributers permission

[techbysample]

Ignite Community,

Would you please provide me with contributor permissions? 

JIRA account: netmille

Best,
Turik




--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis,

Ok.  It's not clear what stage we are in this process. 

Do I need to fill out the IP Clearance form here?
http://incubator.apache.org/ip-clearance/ip-clearance-template.html
If so, I will simply model what was done for Ignite Persistence Store.

Also, What about the software grant form? When will it be provided?

Will I follow steps/guidelines here for pull request?:
https://cwiki.apache.org/confluence/display/IGNITE/How+to+Contribute#HowtoContribute-
(Section: 1. Create GitHub pull-request)

Please advise on general order of steps in this whole process..

Regards,
Turik





--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Yury,

Thanks for feedback.

I reviewed the Trainer API at:
https://github.com/apache/ignite/blob/db7697b17cf6eb94754edb2b5e200655a3610dc1/modules/ml/src/main/java/org/apache/ignite/ml/Trainer.java
 
and also recommend approach that new "GA trainers" should be implemented
that will use GA Grid".


Denis/Yury,

Please advise on next steps based on most recent posts.

Best,
Turik





--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis/Yury,

I updated my previous post slightly, 
For clarity, Please simply respond to this post and disregard previous.

Upon review of your previous comments,  please respond to my feedback :
 
1.  I believe GA Grid can be implemented in separate package within ML
library and operate independently  of other algorithms for use cases where
/only /GA is required.

2.   I am still not totally clear concerning Trainer and Model relationship
in the ML API.

 a. Since org.apache.ignite.ml.Trainer and
org.apache.ignite.ml.Model
are not available, when is it planned to be available? 

  Please advise when available.

 b.  Based on  Yury's comments:
 
"...For both concepts we have API: org.apache.ignite.ml.Model and
org.apache.ignite.ml.Trainer. So if we want to use genetic algoritm for
model trainig we should implement specific trainer for each ML algorithms
like lin regression, kmean, decision tree and others.

For example let`s take a look on lin regression. Currently we have OLS
(Ordinary Least Squares) multiple linear regression. For this regression we
will have OLSRegressionModel and at least two possible trainers: analytical
trainer (a solution of matrix equation, analytical solution) and gradient
descent (numerical solution). And also we could implement GA trainer which
will use GA Grid... "

Do org.apache.ignite.ml.Trainer generate org.apache.ignite.ml.Models?
This part is still not clear..

  Please advise and clarify accordingly.


Best,
Turik 



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis/Yury,

Upon review of your previous comments,  please respond to my feedback :
 
1.  I believe GA Grid can be implemented in separate package within ML
library and operate independently  of other algorithms for use cases where
/only /GA is required.

2.   I am still not totally clear concerning Trainer and Model relationship
in the ML API.

 a. Am I correct that org.apache.ignite.ml.Trainer and
org.apache.ignite.ml.Model
API is not available as it is under development? Please advise.

 b.  Based on  Yury's comments: 
  
"...For both concepts we have API: org.apache.ignite.ml.Model and 
org.apache.ignite.ml.Trainer. So if we want to use genetic algoritm for 
model trainig we should implement specific trainer for each ML algorithms 
like lin regression, kmean, decision tree and others. 

For example let`s take a look on lin regression. Currently we have OLS 
(Ordinary Least Squares) multiple linear regression. For this regression we 
will have OLSRegressionModel and at least two possible trainers: analytical 
trainer (a solution of matrix equation, analytical solution) and gradient 
descent (numerical solution). And also we could implement GA trainer which 
will use GA Grid... "

Do org.apache.ignite.ml.Trainer generate org.apache.ignite.ml.Models?

  Please advise and clarify accordingly.

Best,
Turik

  


  





 is an algorithm that generates 



training algorithm builds a mode



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Denis/Yury,

I am in favor of the second approach.  Also, I envision GA Grid implemented
into a separate package within the ML module.  

If possible, It seem's the initial priority would be merging GA Grid into
the ML module such that it operates independently. Next, we can
discuss/prioritize how best other ML algorithms could utilize GA Grid.(ie:
implement trainers based on GA Grid as you mentioned)
I am not very familiar with 'trainer' concepts in  ML but don't see it as an
issue.


Please advise.

Best,
Turik



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Dmitriy,

Hello. Unfortunately, I am not sure that I fully understand your comments:  

"..Is my understanding correct that GA Grid is a vertical component for 
genetic algorithms?  So far Ignite has been a horizontal product without any 
vertical functionality. I personally would like to keep it this way.."

Would you please clarify?

I simply view GA Grid as a software component that implements a distributive
Genetic Algorithm (GA). 
GA Grid relies on Apache Ignite's major features: advanced clustering,
compute grid, data grid, etc.

Here is a diagram of how GA Grid relates to other components within Ignite:


 

Based my earlier discussion with Denis M., I assumed GA Grid could be added
to the collection of ML algorithms within ML Grid, since GA's are a type of
'Machine Learning" algorithms.  

If it is determined that GA Grid would not fit into Apache Ignite
architecturally, I would consider including
it as separate Apache project.

Denis, would you please add your feedback as well?

Please advise.

Best,
Turik 




--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

GA Grid: Request to contribute GA library to Apache Ignite

[techbysample]

Igniters,

GA Grid (Beta) is an in memory Genetic Algorithm (GA) for Apache Ignite used
to solve complex problems by simulating biological evolution.
GA's are a form of Machine Learning (ML), excellent for finding an optimal
solution, among possibly thousands (or more) candidate solutions for a given
domain.

GA Grid was developed by NetMillennium Inc, Inc outside of Apache Ignite
platform as a proof of concept to determine feasibility in the GA space.
In GA Grid, all genetic operations: Fitness Calculation, Crossover, and
Mutation  are modeled as a ComputeTask for distributive behavior.  Also,
these ComputeTasks leverage Apache Ignite's Affinity Colocation to route
ComputeJobs to respective nodes where Chromosomes are stored in cache.

After it's initial release, Denis Magda inquired about the possibility of
donating GA Grid to Apache Ignite. Per discussions with Denis, he believed
GA Grid would be well suited as an extension to Apache Ignite's ML library. 
Currently, NetMillennium, Inc. has agreed to begin the process of donating
GA Grid to Apache Ignite. 

With it's latest release, GA Grid enhances knowledge discovery by providing
custom SQL functions to 'pivot' genetic optimization results. This enables
improved visualizations inside Apache Zeppelin.

To learn more about GA Grid please visit:

https://github.com/techbysample/gagrid

Check out my recent post on how GA Grid for Ignite integrates with Zeppelin:

https://www.linkedin.com/post/edit/apache-ignite-visualize-ga-grid-solutions-deep-turik-campbell

Please advise.

Best Regards,
Turik Campbell
NetMillennium, Inc.



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Ignite Add-on/Extension Request: Please add GA Grid (beta) to Ignite website

[techbysample]

Dennis/Prachi,

Thanks you! Please include GA Grid Architecture within the addon section..

For example, Here is content from my initial post in Ignite users forum:

http://apache-ignite-users.70518.x6.nabble.com/GA-Grid-Beta-Genetic-Algorithm-component-for-Ignite-is-here-td16041.html

Best
Turik 



--
View this message in context: 
http://apache-ignite-developers.2346864.n4.nabble.com/Ignite-Add-on-Extension-Request-Please-add-GA-Grid-beta-to-Ignite-website-tp20947p21042.html
Sent from the Apache Ignite Developers mailing list archive at Nabble.com.

Ignite Add-on/Extension Request: Please add GA Grid (beta) to Ignite website

[techbysample]

Forum Admin,

Please add project:

GA Grid (beta): Distributive in Memory Genetic Algorithm component for
Ignite

to "Addons and Extensions" section of Apache Ignite website:

https://ignite.apache.org/addons.html

<http://apache-ignite-developers.2346864.n4.nabble.com/file/n20947/GAGrid_Overview.png>
 

(F)itness Calculation, (C)rossover, and (M)utation operations are modeled as
a ComputeTask for distributive behavior. The ComputeTask is split into
multiple ComputeJobs, (ie: Fn,Cn,Mn) assigned to respective nodes, and
executed in parallel.

All of these ComputeTasks leverage Apache Ignite's Affinity Colocation to
route ComputeJobs to respective nodes where Chromosomes are stored in cache.

Additional information about GA Grid (beta) found here:

https://github.com/techbysample/gagrid 

Please advise.

Best,
Turik Campbell



--
View this message in context: 
http://apache-ignite-developers.2346864.n4.nabble.com/Ignite-Add-on-Extension-Request-Please-add-GA-Grid-beta-to-Ignite-website-tp20947.html
Sent from the Apache Ignite Developers mailing list archive at Nabble.com.