Continuing Spark related topic... This ticket definitely must be included in 1.9: https://issues.apache.org/jira/browse/IGNITE-3710 <https://issues.apache.org/jira/browse/IGNITE-3710>
We can’t longer afford torture Ignite Shared RDD users who have to use an outdated Spark version. Anton, could you finalize it this week? As far as I remember, the only thing that is left is to add a missing test suite to Team City. — Denis > On Feb 14, 2017, at 5:00 PM, Denis Magda <dma...@apache.org> wrote: > > Reviewed and merged the first (!) Ignite Shared RDD examples contributed by > Manish: > > https://issues.apache.org/jira/browse/IGNITE-4526 > > Java: > https://github.com/apache/ignite/blob/b461cb47882861356ede58775bd9e253dcf26202/examples/src/main/java8/org/apache/ignite/examples/java8/spark/SharedRDDExample.java > > Scala: > https://github.com/apache/ignite/blob/b461cb47882861356ede58775bd9e253dcf26202/examples/src/main/scala/org/apache/ignite/scalar/examples/spark/ScalarSharedRDDExample.scala > > Manish, thanks for making the life of Apache Ignite users easier. No they can > refer to your examples while learning Ignite Shared RDD API. > > — > Denis > >> On Feb 14, 2017, at 1:21 AM, Anton Vinogradov <avinogra...@gridgain.com> >> wrote: >> >>> >>> Can we push to 1.9 and then merge/rebase to master? >> >> >> Yes, that's *correct *too, but only *megre *should be used. >> >> On Tue, Feb 14, 2017 at 12:19 PM, Vladimir Ozerov <voze...@gridgain.com> >> wrote: >> >>> Can we push to 1.9 and then merge/rebase to master? It should be more >>> reliable than cherry-picking. >>> >>> On Tue, Feb 14, 2017 at 12:15 PM, Anton Vinogradov < >>> avinogra...@gridgain.com >>>> wrote: >>> >>>> Denis, >>>> >>>> Merge to the master first and then cherry-pick to 1.9 from there is a >>>> *correct >>>> *case. >>>> >>>> On Tue, Feb 14, 2017 at 5:24 AM, Dmitriy Setrakyan < >>> dsetrak...@apache.org> >>>> wrote: >>>> >>>>> Thanks, Denis! >>>>> >>>>> On Mon, Feb 13, 2017 at 5:49 PM, Denis Magda <dma...@apache.org> >>> wrote: >>>>> >>>>>> Well, merged Kubernetes integration to the master and cherry-picked >>> to >>>>>> 1.9. The docs and getting started for readme.io to be done soon. >>>>>> >>>>>> — >>>>>> Denis >>>>>> >>>>>>> On Feb 13, 2017, at 9:10 AM, Denis Magda <dma...@apache.org> >>> wrote: >>>>>>> >>>>>>> Do I merge to the master first and then cherry-pick to 1.9 from >>>> there? >>>>>>> >>>>>>> — >>>>>>> Denis >>>>>>> >>>>>>>> On Feb 13, 2017, at 8:21 AM, Anton Vinogradov < >>>>> avinogra...@gridgain.com> >>>>>> wrote: >>>>>>>> >>>>>>>> Igniters, >>>>>>>> >>>>>>>> We're starting release stabilization process. >>>>>>>> Branch 1.9 created and equals to master branch right now. >>>>>>>> >>>>>>>> Please make sure that your changes will be merged to both >>> branches: >>>>>>>> *ignite-1.9* and *master*. >>>>>>>> >>>>>>>> On Fri, Feb 10, 2017 at 4:53 PM, Sergey Kalashnikov < >>>>>> zkilling...@gmail.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Anton, >>>>>>>>> >>>>>>>>> Here is the status for IGNITE-4523. >>>>>>>>> The work is completed, tests are OK. >>>>>>>>> Most of the changes were made by Alexey and were reviewed. >>>>>>>>> I only authored few last commits for which I would appreciate a >>>>> review. >>>>>>>>> The PR is https://github.com/apache/ignite/pull/1508 >>>>>>>>> >>>>>>>>> Thank you >>>>>>>>> -- >>>>>>>>> Sergey >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> 2017-02-09 23:58 GMT+03:00 Denis Magda <dma...@apache.org>: >>>>>>>>> >>>>>>>>>> Anton, >>>>>>>>>> >>>>>>>>>> You can expect Kubernetes support from me in time. >>>>>>>>>> >>>>>>>>>> — >>>>>>>>>> Denis >>>>>>>>>> >>>>>>>>>>> On Feb 9, 2017, at 1:52 AM, Anton Vinogradov <a...@apache.org> >>>>> wrote: >>>>>>>>>>> >>>>>>>>>>> Igniters, >>>>>>>>>>> >>>>>>>>>>> We're on a half way to Ignite 1.9. >>>>>>>>>>> Development phase will be finished 17th of February. >>>>>>>>>>> >>>>>>>>>>> Here <https://cwiki.apache.org/confluence/display/IGNITE/ >>>>>>>>>> Apache+Ignite+1.9> is >>>>>>>>>>> a status page for upcoming release. >>>>>>>>>>> >>>>>>>>>>> According to this page we have some Issues we *especially >>> *expect >>>>> in >>>>>>>>> 1.9: >>>>>>>>>>> >>>>>>>>>>> IGNITE-4106 SQL: parallelize sql queries over cache local >>>>> partitions >>>>>>>>>> Andrew >>>>>>>>>>> Mashenkov >>>>>>>>>>> IGNITE-3860 Improve distributed SQL support. Sergi Vladykin >>>>>>>>>>> IGNITE-4539 RocketMQ data streamer Roman Shtykh >>>>>>>>>>> IGNITE-4212 Ignite Benchmarking Simplification and Automation >>>> Oleg >>>>>>>>>> Ostanin >>>>>>>>>>> IGNITE-4523 Allow distributed SQL query execution over explicit >>>> set >>>>>> of >>>>>>>>>>> partitions Alexei Scherbakov >>>>>>>>>>> IGNITE-3013 Support sorted merge index for SQL Sergi Vladykin >>>>>>>>>>> IGNITE-4169 Data streamer mode for DML Alexander Paschenko >>>>>>>>>>> IGNITE-4670 CPP: Implement LoadCache method Unassigned (Igor >>>>> Sapego, >>>>>>>>>> seems >>>>>>>>>>> you're the best person) >>>>>>>>>>> IGNITE-4159 Cloud Native Deployment of Apache Ignite using >>>>> Kubernetes >>>>>>>>>> Denis >>>>>>>>>>> Magda >>>>>>>>>>> IGNITE-4526 Add Spark Shared RDD examples Manish Mishra >>>>>>>>>>> IGNITE-4674 Ignite Web Console: Support DML queries Alexey >>>>> Kuznetsov >>>>>>>>>>> IGNITE-1794 Ignite should support Hibernate 5 Mykola Pereyma >>>>>>>>>>> >>>>>>>>>>> Guys, please confirm that you will be able to complete listed >>>> tasks >>>>>> by >>>>>>>>>> 17th >>>>>>>>>>> of February. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Fri, Feb 3, 2017 at 5:32 AM, Denis Magda <dma...@apache.org >>>> >>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> Excellent news Roman! Please keep us posted. >>>>>>>>>>>> >>>>>>>>>>>> — >>>>>>>>>>>> Denis >>>>>>>>>>>> >>>>>>>>>>>>> On Feb 2, 2017, at 6:26 PM, Roman Shtykh >>>>> <rsht...@yahoo.com.INVALID >>>>>>> >>>>>>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>> Denis, >>>>>>>>>>>>> RocketMQ data streamer implementation is almost ready. But >>>> there >>>>>> are >>>>>>>>> no >>>>>>>>>>>> binaries in maven repositories now (it will be their 1st >>> release >>>>>> under >>>>>>>>>>>> Apache license). The release is very close to starting voting >>>> for, >>>>>> so >>>>>>>>>>>> hopefully it can be done in the middle of February. >>>>>>>>>>>>> Roman >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Wednesday, February 1, 2017 4:13 AM, Denis Magda < >>>>>>>>>>>> dma...@apache.org> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> Igniters, >>>>>>>>>>>>> Looks like 2.0 will be slightly delayed since the community >>>>>> requires >>>>>>>>>>>> more time to make the new page memory architecture faster. At >>>> the >>>>>> same >>>>>>>>>> time >>>>>>>>>>>> we have a plenty of bug fixes and performance improvements >>> that >>>>> were >>>>>>>>>> merged >>>>>>>>>>>> or close to be merged into the master and ready to be >>> released. >>>>>>>>>>>>> I propose to release all the changes we have in 1.9 close to >>>> the >>>>>> end >>>>>>>>> of >>>>>>>>>>>> February. >>>>>>>>>>>>> According to the dev list discussions, we will be ready to >>>>> release >>>>>>>>>>>> performance optimizations done by Yakov and Sam close to the >>> end >>>>> of >>>>>>>>> 2016 >>>>>>>>>>>> and many SQL improvements driven by multiple folks. >>>>>>>>>>>>> In addition, this is what we might expect in 1.9:- SQL >>>> execution >>>>>> over >>>>>>>>>>>> specific partitions (https://issues.apache.org/ >>>>>>>>> jira/browse/IGNITE-4523 >>>>>>>>>> ). >>>>>>>>>>>> Alexey Scherbakov.- Spark version upgrade ( >>>>>> https://issues.apache.org/ >>>>>>>>>>>> jira/browse/IGNITE-3710). Anton V.- Spark RDD Examples ( >>>>>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4526). Manish >>>>> Mishra.- >>>>>>>>>>>> Rocket MQ data streamer (https://issues.apache.org/ >>>>>>>>>> jira/browse/IGNITE-4539). >>>>>>>>>>>> Roman Shtykh.- Hibernate 5 support ( >>> https://issues.apache.org/ >>>>>>>>>>>> jira/browse/IGNITE-1794). Mykola Pereyma.- .NET DML ( >>>>>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4045). Pavel >>>>>> Tupitsyn.- >>>>>>>>>> .NET >>>>>>>>>>>> Transaction Scope API (https://issues.apache.org/ >>>>>>>>>> jira/browse/IGNITE-3430). >>>>>>>>>>>> Pavel Tupitsyn.- C++ Continuous queries ( >>>>> https://issues.apache.org/ >>>>>>>>>>>> jira/browse/IGNITE-1443). Igor Sapego.- Kubernetes Support ( >>>>>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4159). Denis >>>> Magda.- >>>>>>>>> JDBC >>>>>>>>>>>> batch mode for DML (https://issues.apache.org/ >>>>>> jira/browse/IGNITE-4269 >>>>>>>>> ). >>>>>>>>>>>> Alexander Paschenko.- Benchmarks automation ( >>>>>>>>> https://issues.apache.org/ >>>>>>>>>>>> jira/browse/IGNITE-4212). Oleg Ostanin. >>>>>>>>>>>>> Guys, please confirm that you will be able to complete listed >>>>> tasks >>>>>>>>> by >>>>>>>>>>>> the middle or by 20th of February. Anything else that is not >>> in >>>>> the >>>>>>>>>> list? >>>>>>>>>>>>> BTW, is there anyone who can take a role of the release >>> manager >>>>> for >>>>>>>>>> 1.9? >>>>>>>>>>>>> —Denis >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>> >>>>>> >>>>>> >>>>> >>>> >>> >
