Re: Time and scope for Apache Ignite 2.4

[Yury Babak]

Denis,

Yes, we have the main  issue
   for 
NN introduction. The first implementation of NN for 2.4 release will be a
MLP( multilayer perceptron
  ), with sub task - 
local implemeatation of MLP
  . And this task already
done.

Artem and I - we both sure that tasks 7129 and 6386 will be done before 5th
Jan(expected code freze).

Regards,
Yury.



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Time and scope for Apache Ignite 2.4

[Denis Magda]

Yuri,

Do you aggregate NN tasks somehow in JIRA? Want to learn more on what’s going 
there.

—
Denis

> On Dec 21, 2017, at 1:39 AM, Yury Babak  wrote:
> 
> Hi Denis,
> 
> as for ML - we on track. For this release we have FCM, Decision tree, KNN,
> Model/Trainer API, Neural Network introduction and bunch of improvements and
> bugfixes.
> 
> Also we slightly change our plan for NN. In this release we will add
> distributed(and local) MLP(multilayer perceptron) instead of
> CNN(Convolutional neural network).
> 
> Regards,
> Yury
> 
> 
> 
> --
> Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Time and scope for Apache Ignite 2.4

[Yury Babak]

Hi Denis,

as for ML - we on track. For this release we have FCM, Decision tree, KNN,
Model/Trainer API, Neural Network introduction and bunch of improvements and
bugfixes.

Also we slightly change our plan for NN. In this release we will add
distributed(and local) MLP(multilayer perceptron) instead of
CNN(Convolutional neural network).

Regards,
Yury



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Time and scope for Apache Ignite 2.4

[Petr Ivanov]

Hi, Denis.


Yes, we collaborated with Yuri and are currently waiting for Ignite Tests run 
results (though I’ll be able to start full comparison run only on weekend 
because of extremely high TC load) to be sure that 1) I did not break overall 
build and 2) building and testing on Java 8 produces similar (more or less, 
considering fact that some tests are flaky) result so we can switch to new TC 
test project "Ignite Tests 2.0 (java-8)”.

Hope the changes will see themselves in master on the beginning of the 
following week.



> On 20 Dec 2017, at 23:22, Denis Magda  wrote:
> 
> Hi Peter, 
> 
> Sorry for confusion, yes, I meant using Java 8 by default in Ignite. Labeled 
> the Java 8 ticket with “important” and now it appears in the required tickets 
> list:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets
> 
> As I see Yuri reviewed the ticket from ML perspective:
> https://github.com/apache/ignite/pull/3240 
> 
> 
> Do you guys collaborate together making sure the ML build process simplified? 
> Do we need to create a sub-task of [1] to make sure it’s not missed?
> 
> [1] https://issues.apache.org/jira/browse/IGNITE-7203 
> 
> 
> —
> Denis
> 
>> On Dec 20, 2017, at 12:29 AM, Petr Ivanov  wrote:
>> 
>> Hi, Denis!
>> 
>> 
>> What about switching to Java 8 by default? [1]
>> I guess this task is inseparably connected to Java 7 support drop and Java 9 
>> support introducing.
>> 
>> 
>> [1] https://issues.apache.org/jira/browse/IGNITE-7203
>> 
>> 
>> 
>>> On 19 Dec 2017, at 23:07, Denis Magda  wrote:
>>> 
>>> Igniters,
>>> 
>>> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
>>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets
>>>  
>>> 
>>> 
>>> How good are we if to assume 5th of Jan as a code freeze date? Please 
>>> comment:
>>> - Nikolay Izhikov: Data Frames.
>>> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
>>> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
>>> - Yuri: Machine Learning + neural networks
>>> - Vladimir Ozerov: Java 9 and Java 7
>>> - Sergey Kozlov: SQL scope testing
>>> - etc.: please check the link with the features.
>>> 
>>> —
>>> Denis
 On Dec 4, 2017, at 1:11 PM, Denis Magda  wrote:
 
 Igniters,
 
 Basing on the amount of improvements, fixes and features stacked in the 
 master branch I think it’s a right time to negotiate the scope and time of 
 the next Apache Ignite 2.4 release. I’m ready to step in as a release 
 manager if none of the committers wants to try on this role.
 
 Here is a release page:
 https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 
 
 
 Proposed time date: Jan 5 - code freeze -> stabilization and testing -> 
 Jan 24 - voting -> Jan 31 release.
 
 In my view improvements such Java 9 support and Java 7 discontinuation, 
 memory metrics in bytes [1], binary client protocol, etc. needs to get 
 into the release. All the features like that are labeled “important” in 
 JIRA. Use this label if you are convinced a task has to be release in 2.4.
 
 What’s about machine learning, bulk loading [2], internals problems 
 resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s 
 shifted?
 
 [1] https://issues.apache.org/jira/browse/IGNITE-6902 
 
 [2] 
 https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements
  
 
 [3] 
 https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection
  
 
 [4] 
 https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements
  
 
 
 —
 Denis
>>> 
>> 
> 

Re: Time and scope for Apache Ignite 2.4

[Denis Magda]

Please ping me or file a ticket following these rules [1] when this happens so 
that I could update this documentation page:
https://apacheignite.readme.io/docs/memory-metrics

[1] https://cwiki.apache.org/confluence/display/IGNITE/How+to+Document

—
Denis

> On Dec 20, 2017, at 12:56 PM, Andrey Kuznetsov  wrote:
> 
> Thanks, Denis!
> 
> I hope I'll finish the task on memory metrics in a couple of days.
> 
> 2017-12-20 23:28 GMT+03:00 Denis Magda :
> 
>> Andrey K., excellent progress! Do you think you will finish the task by
>> the end of the year?
>> 
>> Furthermore, I see you are working on Java 9 specific tasks:
>> https://issues.apache.org/jira/browse/IGNITE-6728 <
>> https://issues.apache.org/jira/browse/IGNITE-6728>
>> 
>> Is everything alright there? If you need a review try to ping a reviewer
>> directly.
>> 
>> —
>> Denis
>> 
>>> On Dec 20, 2017, at 3:29 AM, Andrey Kuznetsov  wrote:
>>> 
>>> Hi Denis,
>>> 
>>> As for memory metrics, I'm fixing minor bugs now, and then we'll need
>> some
>>> time for review.
>>> 
>>> 2017-12-19 23:07 GMT+03:00 Denis Magda :
>>> 
 Igniters,
 
 It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
 https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
 ApacheIgnite2.4-RequiredTickets 
 
 How good are we if to assume 5th of Jan as a code freeze date? Please
 comment:
 - Nikolay Izhikov: Data Frames.
 - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the
>> list.
 - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
 - Yuri: Machine Learning + neural networks
 - Vladimir Ozerov: Java 9 and Java 7
 - Sergey Kozlov: SQL scope testing
 - etc.: please check the link with the features.
 
 —
 Denis
 
 --
>>> Best regards,
>>> Andrey Kuznetsov.
>> 
>> 
> 
> 
> -- 
> Best regards,
>  Andrey Kuznetsov.

Re: Time and scope for Apache Ignite 2.4

[Andrey Kuznetsov]

Thanks, Denis!

I hope I'll finish the task on memory metrics in a couple of days.

2017-12-20 23:28 GMT+03:00 Denis Magda :

> Andrey K., excellent progress! Do you think you will finish the task by
> the end of the year?
>
> Furthermore, I see you are working on Java 9 specific tasks:
> https://issues.apache.org/jira/browse/IGNITE-6728 <
> https://issues.apache.org/jira/browse/IGNITE-6728>
>
> Is everything alright there? If you need a review try to ping a reviewer
> directly.
>
> —
> Denis
>
> > On Dec 20, 2017, at 3:29 AM, Andrey Kuznetsov  wrote:
> >
> > Hi Denis,
> >
> > As for memory metrics, I'm fixing minor bugs now, and then we'll need
> some
> > time for review.
> >
> > 2017-12-19 23:07 GMT+03:00 Denis Magda :
> >
> >> Igniters,
> >>
> >> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
> >> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
> >> ApacheIgnite2.4-RequiredTickets  >> confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-
> >> RequiredTickets>
> >>
> >> How good are we if to assume 5th of Jan as a code freeze date? Please
> >> comment:
> >> - Nikolay Izhikov: Data Frames.
> >> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the
> list.
> >> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
> >> - Yuri: Machine Learning + neural networks
> >> - Vladimir Ozerov: Java 9 and Java 7
> >> - Sergey Kozlov: SQL scope testing
> >> - etc.: please check the link with the features.
> >>
> >> —
> >> Denis
> >>
> >> --
> > Best regards,
> >  Andrey Kuznetsov.
>
>


-- 
Best regards,
  Andrey Kuznetsov.

Re: Time and scope for Apache Ignite 2.4

[Denis Magda]

Andrey K., excellent progress! Do you think you will finish the task by the end 
of the year?

Furthermore, I see you are working on Java 9 specific tasks:
https://issues.apache.org/jira/browse/IGNITE-6728 


Is everything alright there? If you need a review try to ping a reviewer 
directly.

—
Denis

> On Dec 20, 2017, at 3:29 AM, Andrey Kuznetsov  wrote:
> 
> Hi Denis,
> 
> As for memory metrics, I'm fixing minor bugs now, and then we'll need some
> time for review.
> 
> 2017-12-19 23:07 GMT+03:00 Denis Magda :
> 
>> Igniters,
>> 
>> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
>> ApacheIgnite2.4-RequiredTickets > confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-
>> RequiredTickets>
>> 
>> How good are we if to assume 5th of Jan as a code freeze date? Please
>> comment:
>> - Nikolay Izhikov: Data Frames.
>> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
>> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
>> - Yuri: Machine Learning + neural networks
>> - Vladimir Ozerov: Java 9 and Java 7
>> - Sergey Kozlov: SQL scope testing
>> - etc.: please check the link with the features.
>> 
>> —
>> Denis
>> 
>> --
> Best regards,
>  Andrey Kuznetsov.

Re: Time and scope for Apache Ignite 2.4

[Denis Magda]

Hi Peter, 

Sorry for confusion, yes, I meant using Java 8 by default in Ignite. Labeled 
the Java 8 ticket with “important” and now it appears in the required tickets 
list:
https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets

As I see Yuri reviewed the ticket from ML perspective:
https://github.com/apache/ignite/pull/3240 


Do you guys collaborate together making sure the ML build process simplified? 
Do we need to create a sub-task of [1] to make sure it’s not missed?

[1] https://issues.apache.org/jira/browse/IGNITE-7203 


—
Denis

> On Dec 20, 2017, at 12:29 AM, Petr Ivanov  wrote:
> 
> Hi, Denis!
> 
> 
> What about switching to Java 8 by default? [1]
> I guess this task is inseparably connected to Java 7 support drop and Java 9 
> support introducing.
> 
> 
> [1] https://issues.apache.org/jira/browse/IGNITE-7203
> 
> 
> 
>> On 19 Dec 2017, at 23:07, Denis Magda  wrote:
>> 
>> Igniters,
>> 
>> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets
>>  
>> 
>> 
>> How good are we if to assume 5th of Jan as a code freeze date? Please 
>> comment:
>> - Nikolay Izhikov: Data Frames.
>> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
>> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
>> - Yuri: Machine Learning + neural networks
>> - Vladimir Ozerov: Java 9 and Java 7
>> - Sergey Kozlov: SQL scope testing
>> - etc.: please check the link with the features.
>> 
>> —
>> Denis
>>> On Dec 4, 2017, at 1:11 PM, Denis Magda  wrote:
>>> 
>>> Igniters,
>>> 
>>> Basing on the amount of improvements, fixes and features stacked in the 
>>> master branch I think it’s a right time to negotiate the scope and time of 
>>> the next Apache Ignite 2.4 release. I’m ready to step in as a release 
>>> manager if none of the committers wants to try on this role.
>>> 
>>> Here is a release page:
>>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 
>>> 
>>> 
>>> Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 
>>> 24 - voting -> Jan 31 release.
>>> 
>>> In my view improvements such Java 9 support and Java 7 discontinuation, 
>>> memory metrics in bytes [1], binary client protocol, etc. needs to get into 
>>> the release. All the features like that are labeled “important” in JIRA. 
>>> Use this label if you are convinced a task has to be release in 2.4.
>>> 
>>> What’s about machine learning, bulk loading [2], internals problems 
>>> resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s 
>>> shifted?
>>> 
>>> [1] https://issues.apache.org/jira/browse/IGNITE-6902 
>>> 
>>> [2] 
>>> https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements
>>>  
>>> 
>>> [3] 
>>> https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection
>>>  
>>> 
>>> [4] 
>>> https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements
>>>  
>>> 
>>> 
>>> —
>>> Denis
>> 
> 

Re: Time and scope for Apache Ignite 2.4

[Andrey Kuznetsov]

Hi Denis,

As for memory metrics, I'm fixing minor bugs now, and then we'll need some
time for review.

2017-12-19 23:07 GMT+03:00 Denis Magda :

> Igniters,
>
> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
> ApacheIgnite2.4-RequiredTickets  confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-
> RequiredTickets>
>
> How good are we if to assume 5th of Jan as a code freeze date? Please
> comment:
> - Nikolay Izhikov: Data Frames.
> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
> - Yuri: Machine Learning + neural networks
> - Vladimir Ozerov: Java 9 and Java 7
> - Sergey Kozlov: SQL scope testing
> - etc.: please check the link with the features.
>
> —
> Denis
>
> --
Best regards,
  Andrey Kuznetsov.

Re: Time and scope for Apache Ignite 2.4

[Petr Ivanov]

Hi, Denis!


What about switching to Java 8 by default? [1]
I guess this task is inseparably connected to Java 7 support drop and Java 9 
support introducing.


[1] https://issues.apache.org/jira/browse/IGNITE-7203



> On 19 Dec 2017, at 23:07, Denis Magda  wrote:
> 
> Igniters,
> 
> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets
>  
> 
> 
> How good are we if to assume 5th of Jan as a code freeze date? Please comment:
> - Nikolay Izhikov: Data Frames.
> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
> - Yuri: Machine Learning + neural networks
> - Vladimir Ozerov: Java 9 and Java 7
> - Sergey Kozlov: SQL scope testing
> - etc.: please check the link with the features.
> 
> —
> Denis
>> On Dec 4, 2017, at 1:11 PM, Denis Magda  wrote:
>> 
>> Igniters,
>> 
>> Basing on the amount of improvements, fixes and features stacked in the 
>> master branch I think it’s a right time to negotiate the scope and time of 
>> the next Apache Ignite 2.4 release. I’m ready to step in as a release 
>> manager if none of the committers wants to try on this role.
>> 
>> Here is a release page:
>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 
>> 
>> 
>> Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 
>> 24 - voting -> Jan 31 release.
>> 
>> In my view improvements such Java 9 support and Java 7 discontinuation, 
>> memory metrics in bytes [1], binary client protocol, etc. needs to get into 
>> the release. All the features like that are labeled “important” in JIRA. Use 
>> this label if you are convinced a task has to be release in 2.4.
>> 
>> What’s about machine learning, bulk loading [2], internals problems 
>> resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s 
>> shifted?
>> 
>> [1] https://issues.apache.org/jira/browse/IGNITE-6902 
>> 
>> [2] 
>> https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements
>>  
>> 
>> [3] 
>> https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection
>>  
>> 
>> [4] 
>> https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements
>>  
>> 
>> 
>> —
>> Denis
> 

Re: Time and scope for Apache Ignite 2.4

[Nikolay Izhikov]

Hello, Denis

> - Nikolay Izhikov: Data Frames.

I'm waiting for Valentin Kulichenko review.
If and when further comments for DataFrame pull request appears I will
fix them immediately.

В Вт, 19/12/2017 в 12:07 -0800, Denis Magda пишет:
> Igniters,
> 
> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
> ApacheIgnite2.4-RequiredTickets  display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets>
> 
> How good are we if to assume 5th of Jan as a code freeze date? Please
> comment:
> - Nikolay Izhikov: Data Frames.
> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the
> list.
> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
> - Yuri: Machine Learning + neural networks
> - Vladimir Ozerov: Java 9 and Java 7
> - Sergey Kozlov: SQL scope testing
> - etc.: please check the link with the features.
> 
> —
> Denis
> > On Dec 4, 2017, at 1:11 PM, Denis Magda  wrote:
> > 
> > Igniters,
> > 
> > Basing on the amount of improvements, fixes and features stacked in
> > the master branch I think it’s a right time to negotiate the scope
> > and time of the next Apache Ignite 2.4 release. I’m ready to step
> > in as a release manager if none of the committers wants to try on
> > this role.
> > 
> > Here is a release page:
> > https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.
> > 4  > +2.4>
> > 
> > Proposed time date: Jan 5 - code freeze -> stabilization and
> > testing -> Jan 24 - voting -> Jan 31 release.
> > 
> > In my view improvements such Java 9 support and Java 7
> > discontinuation, memory metrics in bytes [1], binary client
> > protocol, etc. needs to get into the release. All the features like
> > that are labeled “important” in JIRA. Use this label if you are
> > convinced a task has to be release in 2.4.
> > 
> > What’s about machine learning, bulk loading [2], internals problems
> > resolution [3], metrics [4] related tasks? What goes in 2.4 and
> > what’s shifted?
> > 
> > [1] https://issues.apache.org/jira/browse/IGNITE-6902  > es.apache.org/jira/browse/IGNITE-6902>
> > [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bul
> > k+data+loading+performance+improvements  > onfluence/display/IGNITE/IEP-
> > 1:+Bulk+data+loading+performance+improvements>
> > [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ign
> > ite+internal+problems+detection  > e/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
> > [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Met
> > rics+improvements  > TE/IEP-6:+Metrics+improvements>
> > 
> > —
> > Denis
> 
> 

Re: Time and scope for Apache Ignite 2.4

[Denis Magda]

Igniters,

It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets
 


How good are we if to assume 5th of Jan as a code freeze date? Please comment:
- Nikolay Izhikov: Data Frames.
- Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
- Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
- Yuri: Machine Learning + neural networks
- Vladimir Ozerov: Java 9 and Java 7
- Sergey Kozlov: SQL scope testing
- etc.: please check the link with the features.

—
Denis
> On Dec 4, 2017, at 1:11 PM, Denis Magda  wrote:
> 
> Igniters,
> 
> Basing on the amount of improvements, fixes and features stacked in the 
> master branch I think it’s a right time to negotiate the scope and time of 
> the next Apache Ignite 2.4 release. I’m ready to step in as a release manager 
> if none of the committers wants to try on this role.
> 
> Here is a release page:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 
> 
> 
> Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 
> 24 - voting -> Jan 31 release.
> 
> In my view improvements such Java 9 support and Java 7 discontinuation, 
> memory metrics in bytes [1], binary client protocol, etc. needs to get into 
> the release. All the features like that are labeled “important” in JIRA. Use 
> this label if you are convinced a task has to be release in 2.4.
> 
> What’s about machine learning, bulk loading [2], internals problems 
> resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s 
> shifted?
> 
> [1] https://issues.apache.org/jira/browse/IGNITE-6902 
> 
> [2] 
> https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements
>  
> 
> [3] 
> https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection
>  
> 
> [4] 
> https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements
>  
> 
> 
> —
> Denis

Re: Time and scope for Apache Ignite 2.4

[Andrey Gura]

Hi,

I've just updated the issue. Please take a look.

On Wed, Dec 6, 2017 at 6:44 AM, Dmitriy Setrakyan  wrote:
> On Tue, Dec 5, 2017 at 7:13 AM, Andrey Gura  wrote:
>
>> Hi,
>>
>> I'm working on WAL optimizations that improve performance
>> significantly [1]. I believe it's important task and should be
>> included in Apache Ignite 2.4 release.
>>
>> [1] https://issues.apache.org/jira/browse/IGNITE-6339
>>
>>
> Andrey, I do not believe that moving WAL processing to a separate thread
> would provide a huge performance boost. Is there anything else you are
> doing? If yes, can you please describe it in the ticket?

Re: Time and scope for Apache Ignite 2.4

[Igor Sapego]

Hi Denis,

I've been working on SSL support for ODBC [1] for a while now, and I hope
to include it in 2.4, as well as some other minor improvements and bug fixes
for ODBC.

[1] - https://issues.apache.org/jira/browse/IGNITE-6810

Best Regards,
Igor

On Thu, Dec 7, 2017 at 11:51 AM, vveider  wrote:

> Hi, Denis.
>
> https://issues.apache.org/jira/browse/IGNITE-7107
> https://issues.apache.org/jira/browse/IGNITE-7108
>
>
>
> --
> Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
>

Re: Time and scope for Apache Ignite 2.4

[vveider]

Hi, Denis.

https://issues.apache.org/jira/browse/IGNITE-7107
https://issues.apache.org/jira/browse/IGNITE-7108



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Time and scope for Apache Ignite 2.4

[Dmitry Pavlov]

Hi,

I suggest to include Andrey's change with WAL standalone thread, this will
speed up Ignite at least because CRC calcs goes to user threads instead of
one writer thread. This brings also resistence to thread interrupt and
other benefits.

Change, which I'm currently working on, is a direct IO
https://issues.apache.org/jira/browse/IGNITE-6341  If benchmarks will show
that memory usage decreased, I suggest to include this change also.

Sincerely,
Dmitry Pavlov

Disclaimer: Opinions expressed in this email are those of the author,
and do not necessarily represent the views of any company the author
might be affiliated with at the moment of writing.


ср, 6 дек. 2017 г. в 11:35, Yury Babak :

> Hi,
>
> As for ML - so far so good and from my point of view all mentioned tasks
> will be completed in this release.
>
> Regards,
> Yury
>
>
>
> --
> Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
>

Re: Time and scope for Apache Ignite 2.4

[Yury Babak]

Hi,

As for ML - so far so good and from my point of view all mentioned tasks
will be completed in this release.

Regards,
Yury



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Time and scope for Apache Ignite 2.4

[Dmitriy Setrakyan]

On Tue, Dec 5, 2017 at 7:13 AM, Andrey Gura  wrote:

> Hi,
>
> I'm working on WAL optimizations that improve performance
> significantly [1]. I believe it's important task and should be
> included in Apache Ignite 2.4 release.
>
> [1] https://issues.apache.org/jira/browse/IGNITE-6339
>
>
Andrey, I do not believe that moving WAL processing to a separate thread
would provide a huge performance boost. Is there anything else you are
doing? If yes, can you please describe it in the ticket?

Re: Time and scope for Apache Ignite 2.4

[Andrey Gura]

Hi,

I'm working on WAL optimizations that improve performance
significantly [1]. I believe it's important task and should be
included in Apache Ignite 2.4 release.

[1] https://issues.apache.org/jira/browse/IGNITE-6339

On Tue, Dec 5, 2017 at 12:11 AM, Denis Magda  wrote:
> Igniters,
>
> Basing on the amount of improvements, fixes and features stacked in the 
> master branch I think it’s a right time to negotiate the scope and time of 
> the next Apache Ignite 2.4 release. I’m ready to step in as a release manager 
> if none of the committers wants to try on this role.
>
> Here is a release page:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 
> 
>
> Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 
> 24 - voting -> Jan 31 release.
>
> In my view improvements such Java 9 support and Java 7 discontinuation, 
> memory metrics in bytes [1], binary client protocol, etc. needs to get into 
> the release. All the features like that are labeled “important” in JIRA. Use 
> this label if you are convinced a task has to be release in 2.4.
>
> What’s about machine learning, bulk loading [2], internals problems 
> resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s 
> shifted?
>
> [1] https://issues.apache.org/jira/browse/IGNITE-6902 
> 
> [2] 
> https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements
>  
> 
> [3] 
> https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection
>  
> 
> [4] 
> https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements
>  
> 
>
> —
> Denis

Re: Time and scope for Apache Ignite 2.4

[Pavel Tupitsyn]

1) Thin Client Connector (server part) and .NET Thin Client are in master
and ready for release. See `thin client` component in JIRA.

2) .NET Core cross-platform support (Ignite.NET on Linux and macOS) also
are in master and ready:
https://issues.apache.org/jira/browse/IGNITE-2662
https://issues.apache.org/jira/browse/IGNITE-7013

Pavel




On Tue, Dec 5, 2017 at 2:05 AM, Valentin Kulichenko <
valentin.kuliche...@gmail.com> wrote:

> First part of Spark dataframe integration is likely to get into 2.4:
> https://issues.apache.org/jira/browse/IGNITE-3084
>
> -Val
>
> On Mon, Dec 4, 2017 at 1:11 PM, Denis Magda  wrote:
>
> > Igniters,
> >
> > Basing on the amount of improvements, fixes and features stacked in the
> > master branch I think it’s a right time to negotiate the scope and time
> of
> > the next Apache Ignite 2.4 release. I’m ready to step in as a release
> > manager if none of the committers wants to try on this role.
> >
> > Here is a release page:
> > https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <
> > https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>
> >
> > Proposed time date: Jan 5 - code freeze -> stabilization and testing ->
> > Jan 24 - voting -> Jan 31 release.
> >
> > In my view improvements such Java 9 support and Java 7 discontinuation,
> > memory metrics in bytes [1], binary client protocol, etc. needs to get
> into
> > the release. All the features like that are labeled “important” in JIRA.
> > Use this label if you are convinced a task has to be release in 2.4.
> >
> > What’s about machine learning, bulk loading [2], internals problems
> > resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s
> > shifted?
> >
> > [1] https://issues.apache.org/jira/browse/IGNITE-6902 <
> > https://issues.apache.org/jira/browse/IGNITE-6902>
> > [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> > 1%3A+Bulk+data+loading+performance+improvements <
> https://cwiki.apache.org/
> > confluence/display/IGNITE/IEP-1:+Bulk+data+loading+
> > performance+improvements>
> > [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> > 7%3A+Ignite+internal+problems+detection  > confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
> > [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> > 6%3A+Metrics+improvements  > confluence/display/IGNITE/IEP-6:+Metrics+improvements>
> >
> > —
> > Denis
>

Re: Time and scope for Apache Ignite 2.4

[Valentin Kulichenko]

First part of Spark dataframe integration is likely to get into 2.4:
https://issues.apache.org/jira/browse/IGNITE-3084

-Val

On Mon, Dec 4, 2017 at 1:11 PM, Denis Magda  wrote:

> Igniters,
>
> Basing on the amount of improvements, fixes and features stacked in the
> master branch I think it’s a right time to negotiate the scope and time of
> the next Apache Ignite 2.4 release. I’m ready to step in as a release
> manager if none of the committers wants to try on this role.
>
> Here is a release page:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>
>
> Proposed time date: Jan 5 - code freeze -> stabilization and testing ->
> Jan 24 - voting -> Jan 31 release.
>
> In my view improvements such Java 9 support and Java 7 discontinuation,
> memory metrics in bytes [1], binary client protocol, etc. needs to get into
> the release. All the features like that are labeled “important” in JIRA.
> Use this label if you are convinced a task has to be release in 2.4.
>
> What’s about machine learning, bulk loading [2], internals problems
> resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s
> shifted?
>
> [1] https://issues.apache.org/jira/browse/IGNITE-6902 <
> https://issues.apache.org/jira/browse/IGNITE-6902>
> [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> 1%3A+Bulk+data+loading+performance+improvements  confluence/display/IGNITE/IEP-1:+Bulk+data+loading+
> performance+improvements>
> [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> 7%3A+Ignite+internal+problems+detection  confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
> [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> 6%3A+Metrics+improvements  confluence/display/IGNITE/IEP-6:+Metrics+improvements>
>
> —
> Denis

Time and scope for Apache Ignite 2.4

[Denis Magda]

Igniters,

Basing on the amount of improvements, fixes and features stacked in the master 
branch I think it’s a right time to negotiate the scope and time of the next 
Apache Ignite 2.4 release. I’m ready to step in as a release manager if none of 
the committers wants to try on this role.

Here is a release page:
https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 


Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 24 
- voting -> Jan 31 release.

In my view improvements such Java 9 support and Java 7 discontinuation, memory 
metrics in bytes [1], binary client protocol, etc. needs to get into the 
release. All the features like that are labeled “important” in JIRA. Use this 
label if you are convinced a task has to be release in 2.4.

What’s about machine learning, bulk loading [2], internals problems resolution 
[3], metrics [4] related tasks? What goes in 2.4 and what’s shifted?

[1] https://issues.apache.org/jira/browse/IGNITE-6902 

[2] 
https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements
 

[3] 
https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection
 

[4] 
https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements
 


—
Denis