Re: Ignite 2.8 documentation

2020-03-05 Thread Artem Budnikov
Anton, Could you please review the page about Read Rapair? https://apacheignite.readme.io/docs/read-repair -Artem On 05.03.2020 12:20, Artem Budnikov wrote: OK, I'll recreate it. Nikolay, please let me know when you are finished with the Metrics and system views documentation. I'm done

Re: Adding experimental support for Intel Optane DC Persistent Memory

2020-03-05 Thread steve.hostett...@gmail.com
Dear all, while I probably cannot help a lot with the implementation, I have access to a machine with Optane memory. So if I can help in running benchmarks, let me know. Steve -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: Apache Ignite ML & Python

2020-03-05 Thread AG
Thanks, for the reply! It looks like a high-level API similar to Sklearn pipelines. In my opinion, for the first steps easier to add simple assess to gain the ability to run a simple model or simple preprocessor from python. According to your example: Here is raw dataset, already inside this

[jira] [Created] (IGNITE-12753) Cache SSL contexts in SslContextFactory

2020-03-05 Thread Denis Mekhanikov (Jira)
Denis Mekhanikov created IGNITE-12753: - Summary: Cache SSL contexts in SslContextFactory Key: IGNITE-12753 URL: https://issues.apache.org/jira/browse/IGNITE-12753 Project: Ignite Issue

Re: Ignite 2.8 documentation

2020-03-05 Thread Artem Budnikov
I'm confused. Igor, could you please double check? -Artem On 05.03.2020 04:15, Ivan Pavlukhin wrote: That's right, only C++ and .NET clients have partition awareness Are your sure? Was not the feature implemented for java thin client in [1]? [1]

[jira] [Created] (IGNITE-12750) Correct the setting of the pool to build the index

2020-03-05 Thread Kirill Tkalenko (Jira)
Kirill Tkalenko created IGNITE-12750: Summary: Correct the setting of the pool to build the index Key: IGNITE-12750 URL: https://issues.apache.org/jira/browse/IGNITE-12750 Project: Ignite

Re: Distributed DMX Lighting Control With Apache Ignite.NET

2020-03-05 Thread Pavel Tupitsyn
Hi Mike, Denis, The post series is great, so exciting to know that Ignite.NET is used in such a cool way, and across multiple APIs (Cache, Compute, Services, Messaging). Any feedback will be greatly appreciated, please feel free to reach me over this email address or through the user list.

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Maxim Muzafarov
Ivan, I think `final steps` is mostly related not to binary\sources itself but for the announce message. All documentation must be up-to-date when it occurs. But I think you're right that users already using a new version of Apache Ignite without announcing. We've got some questions\bugs on

Re: Ignite 2.8 documentation

2020-03-05 Thread Artem Budnikov
Guys, I see that there is already version 2.8 for Ignite docs on readme.io. Who created it and when? I've changed some pages under 2.7.6 version without knowing that there is a newer version. -Artem On 05.03.2020 11:45, Artem Budnikov wrote: I'm confused. Igor, could you please double

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Ivan Pavlukhin
Maxim, You did the great job! Many thanks for that! I suppose there is some confusion with terminology. I understand that Ignite release process has several final steps. And for example binaries can be published before documentation is ready and it is ok (I suppose opposite will make no harm as

Re: Ignite 2.8 documentation

2020-03-05 Thread Maxim Muzafarov
Artem, I've created that. It is not public and can be safely removed since it's a full copy of 2.7.6 (at that moment) On Thu, 5 Mar 2020 at 11:53, Artem Budnikov wrote: > > Guys, > > I see that there is already version 2.8 for Ignite docs on readme.io. > Who created it and when? I've changed

Re: Security Subject of thin client on remote nodes

2020-03-05 Thread Denis Garus
Hi, guys! I've prepared the IEP-41: Security Context of a thin client on remote nodes [1]; take a look, please. If there aren't any questions, I could create an issue and start work. Ivan, could you be an IEP sponsor? Thx! 1.

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Ivan Pavlukhin
Wow. I impressed that users try out even RC. Best regards, Ivan Pavlukhin чт, 5 мар. 2020 г. в 12:01, Maxim Muzafarov : > > Ivan, > > I think `final steps` is mostly related not to binary\sources itself > but for the announce message. All documentation must be up-to-date > when it occurs. > >

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Nikolay Izhikov
It shows huge interest in the Ignite from users. So I think we should significantly shorten release cycle in the first place. > 5 марта 2020 г., в 13:08, Alexey Goncharuk > написал(а): > > Hm, actually this is something we've never seen before. I thing we should > definitely reconsider release

Re: Ignite 2.8 documentation

2020-03-05 Thread Artem Budnikov
OK, I'll recreate it. Nikolay, please let me know when you are finished with the Metrics and system views documentation. I'm done with the list of docs we identified in this thread and want to publish v. 2.8. -Artem On 05.03.2020 11:55, Maxim Muzafarov wrote: Artem, I've created that. It

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Alexey Goncharuk
Hm, actually this is something we've never seen before. I thing we should definitely reconsider release vote timings as Ilya suggested to collect users feedback for a longer period of time. чт, 5 мар. 2020 г. в 12:49, Ivan Pavlukhin : > Wow. I impressed that users try out even RC. > > Best

RE: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Sergey-A Kosarev
Classification: Public There are no RC anymore, I believe. It's now just 2.8.0 (as in Maven Central) Thank you to all involved in the release guys, especially Maxim! Kind regards, Sergey Kosarev -Original Message- From: Ivan Pavlukhin [mailto:vololo...@gmail.com] Sent: 05 March 2020

Re: Node.JS, PHP, Python API references for Ignite 2.8 release

2020-03-05 Thread Igor Sapego
Guys, I'm going to take this task and try to fix mentioned issues by the next release. Best Regards, Igor On Thu, Feb 27, 2020 at 9:40 PM Maxim Muzafarov wrote: > Folks, > > It seems that we have a lack of knowledge at the platforms README file [1]. > Should we also update it? > > [1] >

Read load balancing, read-though, ttl and optimistic serializable transactions

2020-03-05 Thread Alexey Goncharuk
Igniters, I have recently discovered [1] that Ignite can arrive in a state when an optimistic serializable transaction can never be successfully committed from a backup node [2]. In short, the root cause of this issue is that there are configurations that allow a key to be stored on primary and

[jira] [Created] (IGNITE-12751) callAsync(jobs, rdc) performance degrades quadratically as jobs.size() grows

2020-03-05 Thread Ilya Kasnacheev (Jira)
Ilya Kasnacheev created IGNITE-12751: Summary: callAsync(jobs, rdc) performance degrades quadratically as jobs.size() grows Key: IGNITE-12751 URL: https://issues.apache.org/jira/browse/IGNITE-12751

Re: Reference of local service.

2020-03-05 Thread Andrey Gura
Hi there, what if we will generate proxy that collects service's metrics only if service will implement some special interface? In such case: - we won't affect existing services at all. - we can impose additional requirement for services that want use metrics out of box (i.e. service that

[jira] [Created] (IGNITE-12752) Pass thin clients SSL certificates to security

2020-03-05 Thread Ilya Kasnacheev (Jira)
Ilya Kasnacheev created IGNITE-12752: Summary: Pass thin clients SSL certificates to security Key: IGNITE-12752 URL: https://issues.apache.org/jira/browse/IGNITE-12752 Project: Ignite

Re: Ignite 2.8 documentation

2020-03-05 Thread Anton Vinogradov
Artem, great! Some minors: >> read operations become more costly for caches with backup copies. Since it makes sense only for cache with backups, can we say something like "read operations become at least 2 times costly since backups checked as well" >> for atomic caches, a consistency

Re: Ignite 2.8 announcement plan

2020-03-05 Thread Pavel Tupitsyn
Denis, The first post is going to be ready soon, probably by tomorrow. Here is a draft, feedback welcome: https://github.com/ptupitsyn/ptupitsyn.github.io/blob/ignite-2.8/_posts/2020-03-05-Whats-New-In-Ignite-Net-2.8.md On Wed, Mar 4, 2020 at 5:15 PM Denis Magda wrote: > Hi Pavel, > >

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Denis Magda
Actually, we already have a related discussion: http://apache-ignite-developers.2346864.n4.nabble.com/Slim-binary-release-and-docker-image-for-Apache-Ignite-td45110.html Ilya, would you mind restarting it highlighting that it's suggested to release a slim package for Ignite 2.8. - Denis On

[jira] [Created] (IGNITE-12754) .NET: Thin Client: Service invocation

2020-03-05 Thread Pavel Tupitsyn (Jira)
Pavel Tupitsyn created IGNITE-12754: --- Summary: .NET: Thin Client: Service invocation Key: IGNITE-12754 URL: https://issues.apache.org/jira/browse/IGNITE-12754 Project: Ignite Issue Type:

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Denis Magda
Ilya, Thanks for driving this activity. It would be nice to shift this conversation to another thread, agree on the slim package structure and release it for 2.8. This discussion is not the most visible one for the topic you're raising. - Denis On Thu, Mar 5, 2020 at 10:49 AM Ilya Kasnacheev

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Ilya Kasnacheev
Hello! libs: core/shmem/jcache ignite-indexing ignite-spring libs/optional: ignite-compress ignite-kubernetes ignite-log4j2 ignite-rest-http ignite-spring-data_2.2 ignite-jta ignite-log4j ignite-opencensus ignite-slf4j ignite-urideploy I have kept examples, but removed

Re: Apache Ignite ML & Python

2020-03-05 Thread Alexey Zinoviev
Ken, thanks for the feedback, part of the ideas looks like the good candidates for the next release for the Java API. We should understand, that Python API could only wrap Java API. We approach with wrapping via P4j library as in mentioned repository could be used, it is a common approach, it is

Ignite Website: New Look

2020-03-05 Thread Denis Magda
Folks, As many of you know, these days I mostly contribute by optimizing our website, preparing different content including documentation/articles, and presenting the project at various events. One of the continuous website activities we undertake together with Mauricio and Ignacio is search

Re: Ignite Website: New Look

2020-03-05 Thread Nikita Ivanov
Denis - looks very nice! I do indeed think we need to work on better content (home page specifically). Thanks! -- Nikita Ivanov On Thu, Mar 5, 2020 at 3:18 PM Denis Magda wrote: > Folks, > > As many of you know, these days I mostly contribute by optimizing our > website, preparing different

Re: Apache Ignite ML & Python

2020-03-05 Thread Ken Cottrell
Alexey, Andrei, Here are some thoughts on what would be good to have in Python-Ignite ML notebook: - some way to pick an optional sample size (out of a very big cache size) that gets communicated and set aside to all partitions - some way to count number of unique values for a category

Re: Ignite 2.8 announcement plan

2020-03-05 Thread Denis Magda
Pavel, thanks, I enjoyed reading the blog, crystal clear and straight to the point! Please consider these several items that might strengthen the article a bit: - I would use "thick client" as a term instead of the "classic client" (and mention that Ignite.NET client is a thick one). The

Re: Apache Ignite ML & Python

2020-03-05 Thread Denis Magda
Folks, Does it make sense to take an approach of Python ML implementation available for GridGain in a beta mode? (where Python APIs wrap around Java ML library) https://www.gridgain.com/docs/latest/developers-guide/python-ml/using-python-ml - Denis On Thu, Mar 5, 2020 at 6:50 AM Alexey

Re: Out of memory with eviction failure on persisted cache

2020-03-05 Thread Evgenii Zhuravlev
Hi Raymond, I tried to reproduce it, but without success. Can you share the reproducer? Also, have you tried to load much more data with 256mb data region? I think it should work without issues. Thanks, Evgenii ср, 4 мар. 2020 г. в 16:14, Raymond Wilson : > Hi Evgenii, > > I am individually

Re: Out of memory with eviction failure on persisted cache

2020-03-05 Thread Raymond Wilson
The reproducer is my development system, which is hard to share. I have increased the size of the buffer to 256Mb, and it copes with the example data load, though I have not tried larger data sets. >From an analytical perspective, is this an error that is possible or expected to occur when using

[jira] [Created] (IGNITE-12755) Not enough information about error

2020-03-05 Thread Surkov Aleksandr (Jira)
Surkov Aleksandr created IGNITE-12755: - Summary: Not enough information about error Key: IGNITE-12755 URL: https://issues.apache.org/jira/browse/IGNITE-12755 Project: Ignite Issue Type:

Re: Apache Ignite ML & Python

2020-03-05 Thread Alexey Zinoviev
Agree with simple case, I think we could start from the simple poc for the Python for ML in the next release чт, 5 мар. 2020 г., 17:05 AG : > > Thanks, for the reply! > > It looks like a high-level API similar to Sklearn pipelines. > In my opinion, for the first steps easier to add simple assess

Re: Apache Ignite ML & Python

2020-03-05 Thread Alexey Zinoviev
Agree with simple case, I think we could start from the simple poc for the Python for ML in the next release чт, 5 мар. 2020 г., 17:05 AG : > > Thanks, for the reply! > > It looks like a high-level API similar to Sklearn pipelines. > In my opinion, for the first steps easier to add simple assess

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Ilya Kasnacheev
Hello! Unfortunately, ignite-zookeeper has a lot of dependencies (8M) which we do not update often enough (such as guava, curator, jackson), and which may form an attack surface. Not a pressing problem for 'integrated' ignite-zookeeper users, since they can re-import these dependencies with more

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Maxim Muzafarov
Ilya, Thank you for preparing the slim package. Can we discuss and fix the list of modules which will be included to "slim" package in the appropriate thread [1]? From my understanding, we should include `ignite-zookeeper` to the package and update the TeamCity release suite also. I see no

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Ilya Kasnacheev
Hello! I have prepared assemblies for Apache Ignite slim packaging: https://github.com/apache/ignite/tree/ignite-slim It is based on ignite-2.8 You can build it with mvn initialize -Prelease,lgpl -Dignite.edition=apache-ignite-slim after a normal release build. Please consider the contents of

Re: [DISCUSSION] Release Apache Ignite 2.8.0 RC1

2020-03-05 Thread Nikolay Izhikov
Hello, Ilya! Thanks for putting your effort into this task. Can you, please, list modules that you include in the slim package? > 5 марта 2020 г., в 20:17, Ilya Kasnacheev > написал(а): > > Hello! > > I have prepared assemblies for Apache Ignite slim packaging: >