New blog post on Apache Ignite in AWS

2020-01-22 Thread Sergey Chugunov
Hello community, Recently I published a new blog post on getting started with Apache Ignite in AWS [1]. I tried to make my example as simple as possible while keeping it usable. Let me know if this post is useful for you. I plan to write several follow-up posts about AWS-specific things but

Re: ML Model persist and reuse

2020-01-22 Thread Alexey Zinoviev
I totally agree with you, that model saving is missed element in this framework. In this release I've experimented with binary format and with a commonly used format PMML (in scikit-learn and in Spark 1.0) https://en.wikipedia.org/wiki/Predictive_Model_Markup_Language This is a link to the

Re: Ignite to H20 integration

2020-01-22 Thread Alexey Zinoviev
The current integration could be used for model inference purposes only (on Ignite data) as presented in h20-ml-inference example. This features could be available in 2.8 Please have a look to

Re: Call for presentations for ApacheCon North America 2020 now open

2020-01-22 Thread Saikat Maitra
Hi Denis, Thank you for your email. I have submitted a talk about Data Streaming using Apache Ignite and Apache Flink. I would also like to co-present on Ignite internals and usecases deep dive. Regards, Saikat On Wed, Jan 22, 2020 at 6:22 PM Denis Magda wrote: > Igniters, > > I was

Re: Call for presentations for ApacheCon North America 2020 now open

2020-01-22 Thread Denis Magda
Igniters, I was submitting an Ignite talk to the conference and found out that this time ASF created a separate category for Ignite-specific proposals. You can see an abstract submitted by me: https://drive.google.com/file/d/1woaEOWaIFxN8UIJ7nvFbYoc53mYsUsSN/view?usp=sharing Who else is ready to

Re: Ignite-spring-boot-autoconfigurer

2020-01-22 Thread Николай Ижиков
Hello, Saikat. Thank you so much for the review. I answered your questions and resolve all the comments. Please, take a look, one more time. > 22 янв. 2020 г., в 07:58, Saikat Maitra написал(а): > > Hi Nikolay, > > I have reviewed the PR and shared comments. > > Please let me know if you

Re: Add user attributes to thin clients

2020-01-22 Thread Pavel Tupitsyn
I've looked through the PR more closely, trying to understand the use case, and there are some Java-specific things going on (left a comment). Please keep in mind that we have thin clients in Python, Node.js, C++, C#. The protocol must be language-agnostic. If we add some features there, let's

Re: Add user attributes to thin clients

2020-01-22 Thread Pavel Tupitsyn
The approach with UserAttributes map looks dirty to me and raises questions: - Why is UserAttributes property related to authentication? - UserAttributes name implies that users can put there anything they want, but what for? What are those additional use cases? I think we should focus on a

Re: AWS EBS Discovery: Contributor Wanted

2020-01-22 Thread Denis Magda
Hi Emmanouil, Thanks for preparing a pull-request for Application Load Balancer: https://issues.apache.org/jira/browse/IGNITE-8617 Igniters, who is willing to step in as a primary reviewer? As for automated testing on AWS, are you aware of any sponsorship program of AWS for open source projects

Re: Ignite and Pauseless JVMs for Low-Latency Scenarious: Meetup with Azul

2020-01-22 Thread Denis Magda
Igniters, Just a reminder for those who live in the San Francisco Bay Area. We're meeting tomorrow at Azul HQ. - Denis On Thu, Jan 9, 2020 at 12:01 PM Denis Magda wrote: > Igniters, > > Some of you should have come across an article by Simon Ritter describing > how Ignite and Azul Zing JVM

Re: Add user attributes to thin clients

2020-01-22 Thread Nikita Amelchev
I think we should add this. It will provide an extra level of security. This approach is used in many products, for example in AWS (MFA). [1] [1] https://docs.aws.amazon.com/general/latest/gr/aws-sec-cred-types.html#multi-factor-authentication ср, 22 янв. 2020 г. в 18:13, Andrey Kuznetsov : > >

Re: Add user attributes to thin clients

2020-01-22 Thread Andrey Kuznetsov
Hi, Pavel! Sometimes single authentication factor is not enough. Attributes proposed allow to add extra factors flexibly. ср, 22 янв. 2020 г., 17:39 Pavel Tupitsyn : > Token can be sent instead of a password (like git works with GitHub > tokens). > > For now I don't see a reason to include

[jira] [Created] (IGNITE-12569) Can't set serialized enum to a BinaryObject's field

2020-01-22 Thread Konstantin Orlov (Jira)
Konstantin Orlov created IGNITE-12569: - Summary: Can't set serialized enum to a BinaryObject's field Key: IGNITE-12569 URL: https://issues.apache.org/jira/browse/IGNITE-12569 Project: Ignite

Re: Apache Ignite 2.8 RELEASE [Time, Scope, Manager]

2020-01-22 Thread Pavel Tupitsyn
Good idea about pre-release build of ignite-2.8 branch. However, I would not name it `rc`, since it is not really a release candidate. Make it `pre0` or something like that. For Ignite.NET I've uploaded pre-release NuGet packages built from current ignite-2.8 branch:

Re: Add user attributes to thin clients

2020-01-22 Thread Pavel Tupitsyn
Token can be sent instead of a password (like git works with GitHub tokens). For now I don't see a reason to include attributes into the handshake message. On Wed, Jan 22, 2020 at 5:32 PM Ilya Kasnacheev wrote: > Hello! > > One does not send security certificate as attribute. The only way to

[jira] [Created] (IGNITE-12568) MessageFactory implementations refactoring

2020-01-22 Thread Andrey N. Gura (Jira)
Andrey N. Gura created IGNITE-12568: --- Summary: MessageFactory implementations refactoring Key: IGNITE-12568 URL: https://issues.apache.org/jira/browse/IGNITE-12568 Project: Ignite Issue

Re: Add user attributes to thin clients

2020-01-22 Thread Ilya Kasnacheev
Hello! One does not send security certificate as attribute. The only way to obtain peer security certificate is to ask SSL engine to provide it. Nevertheless, I can see how it can be useful with e.g. Kerberos, which is token-based IIRC. Regards, -- Ilya Kasnacheev ср, 22 янв. 2020 г. в

Re: Add user attributes to thin clients

2020-01-22 Thread Dmitrii Ryabov
This map is something like user object from `SecurityCredentials`. Sometimes login and password are not enough for security checks. For example, we can send security certificate and validate it inside authenticator. ср, 22 янв. 2020 г., 17:16 Igor Sapego : > Hi Dmitrii, > > Can you please

Re: Internal classes are exposed in public API

2020-01-22 Thread Николай Ижиков
Hello, Igniters. * IGNITE-12552: Move ReadOnlyMetricRegistry to public API merged to the master and cherry-picked to the 2.8. So the main issue with the Metric API solved. * I raised the PR [1] to fix second issue with the new Metric API: absence of the public Java API to get metrics. This PR

Re: Add user attributes to thin clients

2020-01-22 Thread Igor Sapego
Hi Dmitrii, Can you please explain your use case? I'm not sure I'm getting what is the motivation of this change. Best Regards, Igor On Wed, Jan 22, 2020 at 5:11 PM Pavel Tupitsyn wrote: > Hi Dmitrii, > > Honestly, I could not grasp the problem, can you explain it in more detail? > What do

Re: Add user attributes to thin clients

2020-01-22 Thread Pavel Tupitsyn
Hi Dmitrii, Honestly, I could not grasp the problem, can you explain it in more detail? What do we solve by adding a map with arbitrary stuff to the client protocol handshake? On Wed, Jan 22, 2020 at 5:02 PM Dmitrii Ryabov wrote: > Hello, Igniters! > > I want to add the possibility of sending

Add user attributes to thin clients

2020-01-22 Thread Dmitrii Ryabov
Hello, Igniters! I want to add the possibility of sending user defined attributes from thin clients. And check them inside custom authenticator during handshake [1]. There is an issue in hardcoded binary writer for JDBC and `IgniteClient`. This writer searches for a classes in the JDK and

[jira] [Created] (IGNITE-12567) H2Tree goes into illegal state when non-indexed columns are dropped

2020-01-22 Thread Konstantin Orlov (Jira)
Konstantin Orlov created IGNITE-12567: - Summary: H2Tree goes into illegal state when non-indexed columns are dropped Key: IGNITE-12567 URL: https://issues.apache.org/jira/browse/IGNITE-12567

Re: Apache Ignite 2.8 RELEASE [Time, Scope, Manager]

2020-01-22 Thread Ilya Kasnacheev
Hello! I have committed the bumping of essential dependencies' versions: https://issues.apache.org/jira/browse/IGNITE-12540 Would you mind including this change into the scope of 2.8? No point of shipping known problematic JARs in our deliverable. Regards, -- Ilya Kasnacheev ср, 22 янв. 2020

[jira] [Created] (IGNITE-12566) Calcite integration. Expressions evaluation.

2020-01-22 Thread Igor Seliverstov (Jira)
Igor Seliverstov created IGNITE-12566: - Summary: Calcite integration. Expressions evaluation. Key: IGNITE-12566 URL: https://issues.apache.org/jira/browse/IGNITE-12566 Project: Ignite

[jira] [Created] (IGNITE-12565) Extend test coverage [IGNITE-9279] Support custom default SQL schema name

2020-01-22 Thread Ivan Pavlukhin (Jira)
Ivan Pavlukhin created IGNITE-12565: --- Summary: Extend test coverage [IGNITE-9279] Support custom default SQL schema name Key: IGNITE-12565 URL: https://issues.apache.org/jira/browse/IGNITE-12565

[jira] [Created] (IGNITE-12564) Calcite integration. Exceptions handling.

2020-01-22 Thread Igor Seliverstov (Jira)
Igor Seliverstov created IGNITE-12564: - Summary: Calcite integration. Exceptions handling. Key: IGNITE-12564 URL: https://issues.apache.org/jira/browse/IGNITE-12564 Project: Ignite Issue

Re: Request for contribution permission.

2020-01-22 Thread Ivan Pavlukhin
Artem, Welcome to Apache Ignite Community! I added a contributor role to your Jira account. Now you can assign tickets to yourself. Please get familiar with the contribution process [1]. [1] https://cwiki.apache.org/confluence/display/IGNITE/How+to+Contribute ср, 22 янв. 2020 г. в 14:20, Artem

[jira] [Created] (IGNITE-12563) Calcite integration. Reset and remap queries on topology change.

2020-01-22 Thread Igor Seliverstov (Jira)
Igor Seliverstov created IGNITE-12563: - Summary: Calcite integration. Reset and remap queries on topology change. Key: IGNITE-12563 URL: https://issues.apache.org/jira/browse/IGNITE-12563

Request for contribution permission.

2020-01-22 Thread Artem Demchenko
Jira: Username: Mincer2412 Full name: Artem D

Re: Apache Ignite 2.8 RELEASE [Time, Scope, Manager]

2020-01-22 Thread Maxim Muzafarov
Alexey, Sure, I've just thought about it too a few days ago. On Wed, 22 Jan 2020 at 12:09, Anton Vinogradov wrote: > > Good Idea, this will also check that the release process is alive. > > On Wed, Jan 22, 2020 at 12:04 PM Alexey Goncharuk < > alexey.goncha...@gmail.com> wrote: > > > Folks,

Re: New SQL engine, review/feedback request

2020-01-22 Thread Alexey Goncharuk
Igor, Thanks for driving this activity! I hope someone more prominent in SQL subsystem will take a look at the execution logic. From my side, I left a comment regarding the code structure in the ticket. ср, 22 янв. 2020 г. в 12:56, Seliverstov Igor : > Hi guys, > > Some of you know, I'm working

New SQL engine, review/feedback request

2020-01-22 Thread Seliverstov Igor
Hi guys, Some of you know, I'm working on a brand new Calcite based SQL engine. So, now I have some intermediate results and need a feedback from community. A feature branch with a concept of a module is ignite-12248 . The module is going to

Re: Apache Ignite 2.8 RELEASE [Time, Scope, Manager]

2020-01-22 Thread Anton Vinogradov
Good Idea, this will also check that the release process is alive. On Wed, Jan 22, 2020 at 12:04 PM Alexey Goncharuk < alexey.goncha...@gmail.com> wrote: > Folks, Maxim, > > Do you mind if I build the current state of ignite-2.8 branch and upload a > maven staging as rc0 (step 4.3.2 of the

Re: Apache Ignite 2.8 RELEASE [Time, Scope, Manager]

2020-01-22 Thread Alexey Goncharuk
Folks, Maxim, Do you mind if I build the current state of ignite-2.8 branch and upload a maven staging as rc0 (step 4.3.2 of the release process)? I want run some tests for the fixes that are already included to the branch. вт, 21 янв. 2020 г. в 14:28, Maxim Muzafarov : > Folks, > > > I think

[jira] [Created] (IGNITE-12562) FreeListCachingTest.testPageListCacheLimit failing in Disk Page Compressions suite

2020-01-22 Thread Aleksey Plekhanov (Jira)
Aleksey Plekhanov created IGNITE-12562: -- Summary: FreeListCachingTest.testPageListCacheLimit failing in Disk Page Compressions suite Key: IGNITE-12562 URL: https://issues.apache.org/jira/browse/IGNITE-12562