[jira] [Created] (IGNITE-7632) NPE in IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.updateIgfsMetrics()

2018-02-05 Thread Alexandr Kuramshin (JIRA)
Alexandr Kuramshin created IGNITE-7632: -- Summary: NPE in IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.updateIgfsMetrics() Key: IGNITE-7632 URL: https://issues.apache.org/jira/browse/IGNITE-7632

[jira] [Created] (IGNITE-7631) Failed to clear page memory with AssertionError: Release pinned page

2018-02-05 Thread Alexandr Kuramshin (JIRA)
Alexandr Kuramshin created IGNITE-7631: -- Summary: Failed to clear page memory with AssertionError: Release pinned page Key: IGNITE-7631 URL: https://issues.apache.org/jira/browse/IGNITE-7631

[jira] [Created] (IGNITE-7630) NPE in SchemaIndexCacheVisitorImpl.processKey()

2018-02-05 Thread Alexandr Kuramshin (JIRA)
Alexandr Kuramshin created IGNITE-7630: -- Summary: NPE in SchemaIndexCacheVisitorImpl.processKey() Key: IGNITE-7630 URL: https://issues.apache.org/jira/browse/IGNITE-7630 Project: Ignite

[jira] [Created] (IGNITE-7629) NPE when Finished indexes rebuilding for cache

2018-02-05 Thread Alexandr Kuramshin (JIRA)
Alexandr Kuramshin created IGNITE-7629: -- Summary: NPE when Finished indexes rebuilding for cache Key: IGNITE-7629 URL: https://issues.apache.org/jira/browse/IGNITE-7629 Project: Ignite

[jira] [Created] (IGNITE-7628) SqlQuery hangs indefinitely with additional not registered in baseline node.

2018-02-05 Thread Stanilovsky Evgeny (JIRA)
Stanilovsky Evgeny created IGNITE-7628: -- Summary: SqlQuery hangs indefinitely with additional not registered in baseline node. Key: IGNITE-7628 URL: https://issues.apache.org/jira/browse/IGNITE-7628

Re: Subject: new committer: Nikolay Izhikov

2018-02-05 Thread Dmitriy Setrakyan
Congrats, Nikolay, great work on Spark data frames! D. On Mon, Feb 5, 2018 at 1:21 AM, Anton Vinogradov wrote: > The Project Management Committee (PMC) for Apache Ignite > has invited Nikolay Izhikov to become a committer and we are pleased > to announce that he has accepted.

What is the purpose of a binary schema and schema registry?

2018-02-05 Thread John Wilson
Hi, When objects are marshaled, Ignites adds a schema (BinarySchema) to the BinarySchemaRegistry. Moreover, the documentation says that an object can have a few different schemas. My question: 1. What does it mean for an object to have multiple schemas? (e.g. for a simple person object

[GitHub] ignite pull request #3477: IGNITE-7626 Unify code in test which clean up per...

2018-02-05 Thread EdShangGG
GitHub user EdShangGG opened a pull request: https://github.com/apache/ignite/pull/3477 IGNITE-7626 Unify code in test which clean up persistence directories You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite

[GitHub] ignite pull request #3476: IGNITE-7626

2018-02-05 Thread EdShangGG
GitHub user EdShangGG opened a pull request: https://github.com/apache/ignite/pull/3476 IGNITE-7626 You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-gg-13414 Alternatively you can review and apply

[GitHub] ignite pull request #3475: IGNITE-6341: PDS Direct IO 2, removing long runni...

2018-02-05 Thread dspavlov
GitHub user dspavlov opened a pull request: https://github.com/apache/ignite/pull/3475 IGNITE-6341: PDS Direct IO 2, removing long running tests from suite You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite

Re: Obsolete build projects on CI server

2018-02-05 Thread Dmitry Pavlov
Ok for me too. I've never heard about usages of these configs. пн, 5 февр. 2018 г. в 20:25, Anton Vinogradov : > No objections. > > 5 февр. 2018 г. 18:43 пользователь "vveider" > написал: > > > Hi, Igniters. > > > > > > Found (and marked obsolete) several

Re: Obsolete build projects on CI server

2018-02-05 Thread Anton Vinogradov
No objections. 5 февр. 2018 г. 18:43 пользователь "vveider" написал: > Hi, Igniters. > > > Found (and marked obsolete) several build project on our CI server: > * [Obsolete] Assembly and Release [1] - previous release project on Java 7. > * [Obsolete] Ignite JDK

Re: Request for contributor permissions

2018-02-05 Thread Vinokurov Pavel
My Jira id is pvinokurov 2018-02-05 19:26 GMT+03:00 Vinokurov Pavel : > Hello Igniters! > > My name is Pavel. I want to contribute to Apache Ignite and want to start > with fixing one of these tickets - https://issues.apache.org/ > jira/projects/IGNITE/issues. > Any

Request for contributor permissions

2018-02-05 Thread Vinokurov Pavel
Hello Igniters! My name is Pavel. I want to contribute to Apache Ignite and want to start with fixing one of these tickets - https://issues.apache.org/jira/projects/IGNITE/issues. Any help on this will be appreciated. Thanks! -- Regards Pavel Vinokurov

Obsolete build projects on CI server

2018-02-05 Thread vveider
Hi, Igniters. Found (and marked obsolete) several build project on our CI server: * [Obsolete] Assembly and Release [1] - previous release project on Java 7. * [Obsolete] Ignite JDK compatibility [2] - project that did not run for 2 years. * [Obsolete] Ignite Release [3] - more previous release

[GitHub] ignite pull request #3435: IGNITE-7317: SVM Examples

2018-02-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/3435 ---

Re: Thin client: Java bindings

2018-02-05 Thread Alexey Kukushkin
We also need asynchronous versions of all the thin client APIs. I created JIRA-7623 to address async APIs. Proposed design: Async methods are named by appending "Async" to the corresponding syncMethod, e.g. putAsync, clearAsync. Async methods

[jira] [Created] (IGNITE-7627) Introduce a new eviction policy to avoid eviction of Index pages

2018-02-05 Thread Alexey Popov (JIRA)
Alexey Popov created IGNITE-7627: Summary: Introduce a new eviction policy to avoid eviction of Index pages Key: IGNITE-7627 URL: https://issues.apache.org/jira/browse/IGNITE-7627 Project: Ignite

[jira] [Created] (IGNITE-7626) Unify code in test which clean up persistence directories

2018-02-05 Thread Eduard Shangareev (JIRA)
Eduard Shangareev created IGNITE-7626: - Summary: Unify code in test which clean up persistence directories Key: IGNITE-7626 URL: https://issues.apache.org/jira/browse/IGNITE-7626 Project: Ignite

Re: Abandoned Patch Available JIRA tickets

2018-02-05 Thread Pavel Tupitsyn
Fix Version should not be a required field, uncheduled tickets are perfectly normal. On Mon, Feb 5, 2018 at 4:20 PM, Vyacheslav Daradur wrote: > Hi Pavel, > > I've noticed that usually abandoned tickets are tickets without > specified "Fix Version", otherwise tickets should

[GitHub] ignite pull request #3474: IGNITE-5265 Eviction Rate memory metric

2018-02-05 Thread alex-plekhanov
GitHub user alex-plekhanov opened a pull request: https://github.com/apache/ignite/pull/3474 IGNITE-5265 Eviction Rate memory metric You can merge this pull request into a Git repository by running: $ git pull https://github.com/alex-plekhanov/ignite ignite-5265

Re: Abandoned Patch Available JIRA tickets

2018-02-05 Thread Vyacheslav Daradur
Hi Pavel, I've noticed that usually abandoned tickets are tickets without specified "Fix Version", otherwise tickets should be viewed once at least by release manager for moving to next release. Should we do "Fix Version" as required field? On Mon, Feb 5, 2018 at 3:44 PM, Дмитрий Рябов

Re: Eviction policies with persistence

2018-02-05 Thread Dmitry Pavlov
Hi Folks, Thank you for your replies! I've updated wiki according Lucas & Alexey's notes. Thank you! https://cwiki.apache.org/confluence/display/IGNITE/Ignite+Durable+Memory+-+under+the+hood#IgniteDurableMemory-underthehood-Pagereplacement(rotationwithdisk) I've named this section 'Page

Re: Abandoned Patch Available JIRA tickets

2018-02-05 Thread Дмитрий Рябов
Dmitry, there are 103 tickets for Cassandra [1] and 120 for Zookeeper [2]. [1] https://issues.apache.org/jira/browse/CASSANDRA-14132?jql=project%3Dcassandra%20AND%20status%3D"Patch%20Available"%20AND%20updated%20<%20-30d [2]

Re: Eviction policies with persistence

2018-02-05 Thread Ivan Rakov
Guys, +1 for renaming "eviction" for PDS mode. I'd choose "page replacement" over "page swapping" for two reasons: 1) We already have "replace" metrics in DataRegionMetrics. The less we change existing namings, the better. 2) "Page swapping" term is common in operating systems, and that's why

[GitHub] ignite pull request #3472: IGNITE-7437 Fix javadoc in partition based datase...

2018-02-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/3472 ---

Re: Abandoned Patch Available JIRA tickets

2018-02-05 Thread Pavel Tupitsyn
Fixed links: https://issues.apache.org/jira/issues/?jql=project%3Dignite%20AND%20status%3D%22Patch%20Available%22%20AND%20updated%20%3C%20-30d

Re: Abandoned Patch Available JIRA tickets

2018-02-05 Thread Dmitry Pavlov
Hi Denis, There is an interesting aspect of this issue for me. How close is Ignite community in this metric (not reviewed/not merged tickets) to other Apache communities? For example, to Cassandra. Sincerely, Dmitriy Pavlov пн, 5 февр. 2018 г. в 14:51, Pavel Tupitsyn :

Re: Abandoned Patch Available JIRA tickets

2018-02-05 Thread Pavel Tupitsyn
Bumping the thread. Denis Magda, as a PMC chair, can you please look into this? On Tue, Jan 30, 2018 at 5:26 PM, Pavel Tupitsyn wrote: > Igniters, > > We have *almost 60* of PATCH AVAILABLE tickets that are inactive for more > than a month: >

[GitHub] ignite pull request #3473: IGNITE-7625 Fix links for Javadoc

2018-02-05 Thread vveider
GitHub user vveider opened a pull request: https://github.com/apache/ignite/pull/3473 IGNITE-7625 Fix links for Javadoc You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-7625 Alternatively you can

[GitHub] ignite pull request #3472: IGNITE-7437 Fix javadoc in partition based datase...

2018-02-05 Thread dmitrievanthony
GitHub user dmitrievanthony opened a pull request: https://github.com/apache/ignite/pull/3472 IGNITE-7437 Fix javadoc in partition based dataset. You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite

Re: Get TTL of the specific (K,V) entry

2018-02-05 Thread Dmitry Pavlov
Hi, Previously, in real applications, I needed such information about what is the remaining lifetime for the object (at least for debug and monitoring). So I am also +1 for providing such information in the API. Otherwise, user have to duplicate this information in an entry field. Sincerely,

Re: Orphaned, duplicate, and main-class tests!

2018-02-05 Thread Anton Vinogradov
Ilya, 1) Still see no reason for such changes. Does this break something? 2) Looks like you're trying to add Trash*TestSuite.java which will never be refactored. We should do everything in proper way now, not sometime. 3) Your comments looks odd to me. Issue should be resolved in proper way.

Re: Ignite work directory usage?

2018-02-05 Thread Dmitry Pavlov
Hi Igniters, As far as I remember, matching workDir for different nodes in marshaller context are protected by file locks to avoid concurrent file modifications. Sergey C. what do you think? Or am I confuse Marhsaller Context with Binary Meta? Sincerely, Dmitry Pavlov чт, 1 февр. 2018 г. в

Re: Orphaned, duplicate, and main-class tests!

2018-02-05 Thread Ilya Kasnacheev
Anton, 1) We already have ~100 files named "*AbstractTest.java". Renaming these several files will help checking for orphaned tests in the future, as well as increasing code base consistency. 2) This is huge work that is not doable by any single developer. While IgniteLostAndFoundTestSuite can

[jira] [Created] (IGNITE-7623) Thin client Java API - async API

2018-02-05 Thread Alexey Kukushkin (JIRA)
Alexey Kukushkin created IGNITE-7623: Summary: Thin client Java API - async API Key: IGNITE-7623 URL: https://issues.apache.org/jira/browse/IGNITE-7623 Project: Ignite Issue Type:

Re: Transport compression (not store compression)

2018-02-05 Thread Nikita Amelchev
Thanks for your comments, I will try to separate network compression for clients and servers. It makes sense to enable compression on servers if we have SSL turned on. I tested rebalancing time and compression+ssl is faster. SSL throughput is limited by 800 Mbits/sec per connection and if enable

Re: Orphaned, duplicate, and main-class tests!

2018-02-05 Thread Anton Vinogradov
Ilya, 1) I don't think it's a good idea to rename classes to *AbstractTest.java since they already have abstract word at definition. We can perform such renaming only in case whole project will be refactored, but I see no reason to do this. 2) All not included test should be included to

Re: Transparent Data Encryption (TDE) in Apache Ignite

2018-02-05 Thread Dmitry Pavlov
Hi Igniters, Encryption will ensure security only if keys are stored in a secure storage. Otherwise having access to Ignite node storage, we can extract encryption master keys values and read data as plain text (page's clear content). Where are we going to store keys (MEK) physically? Whould it

Re: Subject: new committer: Nikolay Izhikov

2018-02-05 Thread Vyacheslav Daradur
That is good news! Congrats, Nikolay! On Mon, Feb 5, 2018 at 12:21 PM, Anton Vinogradov wrote: > The Project Management Committee (PMC) for Apache Ignite > has invited Nikolay Izhikov to become a committer and we are pleased > to announce that he has accepted. > > Nikolay is an

Subject: new committer: Nikolay Izhikov

2018-02-05 Thread Anton Vinogradov
The Project Management Committee (PMC) for Apache Ignite has invited Nikolay Izhikov to become a committer and we are pleased to announce that he has accepted. Nikolay is an author of the Spark Data Frame API integration [1]. >From what I see, Nikolay one of the most strongest and active

Re: Annoying extra steps for enabling metrics

2018-02-05 Thread Alex Plehanov
Ok, then I will rename methods to setEventsDisabled/getEventsDisabled. 2018-02-01 12:46 GMT+03:00 Anton Vinogradov : > Folks, > > .setEventsDisabled looks to be a good solution, since we will always call > it like .setEventsDisabled(true). > > Calling

[jira] [Created] (IGNITE-7622) SQL: Subquery fails in non-collocated mode

2018-02-05 Thread Roman Shtykh (JIRA)
Roman Shtykh created IGNITE-7622: Summary: SQL: Subquery fails in non-collocated mode Key: IGNITE-7622 URL: https://issues.apache.org/jira/browse/IGNITE-7622 Project: Ignite Issue Type: Bug

[jira] [Created] (IGNITE-7621) Review current builds on TeamCity

2018-02-05 Thread Peter Ivanov (JIRA)
Peter Ivanov created IGNITE-7621: Summary: Review current builds on TeamCity Key: IGNITE-7621 URL: https://issues.apache.org/jira/browse/IGNITE-7621 Project: Ignite Issue Type: Task

Re: Transparent Data Encryption (TDE) in Apache Ignite

2018-02-05 Thread Дмитрий Рябов
Hi, Igniters! I think it would be nice to implement encryption in Ignite. Even SQLite and H2 have encryption so why Ignite don't have it? I'd like to propose a design for discussion. Configurations: IgniteConfiguration: - KeyStore tdeKeyStore - contain encryption keys. - Encryptor encryptor -