[jira] [Created] (IGNITE-9343) ignite-geospatial is not on maven central

2018-08-21 Thread Grant Haywood (JIRA)
Grant Haywood created IGNITE-9343: - Summary: ignite-geospatial is not on maven central Key: IGNITE-9343 URL: https://issues.apache.org/jira/browse/IGNITE-9343 Project: Ignite Issue Type: Bug

[MTCGA]: new failures in builds [1703435] needs to be handled

2018-08-21 Thread dpavlov . tasks
Hi Ignite Developer, I am MTCGA.Bot, and I've detected some issue on TeamCity to be addressed. I hope you can help. *New test failure in master SchemaExchangeSelfTest.testNonEmptyDynamic

Re: Does Ignite support java.sql.Array?

2018-08-21 Thread Denis Magda
I've removed the ARRAY data type from the supported list. Regardless of this, Vova, could you answer to Dmiry's question? -- Denis On Tue, Aug 14, 2018 at 8:28 AM Dmitriy Setrakyan wrote: > > > On Tue, Aug 14, 2018 at 3:34 AM, Vladimir Ozerov > wrote: > >> Hi, >> >> No, we do not support

Re: Apache ignite contribution

2018-08-21 Thread Denis Magda
Hi, Please tell your JIRA id so that we grant required permissions. -- Denis On Tue, Aug 21, 2018 at 7:59 PM SUMIT KESARWANI wrote: > Hi All, > wanted to contribute in apache ignite project. > i request to admin , please provide me the access for jira to assign issue > for myself. > > >

[MTCGA]: new failures in builds [1703433] needs to be handled

2018-08-21 Thread dpavlov . tasks
Hi Ignite Developer, I am MTCGA.Bot, and I've detected some issue on TeamCity to be addressed. I hope you can help. *New test failure in master IgniteCacheAtomicProtocolTest.testPutReaderUpdate1

Apache ignite contribution

2018-08-21 Thread SUMIT KESARWANI
Hi All, wanted to contribute in apache ignite project. i request to admin , please provide me the access for jira to assign issue for myself. -Sumit Kesarwani India

[MTCGA]: new failures in builds [1701592] needs to be handled

2018-08-21 Thread dpavlov . tasks
Hi Ignite Developer, I am MTCGA.Bot, and I've detected some issue on TeamCity to be addressed. I hope you can help. *New test failure in master IgniteClusterActivateDeactivateTestWithPersistence.testClientReconnectClusterActivated

Re: Table Names in Spark Catalog

2018-08-21 Thread Valentin Kulichenko
Stuart, Thanks for pointing this out, I was not aware that we use Spark database concept this way. Actually, this confuses me a lot. As far as I understand, catalog is created in the scope of a particular IgniteSparkSession, which in turn is assigned to a particular IgniteContext and therefore

Re: ignite PureJavaCrc32 vs java.util.zip.CRC32 bench.

2018-08-21 Thread Alex Plehanov
Dmitriy, yes, you correctly understood my idea. вт, 21 авг. 2018 г. в 22:03, Vladimir Ozerov : > Guys, > > Do we have any numbers for real workloads? Or at least Yardstick. > > вт, 21 авг. 2018 г. в 21:04, Dmitriy Pavlov : > > > Let us double-check current options. Maybe I'm mistaken about Alex

[GitHub] ignite pull request #4590: Ignite 2.4.9

2018-08-21 Thread slukyano
GitHub user slukyano opened a pull request: https://github.com/apache/ignite/pull/4590 Ignite 2.4.9 You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-2.4.9 Alternatively you can review and apply

Re: Apache Ignite 2.7 release

2018-08-21 Thread Dmitriy Setrakyan
Thanks, Nikolay! I think it is important to include the links to all important Jira tickets in this thread, so that the community can track them. D. On Tue, Aug 21, 2018 at 12:06 AM, Nikolay Izhikov wrote: > Hello, Dmitriy. > > I think Transparent Data Encryption will be available in 2.7 > >

Re: ignite PureJavaCrc32 vs java.util.zip.CRC32 bench.

2018-08-21 Thread Vladimir Ozerov
Guys, Do we have any numbers for real workloads? Or at least Yardstick. вт, 21 авг. 2018 г. в 21:04, Dmitriy Pavlov : > Let us double-check current options. Maybe I'm mistaken about Alex > Plehanov's idea. > > Let's introduce the following variables and functions: > data - our block. >

Re: ignite PureJavaCrc32 vs java.util.zip.CRC32 bench.

2018-08-21 Thread Dmitriy Pavlov
Let us double-check current options. Maybe I'm mistaken about Alex Plehanov's idea. Let's introduce the following variables and functions: data - our block. OldImpl(data) = X NewImpl(data) = Y NewImpl(data) ^ C = Y ^ C, where C is constant, ^ is bitwise XOR operation. And NewImpl(data) ^ C = X =

Re: Workflow improvement

2018-08-21 Thread Dmitriy Pavlov
Hi Dmitriy, The Bot is able to detect a frequent change of test status, but currently only 50 last runs count. Same is true for the failure rate. This value can be easily changed to 70 or 100, moreover, the auto trigger feature gives us much more builds. We can improve these rules. We can add

Storage Class Memory and Persistent Collections

2018-08-21 Thread Steve Hostettler
Hello, Clearly Storage Class Memory represents a breakthrough for "in memory" grids and some people already tried it on Ignite : http://dmagda.blogspot.com/2017/10/3d-xpoint-outperforms-ssds-verified-on.ht ml I would like to know what is the position of the community towards the Persistent

[GitHub] ignite pull request #4589: Replace TcpDiscoveryMulticastIpFinder with TcpDis...

2018-08-21 Thread dmekhanikov
GitHub user dmekhanikov opened a pull request: https://github.com/apache/ignite/pull/4589 Replace TcpDiscoveryMulticastIpFinder with TcpDiscoveryVmIpFinder in tests Created for testing You can merge this pull request into a Git repository by running: $ git pull

Re: Workflow improvement

2018-08-21 Thread Dmitrii Ryabov
I think plugin will be more pretty looking, but comments can contain any information, so they can be more usefull. I agree with your idea to create bot instead of plugin. As for fail rate - I'm not sure it is working as you describe. I'm looking on my runAll [1]. There is

[GitHub] ignite pull request #4588: IGNITE-9326 Fixed node failure processor invocati...

2018-08-21 Thread agoncharuk
GitHub user agoncharuk opened a pull request: https://github.com/apache/ignite/pull/4588 IGNITE-9326 Fixed node failure processor invocation when EntryProcess… …or result serialization throws an exception You can merge this pull request into a Git repository by running: $

Re: Table Names in Spark Catalog

2018-08-21 Thread Stuart Macdonald
Nikolay, Val, The JDBC Spark datasource[1] -- as far as I can tell -- has no ExternalCatalog implementation, it just uses the database specified in the JDBC URL. So I don't believe there is any way to call listTables() or listDatabases() for JDBC provider. The Hive ExternalCatalog[2] makes the

Re: Workflow improvement

2018-08-21 Thread Dmitriy Pavlov
Hi Dmitrii, I'm not sure we're able to install Github apps to Apache mirrors. The simplest solution, what can be as efficient as a plugin, is fake MTCGA bot account in Github, which will provide PR comments using Github program interface. What do you think? A new test failure can be identified

[GitHub] ignite pull request #4581: IGNITE-9313 Update chief and user script processe...

2018-08-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/4581 ---

[GitHub] ignite pull request #4585: IGNITE-9336: Remove random test dataset generatio...

2018-08-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/4585 ---

[GitHub] ignite pull request #4582: IGNITE-6167: Ability to enabled TLS protocols and...

2018-08-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/4582 ---

[GitHub] ignite pull request #4440: IGNITE-6167: Ability to enabled TLS protocols and...

2018-08-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/4440 ---

Workflow improvement

2018-08-21 Thread Dmitrii Ryabov
Hello, Igniters! I want to suggest improvement for TeamCity Helper [1] – we need an easy way to get list of failed tests that don’t fall in the master branch. These tests should: * fail in the PR * not fail in the master * not be flaky. Also, I want to suggest to create a GitHub plugin, which

[GitHub] ignite pull request #4587: IGNITE-9270 Thread-per-partition during Tx commit

2018-08-21 Thread Jokser
GitHub user Jokser opened a pull request: https://github.com/apache/ignite/pull/4587 IGNITE-9270 Thread-per-partition during Tx commit You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-9270

[jira] [Created] (IGNITE-9342) The same SQL request with multiple statements produces different result

2018-08-21 Thread Igor Sapego (JIRA)
Igor Sapego created IGNITE-9342: --- Summary: The same SQL request with multiple statements produces different result Key: IGNITE-9342 URL: https://issues.apache.org/jira/browse/IGNITE-9342 Project:

Re: ignite PureJavaCrc32 vs java.util.zip.CRC32 bench.

2018-08-21 Thread Sergey Kozlov
Alex In that case the data becomes in unpredictable state (mix of new and old methods) and there's a chance that some partitions will be never touched and never converted. It will force us always support old compression. I suppose the explicit conversion that clearly say what is happening now and

[jira] [Created] (IGNITE-9341) Notify metastorage listeners righ before start of discovery processor

2018-08-21 Thread Ivan Rakov (JIRA)
Ivan Rakov created IGNITE-9341: -- Summary: Notify metastorage listeners righ before start of discovery processor Key: IGNITE-9341 URL: https://issues.apache.org/jira/browse/IGNITE-9341 Project: Ignite

[GitHub] ignite pull request #4586: IGNITE-9279

2018-08-21 Thread devozerov
GitHub user devozerov opened a pull request: https://github.com/apache/ignite/pull/4586 IGNITE-9279 You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-9279-1 Alternatively you can review and apply

Re: QueryDetailMetrics for cache-less SQL queries

2018-08-21 Thread Evgenii Zhuravlev
Hi Alex, I agree that we can't move all metrics to ignite.metrics() and SPI metrics is a good example here. I propose to move at least dataRegionMetrics, dataStorageMetrics to it, since the main API class is not a good place for such things. If we will decide to choose option 1 from my first

[GitHub] ignite pull request #4585: IGNITE-9336: Remove random test dataset generatio...

2018-08-21 Thread zaleslaw
GitHub user zaleslaw opened a pull request: https://github.com/apache/ignite/pull/4585 IGNITE-9336: Remove random test dataset generation 1. Remove ThreadLocalRandom usages in test dataset data generation 2. Refactor Trainer tests 3. Propose a few static datasets generated

[GitHub] ignite pull request #4138: IGNITE-7339 RENTING partition is not evicted afte...

2018-08-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/4138 ---

Re: Wrong off-heap size is reported for a node

2018-08-21 Thread Pavel Pereslegin
Hello, Igniters. I assigned ticket [1] created by Denis and want to clarify how to log committed size. The metric offHeapSize (in DataRegionMetricsImpl) is always calculated, but getOffHeapSize returns zero if memory metrics are disabled for this data region. So I see the following options: 1.

Re: ignite PureJavaCrc32 vs java.util.zip.CRC32 bench.

2018-08-21 Thread Alex Plehanov
Sergey, converting data also force us to introduce some flag to WAL segments/records or convert WAL segments too. WAL segments can be archived, they also can be compressed. IMO we better should not introduce any compatibility modes, left data as is and always just convert crc value returned by

[jira] [Created] (IGNITE-9339) Web console: form-field-size improvements

2018-08-21 Thread Ilya Borisov (JIRA)
Ilya Borisov created IGNITE-9339: Summary: Web console: form-field-size improvements Key: IGNITE-9339 URL: https://issues.apache.org/jira/browse/IGNITE-9339 Project: Ignite Issue Type:

[GitHub] ignite pull request #4584: IGNITE-2.4.8.b5

2018-08-21 Thread dmekhanikov
GitHub user dmekhanikov opened a pull request: https://github.com/apache/ignite/pull/4584 IGNITE-2.4.8.b5 Created for testing. You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-2.4.8.b5 Alternatively

Re: Table Names in Spark Catalog

2018-08-21 Thread Nikolay Izhikov
Hello, Stuart. Can you do some research and find out how schema is handled in Data Frames for a regular RDBMS such as Oracle, MySQL, etc? В Пн, 20/08/2018 в 15:37 -0700, Valentin Kulichenko пишет: > Stuart, Nikolay, > > I see that the 'Table' class (returned by listTables method) has a

[jira] [Created] (IGNITE-9338) ML TF integration: tf cluster can't connect after killing first node with default port 10800

2018-08-21 Thread Stepan Pilschikov (JIRA)
Stepan Pilschikov created IGNITE-9338: - Summary: ML TF integration: tf cluster can't connect after killing first node with default port 10800 Key: IGNITE-9338 URL:

Re: Unknown known issue on cache rebalancing delayed

2018-08-21 Thread Maxim Muzafarov
Roman, I worked recently on rebalance improvements and haven't found any problems with delayed cache rebalacne. Agree with you - let's uncomment this and remove scary comment. Will you create a ticket for it? In case of any problems we can easily detec deadlock with newly configured

[jira] [Created] (IGNITE-9337) VisorNodeDataCollectorTask may produce HUGE result in case of large cluster with many caches

2018-08-21 Thread Alexey Kuznetsov (JIRA)
Alexey Kuznetsov created IGNITE-9337: Summary: VisorNodeDataCollectorTask may produce HUGE result in case of large cluster with many caches Key: IGNITE-9337 URL:

[jira] [Created] (IGNITE-9336) [ML] ANN/SVM Trainer tests produce unpredictable results due to random data generation

2018-08-21 Thread Aleksey Zinoviev (JIRA)
Aleksey Zinoviev created IGNITE-9336: Summary: [ML] ANN/SVM Trainer tests produce unpredictable results due to random data generation Key: IGNITE-9336 URL: https://issues.apache.org/jira/browse/IGNITE-9336

Re: Apache Ignite 2.7 release

2018-08-21 Thread Nikolay Izhikov
Hello, Dmitriy. I think Transparent Data Encryption will be available in 2.7 В Пн, 20/08/2018 в 13:20 -0700, Dmitriy Setrakyan пишет: > Hi Nikolay, > > Thanks for being the release manager! > > I am getting a bit lost in all these tickets. Can we specify some > high-level tickets, that are not