Re: IgniteOutOfMemoryException in LOCAL cache mode with persistence enabled

2019-12-11 Thread Sergey Chugunov
Hi Mitchell, I believe that research done by Anton is correct, and the root cause of the OOME is proportion of memory occupied by metapages in data region. Each cache started in data region allocates one or more metapages per initialized partition so when you run your test with only one cache

Re: Adding support for Ignite secondary indexes to Apache Calcite planner

2019-12-11 Thread Vladimir Ozerov
Roman, What I am trying to understand is what advantage of materialization API you see over the normal optimization process? Does it save optimization time, or reduce memory footprint, or maybe provide better plans? I am asking because I do not see how expressing indexes as materializations fit

Re: IgniteOutOfMemoryException in LOCAL cache mode with persistence enabled

2019-12-11 Thread Denis Magda
I tend to agree with Mitchell that the cluster should not crash. If the crash is unavoidable based on the current architecture then a message should be more descriptive. Ignite persistence experts, could you please join the conversation and shed more light to the reported behavior? - Denis On

Re: Re[4]: Text queries/indexes (GridLuceneIndex, @QueryTextFiled)

2019-12-11 Thread Yuriy Shuliga
I will look to the MOVING partition issue. But also need a guidance there. Ivan, don't you mind to be that person? The question is whether we have an issue with: - wrong storing targets during indexing OR - incorrect nodes/partition selection during querying? BR, Yuriy Shluiha -- Sent

Re: Adding support for Ignite secondary indexes to Apache Calcite planner

2019-12-11 Thread Roman Kondakov
Vladimir, the main advantage of the Phoenix approach I can see is the using of Calcite's native materializations API. Calcite has advanced support for materializations [1] and lattices [2]. Since secondary indexes can be considered as materialized views (it's just a sorted representation of the

[jira] [Created] (IGNITE-12437) .NET: Run tests on macOS TeamCity agent

2019-12-11 Thread Pavel Tupitsyn (Jira)
Pavel Tupitsyn created IGNITE-12437: --- Summary: .NET: Run tests on macOS TeamCity agent Key: IGNITE-12437 URL: https://issues.apache.org/jira/browse/IGNITE-12437 Project: Ignite Issue Type:

Re: Adding support for Ignite secondary indexes to Apache Calcite planner

2019-12-11 Thread Ivan Pavlukhin
Vladimir, You are right Phoenix integration with Calcite stalled halfway. See [1] to get some reasons. [1] https://lists.apache.org/thread.html/0152a97bfebb85c74f10e26e94ab9cd416dec374abba7dc2e1af9d61%40%3Cdev.phoenix.apache.org%3E ср, 11 дек. 2019 г. в 17:11, Vladimir Ozerov : > > Roman, > >

Re: Adding support for Ignite secondary indexes to Apache Calcite planner

2019-12-11 Thread Vladimir Ozerov
Roman, What is the advantage of Phoenix approach then? BTW, it looks like Phoenix integration with Calcite never made it to production, did it? вт, 10 дек. 2019 г. в 19:50, Roman Kondakov : > Hi Vladimir, > > from what I understand, Drill does not exploit collation of indexes. To > be precise

[jira] [Created] (IGNITE-12436) ignite.properties must be handled by maven update-version profile

2019-12-11 Thread Maxim Muzafarov (Jira)
Maxim Muzafarov created IGNITE-12436: Summary: ignite.properties must be handled by maven update-version profile Key: IGNITE-12436 URL: https://issues.apache.org/jira/browse/IGNITE-12436 Project:

[jira] [Created] (IGNITE-12435) [Spark] Add support for saving to existing table via saveAsTable

2019-12-11 Thread Alexey Zinoviev (Jira)
Alexey Zinoviev created IGNITE-12435: Summary: [Spark] Add support for saving to existing table via saveAsTable Key: IGNITE-12435 URL: https://issues.apache.org/jira/browse/IGNITE-12435 Project:

[jira] [Created] (IGNITE-12434) Dump checkpoint readLock holder threads if writeLock can`t take lock more than threshold timeout.

2019-12-11 Thread Stanilovsky Evgeny (Jira)
Stanilovsky Evgeny created IGNITE-12434: --- Summary: Dump checkpoint readLock holder threads if writeLock can`t take lock more than threshold timeout. Key: IGNITE-12434 URL:

Re: Duplicate column name while creating table

2019-12-11 Thread Ilya Kasnacheev
Hello! I have filed an issue https://issues.apache.org/jira/browse/IGNITE-12433 Regards, -- Ilya Kasnacheev ср, 11 дек. 2019 г. в 12:43, Denis Magda : > It sounds like the implementation specificities of Ignite DML. > > SQL folks, how about throwing an exception in case of the duplicate

[jira] [Created] (IGNITE-12433) Possible to create table with duplicate definition of column

2019-12-11 Thread Ilya Kasnacheev (Jira)
Ilya Kasnacheev created IGNITE-12433: Summary: Possible to create table with duplicate definition of column Key: IGNITE-12433 URL: https://issues.apache.org/jira/browse/IGNITE-12433 Project:

[jira] [Created] (IGNITE-12432) [Spark] Need to add test for AVG function in IgniteOptimizationAggregationFuncSpec

2019-12-11 Thread Alexey Zinoviev (Jira)
Alexey Zinoviev created IGNITE-12432: Summary: [Spark] Need to add test for AVG function in IgniteOptimizationAggregationFuncSpec Key: IGNITE-12432 URL: https://issues.apache.org/jira/browse/IGNITE-12432

Re: Duplicate column name while creating table

2019-12-11 Thread Denis Magda
It sounds like the implementation specificities of Ignite DML. SQL folks, how about throwing an exception in case of the duplicate name? - Denis On Thu, Dec 5, 2019 at 9:38 AM DS wrote: > *I am able to create the table with duplicate column name.* > > I was expecting some error saying