Re: CTE and Recursive CTE support in SQL

2018-08-24 Thread piyush
When is Recursive CTE planned ? Recursive CTE is super powerful. https://www.postgresql.org/docs/current/static/queries-with.html https://docs.microsoft.com/en-us/sql/t-sql/queries/with-common-table-expression-transact-sql?view=sql-server-2017 -- Sent from:

Re: CTE and Recursive CTE support in SQL

2018-08-24 Thread piyush
H2 has limited support for Recursive CTE. http://h2database.com/html/advanced.html#recursive_queries Does Ignite supports all SQL features which H2 has ? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Recommended HW on AWS EC2 - vertical vs horizontal scaling

2018-08-24 Thread aealexsandrov
Hi, Ignite doesn't have such kind of benchmarks because they are very specific for every case and setup. However, exists several common tips: 1)In case if you will use EBS then try to avoid the NVMe. It is fast but looks like doesn't provide the guarantees for saving your data. We face the

Re: Unix timestamp conversion problem

2018-08-24 Thread ilya.kasnacheev
Hello! Can you share a reproducer for this problem? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Data index loss problem

2018-08-24 Thread Stanislav Lukyanov
What's your version? Do you use native persistence? Stan -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Affinity key in SQL execution

2018-08-24 Thread Prasad Bhalerao
Can someone please reply to this? On Thu, Aug 23, 2018, 8:38 PM Prasad Bhalerao wrote: > Problem is resolved now. The index type setting in cache configuration was > incorrect. After setting DefaultDataAffinityKey.class in cache config index > type query executed successfully. > > New sql is as

Re: Recommended HW on AWS EC2 - vertical vs horizontal scaling

2018-08-24 Thread eugene miretsky
Thanks Andrei, For user case, please see my email ("Data modeling for segmenting a huge data set: precomputing vs real time computations"). I think our main confusion right now is trying to understand how exactly SQL queries work (when memory is moved to heap, when/how is H2 used, how the reduce

Re: Thin client vs client node performance in Spark

2018-08-24 Thread eugene miretsky
Thanks, So the way I understand it, thick client will use the affinitly key to send data to the right node, and hence will split the traiffic between all the nodes, the thin client will just send the data to one node, and that node will be responsible to send it to the actual node that owns the

Re: Possible issue with Web Console

2018-08-24 Thread Stanislav Lukyanov
This is the commit https://github.com/apache/ignite/commit/bab61f1. Fixed in 2.7. Stan -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How much heap to allocate

2018-08-24 Thread eugene miretsky
Thanks! I am trying to understand when and how data is moved from off-heap to on heap, particularly when using SQL. I took a look at the wiki but still have a few questions My understanding is that data

ScanQuery predicate serialization

2018-08-24 Thread route99
Hello, is there a way to execute a ScanQuery with the Predicate not being serialized? Otherwise it requires the class which implements the IgniteBiPredicate interface or the class where the scan query is executed (with a lambda passed in as the predicate) to be on the classpath of the ignite

ignte cluster hang with GridCachePartitionExchangeManager

2018-08-24 Thread wangsan
Now my cluster topology is Node a,b,c,d all with persistence enable and peerclassloader false. b c d have different class(cache b) from a. 1.When any node crash with oom(memory or stack) .all nodes hang with " - Still waiting for initial partition map exchange " 2.When a start first, b,c,d start

Re: ScanQuery predicate serialization

2018-08-24 Thread vkulichenko
Serialization of the filter must happen, because it's invoked on server nodes and therefore needs to be instantiated there. However, peer class loading can be used for production. If you see this callout in the documentation, you're probably looking at some old version of it. -Val -- Sent

Re: Thin client vs client node performance in Spark

2018-08-24 Thread eugene miretsky
Attached is the error I get from ignitevisorcmd.sh after calling the cache command (the command just hangs). To me it looks like all the spark executrors (10 in my test) start a new client node, and some of those nodes get terminated and restarted as the executor die. This seems to really confuse

Cache Configuration Templates

2018-08-24 Thread Dave Harvey
I found what I've read in this area confusing, and here is my current understanding. When creating an IgniteConfiguration in Java or XML, I can specify the property cacheConfiguration, which is an array of CacheConfigurations. This causes Ignite to preserve these configurations, but this will not

Cross plat form put/get

2018-08-24 Thread wengyao04
Hi, we have c++ ignite client and java client to read/write to the same cache. Our key is a composite object, my cache is IgniteCache ---c++ --- namespace ignite { namespace binary { struct Key { std::string id; bool flag; Key() : id() , flag(false) {

Apache Ignite Hackathon: Open Source contribution is simple

2018-08-24 Thread Dmitriy Pavlov
Hi Ignite Users, Developers, and Enthusiasts, It's natural to assume that a newcomer has little to offer the Apache Ignite. However, you can be surprised at how much each newcomer can help, even now. I would propose to run a hackathon on the next Apache Ignite meetup. In parallel with talks, an

Re: How much heap to allocate

2018-08-24 Thread NSAmelchev
Hi Eugene, Yes, it's a misprint as Dmitry wrote. Ignite print this warning if nodes on local machine require more than 80% of physical RAM. >From code, you can see that total heap/offheap memory summing from nodes having the same mac address. This way calculates total memory used by the local

Re: CTE and Recursive CTE support in SQL

2018-08-24 Thread Ilya Kasnacheev
Hello! Try it and see. With regards of Recursive CTE, I think the development priority is MVCC for now. As for H2 features, there might be further limitations on them in Apache Ignite. Regards, -- Ilya Kasnacheev 2018-08-24 10:34 GMT+03:00 piyush : > H2 has limited support for Recursive

Re: How much heap to allocate

2018-08-24 Thread Dmitriy Pavlov
Hi Eugene, Misprint was corrected in https://issues.apache.org/jira/browse/IGNITE-7824 and will be released as part of 2.7. Even you don't have on-heap caches, entries during reading will be anyway unmarshalled from off-heap to on-heap. So right choice of -Xmx has a high dependence to particular