Re: NullPointerException on ScanQuery

2016-12-20 Thread Alper Tekinalp
Hi Val. Do you have an idea what is causing the NPE in the first place? As Andrey says the exception is caused because of different topology versions cluster nodes. > What is null? > Node is null in the following code in org.apache.ignite.internal.processors.cache.query.ScanQueryFallbackClosa

Re: Ignite cluster

2016-12-20 Thread Anil
Thanks Val. But the default STOP option not looks correct. There is always chance of rejoining of cluster. But if ignite cache is stopped because of segmentation, rejoin has no meaning. Creating different clusters still fine as long as cache is not stopped in case of network segmentation. is the

Re: Ignite Shutdown Hook

2016-12-20 Thread tysli2016
hemanta did you call close() on the Ignite instance? Ignite ignite = Ignition.start(); // do something with ignite ignite.close() I have a similar problem before, and found that Ignite have some threads running which prevent the jvm from stopping even the main thread ended. -- Vi

Re: Ignite 1.6.0 suspected memory leak from DynamicCacheDescriptor

2016-12-20 Thread tysli2016
Thanks for your effort in patiently and promptly replies, we are trying to reproduce the issue, will keep you posted. Tom -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-1-6-0-suspected-memory-leak-from-DynamicCacheDescriptor-tp9443p9669.html Sent from th

Re: Python Client for Apache Ignite

2016-12-20 Thread vkulichenko
Hi Piali, To my knowledge there are ODBC connectors for Python available, so if ODBC API is enough for you in C++, you can do the same for Python. Does this make sense? Can you please clarify what is missing for you? -Val -- View this message in context: http://apache-ignite-users.70518.x6.na

Re: Does Ignite support query and index the embedded object column?

2016-12-20 Thread vkulichenko
Embedded objects are supported, but the flat schema is created, i.e. 'street' and 'zip' fields will appear directly in the 'Organization' table. The query will look like this: select street from Organization where id= ? -Val -- View this message in context: http://apache-ignite-users.70518.x6

Re: Ignite Shutdown Hook

2016-12-20 Thread Valentin Kulichenko
Hi, I'm not sure I understand the problem... Where is the application stuck? Did you look at thread dump? -Val On Tue, Dec 20, 2016 at 12:30 PM, hemanta wrote: > Hi, > > I am starting Ignite as standalone program embedded in my java application > via Spring configuration. It works great howeve

Re: Wait till the cache loading is complete before querying through ignite client

2016-12-20 Thread vkulichenko
I meant the compute as well. With compute you can send your code to any node and have full control on this. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Wait-till-the-cache-loading-is-complete-before-querying-through-ignite-client-tp9643p9662.html Sent f

Re: Ignite Shutdown Hook

2016-12-20 Thread Dmitriy Setrakyan
+ user list On Tue, Dec 20, 2016 at 12:30 PM, hemanta wrote: > Hi, > > I am starting Ignite as standalone program embedded in my java application > via Spring configuration. It works great however my application stucks and > never finishes. I have added some shutdown hooks but they are never cal

Re: Wait till the cache loading is complete before querying through ignite client

2016-12-20 Thread vkulichenko
With LOCAL cache you always have to run the query locally. I.e., you have to send a closure to the server node you want to query and call the cache API there. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Wait-till-the-cache-loading-is-complete-before-que

Re: Python Client for Apache Ignite

2016-12-20 Thread Piali Mazumder Nath
Hi Denis, Please find my reply in-line. On Thu, Dec 15, 2016 at 11:30 PM, Denis Magda wrote: > Piali, > > You're always welcomed. > > Would you answer on some of the questions for me? > > What use cases require you to have a special support on Python side? > Piali>>> We might build some platform

Re: Python Client for Apache Ignite

2016-12-20 Thread piali
Hi Roman, Thanks for the link. I am looking for python client to perform operations programetically right from the beginning like configuring, starting, inserting, stopping etc. Regards, Piali On Fri, Dec 16, 2016 at 12:29 AM, Roman Shtykh [via Apache Ignite Users] < ml-node+s70518n9586...@n6.na

Re: NullPointerException on ScanQuery

2016-12-20 Thread Valentin Kulichenko
Hi Andrey, Do you have an idea what is causing the NPE in the first place? What is null? I didn't quite get it from the thread. -Val On Tue, Dec 20, 2016 at 2:14 AM, Andrey Gura wrote: > Hi, > > As I wrote already I don't see any race for stable topology. Problems > are possible on unstable to

Re: Ignite Design questions

2016-12-20 Thread vkulichenko
Hi Chris, See my comments below... Chris Berry wrote > * How does a Clustered & Partitioned IgniteCache handle a > `cache.getAll(Set<> keys)` behind the scenes ?? > Will it transparently fan those requests out to the appropriate Partition > for me (from the Client – or is it a “double hop” — on

Re: What are typical load time for millions of records

2016-12-20 Thread vkulichenko
Hi, You're right, this heavily depends on a lot of factors and it's almost impossible to tell if these numbers are good or bad. For large data sets you can try partition aware data loading [1]. It can give performance improvement and also is pretty scalable. I.e. you can make it even better by add

Re: LoadCache Performance decreases with the size of the cache

2016-12-20 Thread vkulichenko
Hi Steve, Did you do any profileration? I would recommend to use VisualVM or JFR to see what the hotspots are. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/LoadCache-Performance-decreases-with-the-size-of-the-cache-tp9645p9652.html Sent from the Apache

Re: Wait till the cache loading is complete before querying through ignite client

2016-12-20 Thread vkulichenko
Hi, Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. pmazumdar wrote > I have a cache loader job that puts data in

Re: Increase Java heap space for Ignite

2016-12-20 Thread vkulichenko
pmazumdar wrote > Can we do the same from java code or config file? No, the amount of heap memory can be specified only prior to JVM startup. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Increase-Java-heap-space-for-Ignite-tp1768p9650.html Sent from the

Re: Ignite cluster

2016-12-20 Thread vkulichenko
Ignite doesn't have full segmentation resolution support out of the box. With Ignite you will always end up with two independent working cluster in case of segmentation. You will then have to restart on of these clusters, but if there were updates on the restarted cluster after the segmentation, th

What are typical load time for millions of records

2016-12-20 Thread steve.hostettler
I'm currently trying to improve the load time. I would like to have some feedbacks from other Ignite users as for the actual load performances. In my setup, I have a DB in the same subnet with an Ignite node with 8 cores. It loads 20,000,000 records in 1h with the standard loadCache implementation

Re: LoadCache Performance decreases with the size of the cache

2016-12-20 Thread steve.hostettler
Maybe some more information on this. Apparently the more concurrent threads the worse it becomes. Therefore, I guess that there is some sort of lock (I get why) that is maybe slowing down the load in the cache. Here is my cache configuration: final CacheConfiguration ccfg = new C

Ignite Design questions

2016-12-20 Thread Chris Berry
Greetings, I am hoping for some design advice? I am new to Ignite and don’t want to start out on the wrong foot. At my day job we have a “Rates Engine”. It computes the current Rate for a particular User request. It is a high volume/low latency system. And currently it lives within a Java Serv

LoadCache Performance decrease with the size of the cache

2016-12-20 Thread steve.hostettler
Hello, I am trying to increase the performance of the cache loading. I am witnessing a strange behavior: as the number of objects increase in the cache the number of objects loaded per seconds decrease. The database server seems not to be the problem. To get some numbers I copy pasted the CacheAbs

Re: Does Ignite support query and index the embedded object column?

2016-12-20 Thread dkarachentsev
Hi, Check out this answer [1]. [1] http://apache-ignite-users.70518.x6.nabble.com/Querying-over-fields-in-the-object-inside-Cache-value-td9426.html -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Does-Ignite-support-query-and-index-the-embedded-object-column-tp

Re: Ignite cluster

2016-12-20 Thread Anil
Can someone point me to the ignite xml configuration for network segmentation ? i see IgniteConfiguration property names for network segmentation and setting methods are different :) Thanks On 14 December 2016 at 18:20, Anil wrote: > Hi Anton, > > Thank you very much. > > > > On 14 December 20

Re: Cache Metrics

2016-12-20 Thread Alper Tekinalp
Hi all. Thanks for your replies. Enabling statistics fixed it. On Tue, Dec 20, 2016 at 12:39 PM, Andrey Mashenkov wrote: > Hi Alper, > > May be it is not obvious, but to enable offheap you need to > setOffheapMaxMemory to zero (unlimited) or above zero. > Also metrics is disabled by default, yo

Re: Cache Metrics

2016-12-20 Thread Andrey Mashenkov
Hi Alper, May be it is not obvious, but to enable offheap you need to setOffheapMaxMemory to zero (unlimited) or above zero. Also metrics is disabled by default, you need call setStatisticsEnabled(true); On Tue, Dec 20, 2016 at 11:41 AM, Alper Tekinalp wrote: > Hi all. > > I have the following

Cache Metrics

2016-12-20 Thread Alper Tekinalp
Hi all. I have the following code: IgniteConfiguration igniteConfiguration = new IgniteConfiguration(); igniteConfiguration.setGridName("alper"); Ignite start = Ignition.start(igniteConfiguration); CacheConfiguration configuration = new CacheConfiguration();

Re: NullPointerException on ScanQuery

2016-12-20 Thread Alper Tekinalp
Hi all. Is there any comment on this? -- Alper Tekinalp Software Developer Evam Streaming Analytics Atatürk Mah. Turgut Özal Bulv. Gardenya 5 Plaza K:6 Ataşehir 34758 İSTANBUL Tel: +90 216 455 01 53 Fax: +90 216 455 01 54 www.evam.com.tr