High cpu on ignite server nodes

2018-06-16 Thread praveeng
Hi , We are observing one issue recently that on ignite servers is 100% CPU utilization. ignite version 1.8, server config: RAM 16GB, Cores : 8 please find a thread dump and cache xml and can you please check and suggest if there is any issue. cai003_june14_tdump.zip

RE: High cpu on ignite server nodes

2018-06-16 Thread praveeng
Hi Stan, The high cpu usage is on all servers. one doubt , what is the default expiry policy for any cache if we don't set. Following are the stats of one cache collected from ignitevisor. Cache 'playerSessionInfoCacheIgnite(@c18)':

Re: The thread which is inserting data into Ignite is hung

2018-06-03 Thread praveeng
Hi All, We have identified the following issues and fixed after that onwards we haven't got any issue. 1. Cursor is not closed when we do a query 2. backups 2147483646 to 1 or 2 [ i am not sure will it really cause any issue or not.] 3. TCP port 9090 is opened from client to server but not opened

The thread which is inserting data into Ignite is hung

2018-04-14 Thread praveeng
Hi, We have observed one issue with IGNITE today is , the client thread has been waiting forever when it is trying to create a cache, inserting the data and trying to know the size of the cache [ REPLICATED caches, backups value for these caches is 2147483647 ]. We are getting this issue few

RE: High cpu on ignite server nodes

2018-06-22 Thread praveeng
Hi Stan, Thanks for your analysis. We have increased the on heap cache size 50 and added expiry policy [30mins]. The expiry policy is expiring the entries and the cache is never reaching to it's max size. But now we see high heap usage because of that GCs are happening frequently and FULL GC

Re: Inserting data into Ignite thread is hung

2018-10-22 Thread praveeng
Hi , I have forgot to specify the below points. 1. This issue is happening every time at the same place of code for the same cache. 2. The cache to which we are inserting is not at all used by any other service [ cache instance is created in other services but we will not be making any call to

Re: Inserting data into Ignite thread is hung

2018-10-22 Thread praveeng
Hi, I don't think there is a network issue, since at that moment other clients are able to access the data from the Ignite cluster. But some times the inserting thread is hung for 15 mins, after that it has proceeded further. If the thread is hung which is inserting, we are canceling the thread

Inserting data into Ignite thread is hung

2018-10-22 Thread praveeng
Hi , Version: 1.8 Java: 1.7.0_45-b18 [ we can't upgrade the java version to 1.8 due to some internal restriction.] We are facing that the ignite thread is hung when we are trying to insert the data. This is not happening that much frequently. We don't see any exceptions in ignite except below

Re: Inserting data into Ignite thread is hung

2018-10-26 Thread praveeng
Hi, We are getting this issue in production continuously. I am attaching the thread dumps of my services (ignite client -threaddump14168.txt file and ignite servers- 3 files ). can any one please analyze and suggest once how to fix this issue. threaddump14168.txt

Re: Ignite node is down due to full RAM usage

2019-03-26 Thread praveeng
Hi, As we can't upgrade java version to 1.8, we can't use the ignite latest version. If it is because of Heap Memory issue, i could have got the OOM error in logs and heap dump might have generated automatically. This could be because of the data in off heap is not expired and the RAM is used

Ignite node is down due to full RAM usage

2019-03-22 Thread praveeng
Hi, Ignite version : 1.8 One of the ignite node in 3node cluster is down due to full usage of RAM. At that point of time i can observe the following logs on this node: [00:32:02,119][INFO ][grid-timeout-worker-#7%CasinoApacheIgniteServices%][IgniteKernal%CasinoApacheIgniteServices] Metrics for