Re: Memory foot print of the ignite nThe background cache eviction process was unable to free [10] percent of the cache for Context

2017-12-25 Thread Alexey Popov
Naveen,

I am not sure I understand you correctly.

Ignite off-heap usage is a part of your VIRT "top" output. You can add DATA
column to "top" output to better visualize memory usage of pure
on-heap+off-heap data only.

Please run Ignite with different memory settings and see the memory
footprint.

   PID USER  PR  NIVIRTRESSHR S  %CPU %MEM TIME+ COMMAND
  
SWAP   CODEDATA
  6833 root  20   0 3725072 242744  17740 S   1.0 12.0   0:11.02 java   
 
0  4 1427232

Thank you,
Alexey



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/


Re: Memory foot print of the ignite nThe background cache eviction process was unable to free [10] percent of the cache for Context

2017-12-21 Thread Naveen
Thanks Alexey.

As you mentioned, in heap its only java classes that reside, which you can
mention while starting the ignite thru VM options and it will be reflected
after the node comes up

Topology snapshot [ver=1, servers=1, clients=0, CPUs=8, heap=7.1GB]

And, on linux when we execute top command we can see all the processes
running and other stats like RAM, CPU usage like below

Below entry is shown for the ignite process, which shows the used heap size
of JVM.  
  PID USER  PR  NIVIRTRESSHR S  %CPU %MEM TIME+ COMMAND


63200 tibusr20   0 21.562g *1.792g * 14908 S   1.0  5.8  14:37.77
/app/JAVA_1.8/jdk1.8.0_151//bin/java -Xms1g -Xmx1g -server
-XX:+AggressiveOpts -XX:MaxMetaspace+

However, data is not stored in off-heap, so how do we know the process which
is holding the off-heap memory, can we see this in the top command output

Thanks
Naveen




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/


Re: Memory foot print of the ignite nThe background cache eviction process was unable to free [10] percent of the cache for Context

2017-12-20 Thread Alexey Popov
Hi Naveen,

Off-heap memory "Off-heap size" works strangely.
There are several tickets here
https://issues.apache.org/jira/browse/IGNITE-6814
https://issues.apache.org/jira/browse/IGNITE-5583
http://apache-ignite-users.70518.x6.nabble.com/Cache-size-in-Memory-td17226.html

You can get an estimation of off-heap memory usage by  *  (4k default for 2.3)
 ^-- PageMemory [pages=2043040] 
So, it is about 2043040 * 4096 = 8.3 Gb

Does it look realistic for you data models?

Please note that all Caches are stored off-heap.
On-heap memory used for data transfer, "hot" caches on top of off-heap
caches, etc.

Regarding your error: 
Are you sure you use Ignite here for cache variable?
It looks like org.apache.catalina.webresources.Cache is used instead of
Ignite for your code

res = cache.get(custid).toString(); 

Thank you,
Alexey



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/