Re: Very high memory consumption in apache ignite

[rishi007bansod]

I did memory analysis following is result I got in eclipse MAT. 
<http://apache-ignite-users.70518.x6.nabble.com/file/n9034/heap_dump.png> 
What further memory tuning can I apply?



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Very-high-memory-consumption-in-apache-ignite-tp8822p9034.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Very high memory consumption in apache ignite

[Andrey Mashenkov]

Hi rishi007bansod.

Are you sure all these memory consumped with java process?
You can try to analyze pmap or vmmap tool report? https://plumbr.eu/
blog/memory-leaks/why-does-my-java-process-consume-more-memory-than-xmx

Please, let me know if you find any suspicious thing.

On Thu, Nov 10, 2016 at 5:19 PM, rishi007bansod <rishi007ban...@gmail.com>
wrote:

> Cache configuration I have used is,
>
> CacheConfiguration<Object,Object> ccfg_order_line = new
> CacheConfiguration<>();
> ccfg_order_line.setIndexedTypes(order_lineKey.class,
> order_line.class);
> ccfg_order_line.setName("order_line_cache");
> ccfg_order_line.setCopyOnRead(false);
> ccfg_order_line.setMemoryMode(CacheMemoryMode.ONHEAP_TIERED);
> ccfg_order_line.setSwapEnabled(false);
> ccfg_order_line.setBackups(0);
> IgniteCache<Object, Object> cache_order_line =
> ignite.createCache(ccfg_order_line);
>
> JVM configuration I have used is,
>
> -server
> -Xms10g
> -Xmx10g
> -XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC
> -XX:+UseTLAB
> -XX:NewSize=128m
> -XX:MaxNewSize=128m
> -XX:MaxTenuringThreshold=0
> -XX:SurvivorRatio=1024
> -XX:+UseCMSInitiatingOccupancyOnly
> -XX:CMSInitiatingOccupancyFraction=40
> -XX:MaxGCPauseMillis=1000
> -XX:InitiatingHeapOccupancyPercent=50
> -XX:+UseCompressedOops
> -XX:ParallelGCThreads=8
> -XX:ConcGCThreads=8
> -XX:+DisableExplicitGC
>
> same as provided at link
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/Very-high-memory-consumption-in-apache-
> ignite-tp8822p8880.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>

Re: Very high memory consumption in apache ignite

[rishi007bansod]

Cache configuration I have used is,

CacheConfiguration<Object,Object> ccfg_order_line = new
CacheConfiguration<>();
ccfg_order_line.setIndexedTypes(order_lineKey.class, order_line.class);
ccfg_order_line.setName("order_line_cache");
ccfg_order_line.setCopyOnRead(false);
ccfg_order_line.setMemoryMode(CacheMemoryMode.ONHEAP_TIERED);
ccfg_order_line.setSwapEnabled(false);
ccfg_order_line.setBackups(0);
IgniteCache<Object, Object> cache_order_line =
ignite.createCache(ccfg_order_line);

JVM configuration I have used is,

-server 
-Xms10g 
-Xmx10g 
-XX:+UseParNewGC 
-XX:+UseConcMarkSweepGC 
-XX:+UseTLAB 
-XX:NewSize=128m 
-XX:MaxNewSize=128m 
-XX:MaxTenuringThreshold=0 
-XX:SurvivorRatio=1024 
-XX:+UseCMSInitiatingOccupancyOnly 
-XX:CMSInitiatingOccupancyFraction=40
-XX:MaxGCPauseMillis=1000 
-XX:InitiatingHeapOccupancyPercent=50 
-XX:+UseCompressedOops
-XX:ParallelGCThreads=8 
-XX:ConcGCThreads=8 
-XX:+DisableExplicitGC

same as provided at link 



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Very-high-memory-consumption-in-apache-ignite-tp8822p8880.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Very high memory consumption in apache ignite

[Dmitriy Govorukhin]

Hi, could you please provide your final jvm options  and cache configuration?  



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Very-high-memory-consumption-in-apache-ignite-tp8822p8879.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Very high memory consumption in apache ignite

[vkulichenko]

Data is consumed not only by data, but by JVM in total, so it's hard to tell.
If you don't have any issues associated with this, then most likely these
are mostly temporary objects that will be eventually garbage collected. If
you have any concerns, I would recommend to grab a heap dump and check what
is going on.

-Val



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Very-high-memory-consumption-in-apache-ignite-tp8822p8856.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Very high memory consumption in apache ignite

[rishi007bansod]

I have 9 tables with number of entries as mentioned below,
<http://apache-ignite-users.70518.x6.nabble.com/file/n8822/tables.png> 

total size of database is 370MB but when I put data in cache it almost
consumes 7GB of Memory. Following are memory consumption details.

Memory consumption before data loading in cache :
<http://apache-ignite-users.70518.x6.nabble.com/file/n8822/before.png> 

Memory consumption after data loading in cache :
<http://apache-ignite-users.70518.x6.nabble.com/file/n8822/after.png> 

Why this is happening? Also as mentioned in post 
https://apacheignite.readme.io/docs/capacity-planning
<https://apacheignite.readme.io/docs/capacity-planning>   total in-memory
database size should increase by 30% after applying indexing. So in my case
data size should be at max 410MB. 



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Very-high-memory-consumption-in-apache-ignite-tp8822.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.