Re: onheapCacheEnabled enormous heap consumption

2019-07-24 Thread Andrey Dolmatov
Thanks! It was unclear for me. On Sun, Jul 14, 2019, 10:59 AM Павлухин Иван wrote: > Andrey, > > Yes it is a little bit complicated for understanding. > > CacheConfiguration.evictionPolicy takes it roots back in history where > there were neither offheap nor persisence, cache data was stored in

Re: onheapCacheEnabled enormous heap consumption

2019-07-15 Thread Majid Salimi
Unsubscribe me On Sun, Jul 14, 2019 at 12:30 PM Павлухин Иван wrote: > Andrey, > > Yes it is a little bit complicated for understanding. > > CacheConfiguration.evictionPolicy takes it roots back in history where > there were neither offheap nor persisence, cache data was stored in > java heap

Re: onheapCacheEnabled enormous heap consumption

2019-07-14 Thread Павлухин Иван
Andrey, Yes it is a little bit complicated for understanding. CacheConfiguration.evictionPolicy takes it roots back in history where there were neither offheap nor persisence, cache data was stored in java heap only. Also, as far as I know, today CacheConfiguration.evictionPolicy (as already

Re: onheapCacheEnabled enormous heap consumption

2019-07-08 Thread Ilya Kasnacheev
Hello! Data is always written to persistence immediately (via WAL). You can control eviction of offheap with evictionThreshold and pageEvictionMode settings of DataRegionConfiguration. Regards, -- Ilya Kasnacheev пн, 8 июл. 2019 г. в 17:50, Andrey Dolmatov : > When data overfit dataRegion

Re: onheapCacheEnabled enormous heap consumption

2019-07-08 Thread Andrey Dolmatov
When data overfit dataRegion max size, so no more available offheap space, then data goes to persistence. So, what option controls how data pages should be evicted from offheap to persistence. On Mon, Jul 8, 2019, 5:33 PM Ilya Kasnacheev wrote: > Hello! > > Data is always stored in offheap.

Re: onheapCacheEnabled enormous heap consumption

2019-07-08 Thread Ilya Kasnacheev
Hello! Data is always stored in offheap. Eviction strictly controls onheap cache. Once data is evicted from onheap it is available in offheap. Regards, -- Ilya Kasnacheev пн, 8 июл. 2019 г. в 17:31, Andrey Dolmatov : > We plan to use persistence in production. I didn't understand, >

Re: onheapCacheEnabled enormous heap consumption

2019-07-08 Thread Andrey Dolmatov
We plan to use persistence in production. I didn't understand, CacheConfiguration.EvictionPolicy specify heap->offheap eviction, offheap->persistence eviction or both. It's not clear for me. On Mon, Jul 8, 2019, 5:19 PM Ilya Kasnacheev wrote: > Hello! > > Oops, I was wrong. This is indeed the

Re: onheapCacheEnabled enormous heap consumption

2019-07-08 Thread Andrey Dolmatov
No, we didn't specify EvictionPolicy. I didn't find does CacheConfiguration have default EvictionPolicy? On Mon, Jul 8, 2019, 5:19 PM Ilya Kasnacheev wrote: > Hello! > > Oops, I was wrong. This is indeed the wrong setting. > > Have you tried specifying evictionPolicy? I think it is the one that

Re: onheapCacheEnabled enormous heap consumption

2019-07-08 Thread Ilya Kasnacheev
Hello! Oops, I was wrong. This is indeed the wrong setting. Have you tried specifying evictionPolicy? I think it is the one that controls eviction from onheap cache. You can put a LruEvictionPolicy of 100 000 here, for example. Regards, -- Ilya Kasnacheev пн, 8 июл. 2019 г. в 17:09, Andrey

Re: onheapCacheEnabled enormous heap consumption

2019-07-08 Thread Andrey Dolmatov
No, because we didnt specify QueryEntity. Does onheapCacheEnabled uses for SQL only? What default value for sqlOnheapCacheMaxSize? пн, 8 июл. 2019 г. в 17:05, Ilya Kasnacheev : > Hello! > > Have you tried also specifying sqlOnheapCacheMaxSize? You can specify 100 > 000 if you like. > > Regards,

Re: onheapCacheEnabled enormous heap consumption

2019-07-08 Thread Ilya Kasnacheev
Hello! Have you tried also specifying sqlOnheapCacheMaxSize? You can specify 100 000 if you like. Regards, -- Ilya Kasnacheev пн, 8 июл. 2019 г. в 17:01, Andrey Dolmatov : > We use simple replicated KV cache. > We try to upload 32 000 000 small records to it (about 6Gb in > data region,

onheapCacheEnabled enormous heap consumption

2019-07-08 Thread Andrey Dolmatov
We use simple replicated KV cache. We try to upload 32 000 000 small records to it (about 6Gb in data region, persistance disabled). We load data using DataStreamer. If we set onheapCacheEnabled=false, server node consumes heap about 500 Mb. If we set onheapCacheEnabled=true, server node