Re: Slow cache loading with an object key using affinity key

[vtchernyi]

Hi,

Please take a look at my post [1]. It is not exactly about you question, but it works in production for row count you mention

Regards,

Vladimir
[1] https://www.gridgain.com/resources/blog/how-fast-load-large-datasets-apache-ignite-using-key-value-api

22:39, 22 января 2021 г., gvaidya <gvai...@insynccloud.com>:

Hi Alex,

The data distribution of itemid is very even. For the ~537K records data set
there are exactly 12 records per itemid for all values of itemid.

I have reviewed all the documentation in the links you provided. I also
switched to jdk8 (i was using jdk15 earlier), set my jvm options per the
documentation recommendations. No change in cache load times. It
consistently takes 3 min to load ~537K records. Interestingly, the load
process is not linear. I can see ~200K loaded in 30 sec. The next 30 sec get
me to ~300K, next 1 min to ~425K.

Here are my jvm options:

Attached is the node server log and the GC log per you request.

Thanks,
Gautam
ignite-2a3b18c1.log
<http://apache-ignite-users.70518.x6.nabble.com/file/t3063/ignite-2a3b18c1.log>
GClog.current
<http://apache-ignite-users.70518.x6.nabble.com/file/t3063/GClog.current>

--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

--
Отправлено из мобильного приложения Яндекс.Почты