I have started my cluster and pushed some data into a cache. Cluster details
are provided below. The cache has persistence enabled.
I see a couple of issues with how data is cached.
1. Out of 8 nodes only 2 nodes have some entries. I ran all my keys through
Murmur3 hash and they seemed to be evenly distributed.
2. On the nodes that have data, I only see entires in off-heap (Which I
assume is disk). I have 0 entries in heap and 0 in heap memory. Do entries
only get into off-heap memory when they are read?
This is the output from visor for a node:
Total: 419490
Heap: 0
Off-Heap: 419490
Off-Heap Memory: 0
My cluster consists of 8 servers running one node each. Each server has 32GB
RAM and 4 Cores.
All the nodes are started like this
=================
bin/ignite.sh -J-Xmx3g config/dev-cluster-config.xml
=================
My cache consists of
- key: strings of length 9 chars
- Value: POJOs that have some metadata and one large array of integers
(8800 values)
I have 4 data streamers and as they start pushing data, I see some server
nodes throwing OutOfMemoryErrors and the data streamers hangup.
The streamer code is here.
Cache configuration:
==========================================
CacheConfiguration<String, Tile> cacheCfg = new
CacheConfiguration<>(DATA_CACHE_NAME);
cacheCfg.setAtomicityMode(CacheAtomicityMode.ATOMIC);
cacheCfg.setCacheMode(CacheMode.PARTITIONED);
cacheCfg.setBackups(2);
cacheCfg.setWriteSynchronizationMode(CacheWriteSynchronizationMode.FULL_SYNC);
cacheCfg.setIndexedTypes(String.class, Tile.class);
==========================================
Cluster-config.xml :
<bean id="ignite.cfg"
class="org.apache.ignite.configuration.IgniteConfiguration">
<property name="igniteInstanceName"
value="dev-ignite-cluster-us-east1"/>
<property name="peerClassLoadingEnabled" value="true"/>
<property name="dataStorageConfiguration">
<bean
class="org.apache.ignite.configuration.DataStorageConfiguration">
<property name="defaultDataRegionConfiguration">
<bean
class="org.apache.ignite.configuration.DataRegionConfiguration">
<property name="persistenceEnabled" value="true"/>
<property name="maxSize" value="#{16L * 1024 * 1024
* 1024}"/>
</bean>
</property>
</bean>
</property>
<property name="discoverySpi">
<bean
class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
<!-- Aws config goes here-- >
</bean>
</property>
</bean>
=========================================
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
