Hi All, We are using Cassandra database with very simple table schema which consists two columns of type string and both the columns length is less than 16 characters, first column is Primary Key and all queries/updates performed using it. This table holds around billion records.
To optimize the transaction latencies especially for queries, we are evaluating to use Apache Ignite as caching layer on top of underlying Cassandra database. Appended below is the sample ignite configuration file, while loading table into cache we have foreseen heavy memory usage and unable to cache full data. Need your help in identifying the RAM requirements to cache the whole data into memory and also let us know if any changes needed in ignite configurations to improve the performance and to optimize the resource utilization. The following XML I am overriding during node start up: -------------------------------------------------------------->> <?xml version="1.0" encoding="UTF-8"?> <beans xmlns="http://www.springframework.org/schema/beans"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd";> <bean class="org.apache.ignite.cache.store.cassandra.datasource.DataSource" name="cassandra"> <property name="contactPoints" value="vmc0293,vmc0294,vmc0302" /> </bean> <bean class="org.apache.ignite.configuration.IgniteConfiguration"> <property name="cacheConfiguration"> <list> <bean class="org.apache.ignite.configuration.CacheConfiguration"> <property name="cacheMode" value="PARTITIONED" /> <property name="backups" value="0" /> <property name="name" value="msisdn_sub_cs" /> <property name="readThrough" value="true" /> <property name="writeThrough" value="true" /> <property name="sqlSchema" value="msisdn_sub_cs" /> <property name="indexedTypes"> <list> <value type="java.lang.Class">java.lang.String</value> <value type="java.lang.Class">java.lang.String</value> </list> </property> <property name="cacheStoreFactory"> <bean class="org.apache.ignite.cache.store.cassandra.CassandraCacheStoreFactory"> <property name="dataSource" ref="cassandra" /> <property name="persistenceSettings"> <bean class="org.apache.ignite.cache.store.cassandra.persistence.KeyValuePersistenceSettings"> <constructor-arg type="java.lang.String"> <value></value> </constructor-arg> </bean> </property> </bean> </property> </bean> </list> </property> <property name="discoverySpi"> <bean class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> <property name="ipFinder"> <bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder"> <property name="addresses"> <list> <value>10.61.217.13:47500..47509</value> <value>10.61.217.14:47500..47509</value> <value>10.61.217.22:47500..47509</value> </list> </property> </bean> </property> </bean> </property> <property name="dataStorageConfiguration"> <bean class="org.apache.ignite.configuration.DataStorageConfiguration"> <property name="defaultDataRegionConfiguration"> <bean class="org.apache.ignite.configuration.DataRegionConfiguration"> <property name="name" value="Default_Region" /> <property name="maxSize" value="#{20L * 1024 * 1024 * 1024}" /> </bean> </property> </bean> </property> </bean> </beans> -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
