Hi, we are using Ignite as a cache layer over Cassandra for faster read queries using spark. Our cluster has 10 nodes running an instance of Cassandra and Ignite. However, we came across a few issues:
1) We currently store the data from spark to cassandra. Hence to load data, we need to call .loadCache() . I know there are ways for data written in Ignite to be synced with cassandra (writeBehind, writeThroughs) . However we want to do the opposite. Load in cassandra and want it to be reflected in the cache which can be queries by spark. Is there a way to do so ? 2) To load data into the cache from Cassandra, I start a new client in another machine and call the .loadCache() method. However, it takes almost 45 minutes to load the data (around 30 million rows with 20 columns each) . Is there a way to make this faster by ensuring that data from a particular node in cassandra cluster is parallelly loaded to the cache instance of the same node ? I have defined my partition and clustering columns in the my spring persistance-settings. Thanks, Shrey -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
