I am loading data through kafkastreamer and ignitedatastreamer to cache. What are ideal settings for ignitedatastreamer(for parameters like, pernodebuffersize, pernodeparallelprocessing, autoflushfreq) to load data at high rate. Also are there any system settings in linux that can increase data loading performance significantly? what else can I try for improving data load throughput. My message size is 500 bytes and i am getting rate of only 50k msgs/sec i.e. 25MB/s, but RAM write rates are upto 100GB/sec. So how can I achieve this rate?
-- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Get-high-throughput-for-loading-data-in-ignite-tp10483.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
