Hi,

There are two ways to load large amounts of data into cache: using
IgniteDataStreamer and using CacheStore.loadCache method.

In case of IgniteDataStreamer you should start one client and read the whole
file there. It seems to me, the way you split will not give performance
improvement, because reading a line from local file is faster than updating
a remote node.

In case of CacheStore each node will have to read the whole file as well,
but it will save only data that belongs to the local node and discard
everything else, so there will be no network traffic at all during the
process.

Please refer to this documentation page for more information and examples:
https://apacheignite.readme.io/docs/data-loading

Let us know if you have more questions.

-Val



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Super-slow-data-loading-performance-when-more-nodes-added-tp1105p1117.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Reply via email to