a different machine is fine
all you need to do is build a client using either java, c++,.net, scala, and
probably powershell as well
i have something like this in .Net and can parallel load files (one per
thread in a pool of 10 threads)
using (var ldr = igniteclient.GetDataStreamer<dynamic,
dynamic>(tablename))
{
ldr.AllowOverwrite = true;
ldr.AutoFlushFrequency = 5000;
ldr.PerNodeParallelOperations = 20;
ldr.PerNodeBufferSize = 15000;
foreach (var record in lines) --CSV
{
1) create class object and populate it with csv data
ldr.AddData(id, instanceRecord);
}
}
it will be much faster than the way you are loading it which i presume is
one file at a time and you wont run into this 2.5gb limitation that is
likely related to the tool you are using and you have no control over it
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
