On 11/08/2010, at 9:50 AM, Chris Hulbert wrote:
... (each record has ~8 integer fields).
Hit a bit of a roadblock - it takes about 8 1/2 minutes to load 1
million records into a locally running cluster of 3 or 4.
You're moving 32 MB. If that's from disk to RAM, you should be able to
do that in under a second.
If it's across a LAN, well, it'll depend on your network, but it
should be no slower.
If it is... you need to find the bottleneck (duh).
What's using CPU during those 8 minutes?
How many disk IO/s is the DB process requesting?
I suspect the latter is your problem (too many small IO requests), but
I know nothing about Hazelcast.
Can you cluster the records into large chunks, say at least 64KB each?
Clifford Heath.
--
You received this message because you are subscribed to the Google Groups "Ruby or
Rails Oceania" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/rails-oceania?hl=en.
