Our machines are on a GigE switch. With SCP for compressed data, I see
50MB/sec transfer rates.
When my reduce is running, on the status page I see the following for
the incomplete reduce's
reduce > copy (643 of 789 at 0.12 MB/s) >
reduce > copy (656 of 789 at 0.12 MB/s) >
reduce > copy (644 of 789 at 0.12 MB/s) >
reduce > copy (644 of 789 at 0.12 MB/s) >
reduce > copy (656 of 789 at 0.12 MB/s) >
reduce > copy (656 of 789 at 0.12 MB/s) >
reduce > copy (643 of 789 at 0.12 MB/s) >
reduce > copy (623 of 789 at 0.12 MB/s) >
reduce > copy (621 of 789 at 0.12 MB/s) >
Is that the actual transfer rate between machines, or is that a
misleading number?
We are running with replication set to 3.
