there's an open bug on stalled/slow reduce copy speeds (don't have the number handy). but it's targeted for 0.16 from what i remember.
we get stuck in this once in a while and killing the reduce task fixes things (admittedly, not a real solution). speculative execution might help as well - but i don't have much experience using it. -----Original Message----- From: Jason Venner [mailto:[EMAIL PROTECTED] Sent: Wed 12/5/2007 9:11 AM To: [email protected] Subject: more on reduce copy speed The map is 100% done, and has been for a 10 minutes or more. reduce > copy (24 of 89 at 1.45 MB/s)
