On Tue, 2005-10-04 at 09:52 -0700, Doug Cutting wrote: > Rod Taylor wrote: > >>Tell me how it behaves during the sort phase. > > > > I ran 8 jobs simultaneously. Very high await time (1200) and it was > > doing about 22MB/sec data writes. Nearly 0 reads from disk (everything > > would be cached in memory). > > This is during the sort part? This first writes a big file, then reads > it, then sorts it. With 20M records I think the file is around 2.5GB, > so eight of these would be 20GB. Do you have 20GB of RAM?
For the archives: The poor performance was caused by the IBM 1.4.2 JDK. Changing to Suns JDK (1.4 or 1.5) seems to have superior performance when dealing with disk IO. -- Rod Taylor <[EMAIL PROTECTED]>
