On 18/10/10 23:07, Michael Segel wrote:
Ok, I'll bite. Why would you want to use a block size of> 2GB?
1. Some of the events coming off large physics devices are single self-contained files of 3+ GB size; having a block size which has an event in a single block guarantees locality for the entirety of the operation.
2. Some very fast clusters are finding problems with smaller block sizes (256MB) causing TT's to finish too fast and so overload the JT. It's a combination of TT-JVM-Reuse, cluster size and improved disk and CPU performance.
