Re: question on Hadoop configuration for non cpu intensive jobs - 0.15.1

[Jason Venner]

Our OOM was being caused by a damaged sequence data file. We had assumed 
that the sequence files had checksums, which appears to be in correct.
The deserializer was reading a bad length out of the file and trying to 
allocate 4gig of ram.