On Mon, Jan 9, 2012 at 2:42 AM, Oliver Meyn (GBIF) <[email protected]> wrote: > It seems really weird that compression (native compression even moreso) > should be required by a command that is in theory moving files from one place > on a remote filesystem to another. Any light shed would be appreciated.
The issue is that the completebulkload script does actually open the files to read their metadata as well as the first/last key in the file. This is necessary to figure out which region each file belongs in. So, you do need the compression support on whatever machine you run completebulkload from. -Todd -- Todd Lipcon Software Engineer, Cloudera
