Hi I am currently injesting lzo compressed log files, running the lzo indexer on them and then running a bunch of pig scripts. The typical size of the lzo files are around 100mb. I am wondering if I should run a map/reduce job to merge the files into a larger file prior to running the lzo indexer?
Thanks
