Yes, the indexer isn't giving you anything if your files are so small. You should merge your files if that's an option.
On Fri, Dec 16, 2011 at 12:06 PM, Cameron Gandevia <[email protected]> wrote: > Hi > > I am currently injesting lzo compressed log files, running the lzo indexer > on them and then running a bunch of pig scripts. The typical size of the > lzo files are around 100mb. I am wondering if I should run a map/reduce job > to merge the files into a larger file prior to running the lzo indexer? > > Thanks
