You might find the elephant-bird project helpful for reading and creating LZO files, in raw hadoop or using Pig. (disclaimer: I'm a committer on elephant-bird)
D On Wed, Mar 28, 2012 at 9:49 AM, Prashant Kommireddi <[email protected]> wrote: > Pig support LZO for splittable compression. > > Thanks, > Prashant > > On Mar 28, 2012, at 9:45 AM, Mohit Anchlia <[email protected]> wrote: > >> We currently have 100s of GB of uncompressed data which we would like to >> zip using some compression that is block compression so that we can use >> multiple input splits. Does pig support any such compression?
