Re: LZO LoadFunc

[Kevin Weil]

Hey all,

We're getting super close to open-sourcing about 8 different LZO-based pig
loaders out there, along with a code-generator for protobuf-based big
loaders and a framework for creating your own for your own data formats.  We
use this internally.  I extracted the bits from our internal repo last week,
generalized certain parts away from our particular setup (always a good
thing), and just today Dmitriy and I re-integrated the nearly-open-source
version into our repo.  We're testing now.  I expect I'll have everything up
on my github page next week.  I'll tweet about it (@kevinweil) and then post
to this user list a couple days later when the first few people have
verified that it's looking ok.

Thanks,
Kevin

On Thu, Mar 11, 2010 at 11:10 PM, Rekha Joshi <rekha...@yahoo-inc.com>wrote:

> Kevin Weil <kevinw...@gmail.com>
> www.github.com/kevinweil/hadoop-lzo
>
> On 3/12/10 12:23 PM, "Bae, Jae Hyeon" <metac...@gmail.com> wrote:
>
> Hi everyone
>
> I want to use LZO splittable IO in pig. I saw Kevin Weil's github
> repository that he wrote LZO LoadFunc functionalities but he didn't
> contribute it yet.
>
> According to him, For Pig jobs, email me or check the pig list -- I
> have custom LZO loader classes that work but are not (yet) contributed
> back.
>
> but I cannot find his email address :(
>
> Please put me through his email address or let me know where I can
> find LZO LoadFunc source codes
>
> Regards Jae Hyeon
>
>