What format is the file in? You can use ProtobufBytesToTuple() udf to convert protobuf bytes to a PIG tuple.
e.g.:
define
ToTuple
com.twitter.elephantbird.pig.piggybank.ProtobufBytesToTuple('com.example.protobufs.Table.User');
users = foreach binary generate ToTuple(user_bytes);
describe users;
Raghu.
On Thu, Sep 22, 2011 at 9:27 PM, Doug Daniels <[email protected]>wrote:
> Is it possible to use elephant-bird to load protobuf-encoded data that
> isn't compressed with LZO?
>
> Thanks,
> Doug
>
