pig-user  

RE: log file formats

Olga Natkovich
Tue, 16 Sep 2008 16:27:35 -0700

You would need to write a custome storage funcion for this.

Olga 

> -----Original Message-----
> From: Emmett Shear [EMAIL PROTECTED] 
> Sent: Tuesday, September 16, 2008 4:00 PM
> To: pig-user@incubator.apache.org
> Subject: log file formats
> 
> I have a log file I'm writing explicitly to process in pig. 
> The data for each line is a set of key-value pairs, which 
> seems pretty much perfect as a fit for Pig, however I'm 
> having some trouble. It's easy to parse a space delimited 
> list into a tuple with PigStorage(' '); is there an easy way 
> to parse "k=v k=v k=v" key value pairs into a map? I have 
> total control over the log format.
> 
> Thanks,
> Emmett
>