pig-user  

Re: apache log parsing

Earl Cahill
Fri, 26 Sep 2008 23:09:40 -0700

Looks like my attachment might have disappeared.  Just in case, I posted a copy 
here

http://pig.holaservers.com/CommonLogLoader.java

I was going to try and get some patches ready, but where would such a class go? 
 Is it a piggybank thing?  I guess it might go in storage?  Is that the right 
place?  I will try to get things going just using ant, since my eclipse isn't 
going quite yet.

Thanks,
Earl


----- Original Message ----
From: Earl Cahill <[EMAIL PROTECTED]>
To: pig-user@incubator.apache.org
Sent: Friday, September 26, 2008 10:06:51 AM
Subject: Re: apache log parsing


This post was before my pig time, but I unknowingly wrote something in parallel 
which I attached.  I am trying to get pig going with eclipse so I can get a 
patch set or two submitted.  Before that happens, you're welcome to look at my 
code.

Thanks,
Earl



----- Original Message ----
From: Ian Holsman <[EMAIL PROTECTED]>
To: pig-user@incubator.apache.org
Sent: Thursday, September 25, 2008 11:46:40 PM
Subject: Re: apache log parsing

Hi Juan.
did you get anywhere with that UDF?
the pastebin has expired.

Regards
Ian

Juan Manuel Caicedo wrote:
> Hello Mark
>
> I was working on a UDF that parses a log file in the Common Log
> Format. The code is still experimental and not tested, but you can use
> it if you want:
>
> http://pastebin.com/m63796241
>
> Let me know if you have questions or if it works for you.
>
> Juan Manuel Caicedo
>
> On Fri, Jul 4, 2008 at 2:53 AM, Theocharis Ian Athanasakis
> <[EMAIL PROTECTED]> wrote:
>  
>> Gert,
>>
>> Some tips on writing your own UDF functions are at
>> http://wiki.apache.org/pig/PigFunctions
>>
>> There is more information on the UDF repository, also known as the
>> Piggy Bank, http://wiki.apache.org/pig/PiggyBank
>>
>> Note that both of these links come from http://wiki.apache.org/pig/ .
>> It's a pretty good resource.
>>
>> Cheers,
>>
>> Ian.
>>
>> On Fri, Jul 4, 2008 at 00:35, Gert Pfeifer <[EMAIL PROTECTED]> wrote:
>>    
>>> Where do I find the UDF repository?
>>>
>>> Gert
>>>
>>> Olga Natkovich wrote:
>>>      
>>>> I don't know of any at the moment. But if you do find it or create a new
>>>> one, please, consider adding it to the UDF repository.
>>>>
>>>> Olga
>>>>
>>>>        
>>>>> -----Original Message-----
>>>>> From: Mark Snow [EMAIL PROTECTED]
>>>>> Sent: Wednesday, July 02, 2008 1:56 PM
>>>>> To: pig-user@incubator.apache.org
>>>>> Subject: apache log parsing
>>>>>
>>>>> Hi All,
>>>>>
>>>>> (Thanks for the help with the tutorial!) I'm looking at using
>>>>> pig to chew through some apache server log files. Has anyone
>>>>> on the list done this? Any best practices or UDF's floating
>>>>> around out there?
>>>>>
>>>>>
>>>>>          
>
>