You might like to check up PIG-116 and HADOOP-5175.Also think there is a JobCleanup task which takes care of cleaning.., AFAIK.., unless its failed job. Cheers, /R
On 1/27/10 12:01 AM, "Bill Graham" <[email protected]> wrote: Hi, Every time I run a Pig script I get a number of Job jars left in the /tmp directory of my client, 1 per MR job it seems. The file names look like /tmp/Job875278192.jar. I have scripts that run every five minutes and fire 10 MR jobs each, so the amount of space used by these jars grows rapidly. Is there a way to tell Pig to clean up after itself and remove these jars, or do I need to just write my own clean-up script? thanks, Bill
