Hi Olga, We have been observing this problem with latest (0.6.0 release) where pig is unable to get the job-id of the current M/R job it spawns. There is reproducible test case but the problem is frequent enough to cause worries. I'd like to get your opinion on opening a new Pig JIRA for this or reopening PIG-948. Please advise.
Regards -...@nkur On 12/12/09 8:21 AM, "Ganesan Srinivasan" <gane...@yahoo-inc.com> wrote: Hi Ankur, I tried the latest version (pig-0.6.0.0.20.1.0911122100), and I don't see job id. I see a message "Cannot get jobid for this job"... 2009-12-12 02:40:42,245 [Thread-10] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 2009-12-12 02:40:42,762 [Thread-10] INFO org.apache.hadoop.zebra.pig.TableLoader - Total input tables to process : 1 2009-12-12 02:40:43,242 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Cannot get jobid for this job 2009-12-12 02:40:49,263 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete 2009-12-12 02:43:20,813 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 25% complete Please let me know how can I get it. Thanks Ganesan. ________________________________ From: Ankur C. Goel [mailto:gan...@yahoo-inc.com] Sent: Wednesday, November 04, 2009 3:32 AM To: pig-usergr...@yahoo-inc.com; Safique Mohamed Subject: Re: [pig-usergroup] Getting JobId from pig logs With the fix for https://issues.apache.org/jira/browse/PIG-948 being available in the latest pig release, it should be available in the pig logs. The latest pig release has been deployed to all the clusters except M45. To use the latest release run with -latest option. -...@nkur On 11/4/09 4:51 PM, "Safique Mohamed" <safiq...@yahoo-inc.com> wrote: Hi all, Is there some way of getting the jobId from the pig logs; it would be useful to look into the jobtracker history logs (using jobId) at a later stage. Thanks, With Regards, Safique | YSM Panama - Minerva (IR DataPlatform). [Yahoo! SDC India, Embassy Golf Links Business Park, Koramangala, Bangalore-560071]. Tel: +91-97390-62985. Email: safiq...@yahoo-inc.com <mailto:safiq...@yahoo-inc.com>