You can also use ambrose to monitor execution of your pig script at runtime. Remark: from pig-0.11 on.
It show you the DAG of MR jobs and which are currently being executed. As long as pig-ambrose is connected to the execution of your script (workflow) you can replay the workflow. -- kind regards, Geert On 15-okt.-2013, at 14:43, Shahab Yunus <shahab.yu...@gmail.com> wrote: > Have you tried using ILLUSTRATE and EXPLAIN command? As far as I know, I > don't think they give you the exact number as it depends on the actual data > but I believe you can interpret it/extrapolate it from the information > provided by these commands. > > Regards, > Shahab > > > On Tue, Oct 15, 2013 at 3:57 AM, ey-chih chow <eyc...@gmail.com> wrote: > >> Hi, >> >> I have a Pig script that has two group-by statements on the the input data >> set. Is there anybody knows how many M-R jobs the script will generate? >> Thanks. >> >> Best regards, >> >> Ey-Chih Chow >>
