Are there any example's around this which could prove useful for understanding this?
Thanks, Chaitanya On Fri, Apr 22, 2011 at 1:52 PM, Dmitriy Ryaboy <[email protected]> wrote: > I may be misunderstanding what you are asking. The tricky part is measuring > MR time *without* wait time, which one cannot control (it depends mostly on > the size and utilization level of your cluster). This tricky bit is what > PigStats helps you with. > If you just want to measure the full time, including wait time, you can > just > time the process like you would time anything else. Use the "time" unix > command, or if you are in Java, use System.currentTimeMillis() before you > start executing and again when the procedure returns. > > On Thu, Apr 21, 2011 at 10:18 PM, sumit ghosh <[email protected]> wrote: > > > Hi, > > > > How to get the actual time spent in doing all the map-reduce operations > > while > > executing a pig script. It should exclude the time wait for the scheduler > - > > and > > any other waiting time. Please help. > > > > Another question is - how to use the function getDuration() in: > > > > > http://pig.apache.org/docs/r0.8.0/api/org/apache/pig/tools/pigstats/PigStats.html > > > > Can you please help me with the Pig Statements. > > > > Thanks, > > Sumit > > >
