Whoops, didn't realize what mailing list I was on! Your scalding logs should have the start and end times, and it should also print links to the Hadoop UI which will show you he runtime and stats about each step. Dr scalding is something we have internally but all the info you need should be in your logs already.
Thanks, Alex On Friday, August 19, 2016, Alex Levenson <[email protected]> wrote: > This is actually already logged in your scalding logs. > You can get s better viz by opening up the dr scalding link in your logs > as well. It'll show you the runtime and many other stats about your jobs. > > On Friday, August 19, 2016, <[email protected] > <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >> Hi, >> >> I have a scalding workflow, it has a lot of steps(pipes). I want to check >> that how much time each step is taking. For this, I want to log the >> timestamp when the step starts to execute and when it finishes execution. >> Could you please tell me that how to do this. I am new to scalding. If >> possible, can you show me some example as well. >> >> Regards, >> Abhishek >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Scalding Development" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> For more options, visit https://groups.google.com/d/optout. >> > > > -- > Sent from my phone > -- Sent from my phone -- You received this message because you are subscribed to the Google Groups "Scalding Development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
