Hi, I use HPROF to profile my mapreduce / MR2 jobs and I am looking for a way to automatically download the "profile.out" files created by the profiled tasks. I intend to do it from the driver once the job is finished so a Java API is welcome but I am also fine using one of the REST APIs.
LogCLIHelpers shown me how it can be done, but it seems a bit convoluted and relies on private API. REST APIs have logsLink entries. However the link points to web page making it difficult to get the file. Any idea or code sample ? I would also be interested by a command line tool allowing to do the same thing (without having to parse "yarn logs") Thanks. Clément MATHIEU
