Re: Monitoring single-run job statistics

2016-01-06 Thread Filip Łęczycki
entioned stats (cpu time, >> mem time, gc time) for a single job ran on long running Flink cluster? >> >> I will be very grateful for an answer:) >> >> Best regards, >> Filip >> >> Pozdrawiam, >> Filip Łęczycki >> >> 2016-01-04 10:05 GMT+01

Re: Monitoring single-run job statistics

2016-01-04 Thread Filip Łęczycki
2016-01-04 10:05 GMT+01:00 Till Rohrmann <till.rohrm...@gmail.com>: > Hi Filip, > > at the moment it is not possible to retrieve the job statistics after the > job has finished with flink run -m yarn-cluster. The reason is that the > YARN cluster is only alive as long as the job

Monitoring single-run job statistics

2016-01-01 Thread Filip Łęczycki
Hi all, I am running filnk aps on YARN cluster and I am trying to get some benchmarks. When I start a long-running flink cluster on my YARN cluster I have an access to web UI and rest API that provide me statistics of the deployed jobs (as desribed here:

Re: Job Statistics

2015-06-18 Thread Maximilian Michels
On Thu, Jun 18, 2015 at 3:41 PM, Jean Bez jeanluca...@gmail.com wrote: Hi Fabian, I am trying to compare some examples on Hadoop, Spark and Flink. If possible I would like to see the job statistics like the report given by Hadoop. Since I am running these examples on a large cluster it would

Re: Job Statistics

2015-06-18 Thread Jean Bez
Hi Fabian, I am trying to compare some examples on Hadoop, Spark and Flink. If possible I would like to see the job statistics like the report given by Hadoop. Since I am running these examples on a large cluster it would be much better if I could obtain such data directly from the console

Re: Job Statistics

2015-06-18 Thread Jean Bez
wrote: Hi Fabian, I am trying to compare some examples on Hadoop, Spark and Flink. If possible I would like to see the job statistics like the report given by Hadoop. Since I am running these examples on a large cluster it would be much better if I could obtain such data directly from

Re: Job Statistics

2015-06-18 Thread Jean Bez
the job statistics like the report given by Hadoop. Since I am running these examples on a large cluster it would be much better if I could obtain such data directly from the console. Thanks! Jean Em 18/06/2015 04:55, Fabian Hueske fhue...@gmail.com escreveu: Hi Jean, what kind of job execution

Re: Job Statistics

2015-06-18 Thread Jean Bez
and printing those would be easy. What metrics in particular are you looking for? Best, Max On Thu, Jun 18, 2015 at 3:41 PM, Jean Bez jeanluca...@gmail.com wrote: Hi Fabian, I am trying to compare some examples on Hadoop, Spark and Flink. If possible I would like to see the job statistics like

Re: Job Statistics

2015-06-18 Thread Stephan Ewen
jeanluca...@gmail.com wrote: Hi Fabian, I am trying to compare some examples on Hadoop, Spark and Flink. If possible I would like to see the job statistics like the report given by Hadoop. Since I am running these examples on a large cluster it would be much better if I could obtain

Re: Job Statistics

2015-06-18 Thread Matthias J. Sax
Hi, the CLI cannot show any job statistics. However, you can use the JobManager web interface that is accessible at port 8081 from a browser. -Matthias On 06/17/2015 10:13 PM, Jean Bez wrote: Hello, Is it possible to view job statistics after it finished to execute directly in the command

Re: Job Statistics

2015-06-18 Thread Fabian Hueske
Hi Jean, what kind of job execution stats are you interested in? Cheers, Fabian 2015-06-18 9:01 GMT+02:00 Matthias J. Sax mj...@informatik.hu-berlin.de: Hi, the CLI cannot show any job statistics. However, you can use the JobManager web interface that is accessible at port 8081 from

Job Statistics

2015-06-17 Thread Jean Bez
Hello, Is it possible to view job statistics after it finished to execute directly in the command line? If so, could you please explain how? I could not find any mentions about this in the docs. I also tried to set the logs to debug mode, but no other information was presented. Thank you