I will have a look at Vaidya. Thank you.
Am 10.04.2011 18:50, schrieb Sean Owen:
I think it sounds like a great project.
I believe that one of the biggest barriers to improving performance is
simply understanding where the time is being spent. Is it I/O or CPU? is it
the combiner steps, shuffle? mapper, reducer?
What you are suggesting, and what I am sort of thinking of, sounds a lot
like what Apache Vaidya is doing (
http://hadoop.apache.org/common/docs/r0.20.2/vaidya.html). This is a great
project and perhaps something to build on.
It would be great to see the output of such a tool. I'm sure that it would
discover some clear, easy bottlenecks.
On Sun, Apr 10, 2011 at 4:19 PM, Oliver Fischer<[email protected]>wrote:
--
Oliver B. Fischer, Schönhauser Allee 64, 10437 Berlin
Certified ScrumMaster, OMG Certified Expert in BPM - Fundamental
Tel. +49 30 44793251, Mobil: +49 178 7903538
Mail: [email protected]
Blog: http://logbuch.freiheitsgrade-se.de