I don't think this result holds in general -- they chose a very CPU intensive problem, without much data movement. This won't work for, say, Mahout jobs. I don't really see the point in porting Hadoop to a GPU. If you're in a GPU you don't need most of what Hadoop does! That is I imagine this is faster if you just wrote a straight CUDA app.
On Tue, Jul 10, 2012 at 11:51 AM, mohsen jadidi <[email protected]> wrote: > to add some note: > > This paper demonstrated that a version of Hadoop MapReduce when “ported” to > a small 4-node GPU cluster could outperform a regular Hadoop 62 node CPU > cluster and achieved a 508x speed-up per cluster node when performing Black > Scholes option pricing. It should be noted that Black Scholes algorithm is > an analytical algorithm. The GPU cluster configuration comprised 5 nodes > each comprising a quad-core CPU with two 9800 GX2 GPUs, each with 128 core > processors, connected to a Gigabit Ethernet router and one control node > also connected to the Gigabit Ethernet router. >
