If your process is not inherently designed for concurrency with multiple logical components as different threads of execution, dispatchable to multiple cores in parallel, you cannot make it mufti-core aware by splitting it as different threads. (if these threads are sequential by nature, you get the same compute latency )
If your process is computation intensive, you can try using intel CMP-compilers, or if it is IO intensive, there is nothing much you can do unless its a NUMA system or (any asymmetric cluster, where you can leverage node-locality benefits). I am just curious to know what process is this, that takes 1-2 weeks to execute, in CPUs. currently available in the market.. thanks On Wed, May 20, 2009 at 4:52 PM, sree deepya <mdee...@gmail.com> wrote: > Hi, > I have a small doubt regarding possibility of multiprocessing in > hadoop.Is it possible ???? > To be more clear,I have some processes that take around a week or two to > execute.Is it possible to use hadoop to > reduce this execution time by dividing these processes into a number of > processes and executing simultaneously on > different nodes???Or is there any other way in which my objective can be > achieved using hadoop???? > > If yes, Can you please throw some light on this issue???? > > Thanks in advance, > > regards, > SreeDeepya. >
