On Fri, Apr 8, 2011 at 2:40 PM, Debayan Banerjee <[email protected]> wrote: > On 8 April 2011 14:36, Narendra Sisodiya <[email protected]> > wrote: >> I am working on Live Network Data, >> The Problem is the network speed is very high , 1GBps data link, >> I have 48 GB RAM and 24 Core of CPU on system... >>= > > > Forget about shell scripts. What you need for analysing network > traffic at this rate is MapReduce frameworks like Hadoop or Disco. > This will allow you to fully utilise your processor cores and RAM. > Setting up Haddop or Disco is well documented on respective web pages.
What these framework do exactly ?? is it something like if one command is taking 10 second then using 10 parallel PC , we can execute same command in 1 second ?? something like this ? -- LUG@IITD - http://lug-iitd.org/Footer
