Hi - that depends on your expected dataset. You can easily do 4 million records on a small 2 core CPU with 512MB RAM with Nutch 1.x and still have decent performance when updating the DB. We've also loaded 40 billion records but that won't work well on a 80 CPU cores and 80 GB RAM cluster.
-----Original message----- > From:Ralf R. Kotowski <[email protected]> > Sent: Monday 30th September 2013 0:11 > To: [email protected] > Subject: Nutch, Hbase, hardware requirements per node? > > Hi, > > > > What would be some good hardware requirements per node to look for in a > hosting company to set-up a multimode Nutch/Hbase cluster? > > > > I've seen peeps posting some impressive numbers with a 20 node set-up! > > > > Thnx! > > > > RRK > >
