Hi,
Can anyone help please? How stable is Hbase when inserting data? I have seen a few emails regarding issues with this. The reason I ask is that we have built a 12 data-node cluster, with region servers, zoo keeper etc.. When we add a few million rows via the Java APIs, the system periodically fails. Regions go-off line, performance slows down dramatically from 1000 inserts per second to under 200 per second. It just has a generally feeling of instability. We have rebuilt the system several times. We have changed the write-buffer sizes, added more memory, added periodical flushing of the tables etc.. The network seems to be performing fine as are the hard-drives etc.. We are using Hbase 0.89.20100924+28, r Is the only way to upload (say 1,000,000 rows) via map reduce? Or should we be able to just 'put' new records without the system failing apart? We have been trying to build a working system that we can insert records reliably but to no avail. Any advice would be appreciated. Regards Stuart Stuart Scott System Architect emis intellectual technology Fulford Grange, Micklefield Lane Rawdon Leeds LS19 6BA E-mail: [email protected] <mailto:[email protected]> Website: www.emisit.com <outbind://26/www.emisit.com> Privileged and/or Confidential information may be contained in this message. If you are not the original addressee indicated in this message (or responsible for delivery of the message to such person), you may not copy or deliver this message to anyone. In such case, please delete this message, and notify us immediately. Opinions, conclusions and other information expressed in this message are not given or endorsed by EMIS nor can I conclude contracts on its behalf unless otherwise indicated by an authorised representative independently of this message. EMIS reserves the right to monitor, intercept and (where appropriate) read all incoming and outgoing communications. By replying to this message and where necessary you are taken as being aware of and giving consent to such monitoring, interception and reading. EMIS is a trading name of Egton Medical Information Systems Limited. Registered in England. No 2117205. Registered Office: Fulford Grange, Micklefield Lane, Rawdon, Leeds, LS19 6BA
