Derek Pappas wrote:
No. See attached program. It parses the arc files and writes the html
records to hbase.
5 data nodes and 3 regions.
I don't believe this list allows attachments (Program did not come
across). Put it up in pastebin?
Single threaded.
How many instances do you have running? One only?
Tell us what you are seeing in your logs so we can help. Make sure
you have DEBUG enabled (see earlier in the FAQ that J-D pointed you
at for how).
Errors posted below, datanodes complaining of blocks, as J-D
indicates, should be addressed mostly by the troubleshooting section
he pointed you to. You might also check datanode logs for errors.
Could help give us a clue why the failures.
Meantime, how many regions when it fails? Tell us about your schema
and your hardware.
Dell 850's. Super Micro core duo's and a quad core.
5 data nodes 3 regions
Add your configuration to pastebin too. Whats your schema like? How
many column families?
Anything else running on these systems? They should be well able (How
much RAM -- are you swapping?).
Enable DEBUG and paste exceptions from regionserver logs including the
lines that lead up to the exception.
Check your datanode logs too.
St.Ack