Re: In search of a bug around splitting

2011-08-19 Thread bijieshan
One query about the rollback: If the journal contains the entry of PONR, it returns directly. The regionserver should abort if rollback returns false. Right? Jieshan - On Fri, Aug 19, 2011 at 12:05 AM, Joseph Pallas

Not Starting Hmaster bacause of Permission denied

2011-08-19 Thread Zhong, Andy
Hi All, I am facing an issue to start Hmaster bacause of Permission denied, although two region servers seem start properly. I will be much appreciated if any one could help me to figure out the root cause. I have hadoop running under 'hadoop' user, and Hbase running under 'hbase' user. Thanks, -

Re: Not Starting Hmaster bacause of Permission denied

2011-08-19 Thread Sonal Goyal
Hi Andy, I guess you are using dfs security, in which case your hbase user does not have the permission to create the top level directory /hbase in the dfs. Can you try the following and then start your master? Let us know how it goes. bin/hadoop fs -mkdir /hbase bin/hadoop fs -chown hbase

RE: Not Starting Hmaster bacause of Permission denied

2011-08-19 Thread Zhong, Andy
Sonal, Humm... Thanks for your reply! But not aware of dfs security is being used here (Hadoop0.20.2 + Hbase 0.20.3). Is this the top level directory related to the following the hbase rootdir, and are you suggest to create the following? bin/hadoop fs -mkdir /activity/hbase bin/hadoop fs -chown

Re: In search of a bug around splitting

2011-08-19 Thread Stack
On Fri, Aug 19, 2011 at 6:56 AM, bijieshan bijies...@huawei.com wrote: One query about the rollback: If the journal contains the entry of PONR, it returns directly. The regionserver should abort if rollback returns false. Right? Yes. St.Ack

Re: Not Starting Hmaster bacause of Permission denied

2011-08-19 Thread Sonal Goyal
Hi Andy, We run HBase under the same user, so unfortunately I havent seen your issue. But the hbase user definitely needs to own the hbase.rootdir, to be able to write to it. Do your hbase and hadoop users belong to the same group and is the activity dfs folder permissions set correctly for hbase

confirmed procedure for repairing hole in hbase metadata

2011-08-19 Thread Geoff Hendrey
Stack, Thanks again for providing us this procedure. We had 5 holes in a big multi-terabyte table. We were able to repair them all and get back to work. Regarding your question of what caused the holes in the first place: we have no idea, unfortunately. Our load is read, write, and update and

RE: Query regarding HTable.get and timeouts

2011-08-19 Thread Srikanth P. Shreenivas
I did some tests today. In our QA setup, we dont see any issues. I ran more than 100,000 operations in our QA setup in 1 hour with all HBase reads/writes working as expected. However, in our production setup, I regularly see the issue wherein client thread gets interrupted because

Reverse timestamp

2011-08-19 Thread Mark
I understand the need but I don't understand how to generate a reverse timestamp. Can someone please explain how this is accomplished and how I can test that its working correctly? Thanks

Thrift clients

2011-08-19 Thread Mark
I've noticed that the thrift server can be run in buffered or framed transport. Can someone explain the differences and why one may choose one of the other? I see that the framed has a -nonblocking option... does this mean requests are asynchronous? Thanks for your help

Re: Reverse timestamp

2011-08-19 Thread lars hofhansl
HBase maps (row-key, column family name, column, timestamp) to a value. The KeyValues are also sorted by the same attributes in reverse timestamp order. The default timestamp is the current time, but you can set any long value (which does not need correlate in any way to the time domain) as the

Re: Avatar namenode?

2011-08-19 Thread lars hofhansl
I was thinking the same. In an ideal world, I guess, the namenodes would be quorum based. Clients would be aware of all the namenodes and fire updates in parallel to all namenodes, and updates not return until N namenodes confirmed the update. To make it easier one could initially require that