please find the attached master & slave hbase logs.
> On Thu, Sep 20, 2012 at 5:14 PM, Monish r <[email protected]> wrote:
>
>> Hi,
>> From the *jps* status i can see that u have started region server in both
>> the servers
>>
>> *NameNode:*
>> 11578 HMaster
>> 11476 HQuorumPeer
>> 10921 TaskTracker
>> 10246 NameNode
>> 12430 Main
>> 10746 JobTracker
>> 12538 Jps
>> 11798 *HRegionServer*
>> 10618 SecondaryNameNode
>> 10433 DataNode
>>
>> *DataNode:*
>> 2202 NC
>> 10772 Jps
>> 10495 TaskTracker
>> 2112 -- process information unavailable
>> 10697 *HRegionServer*
>> 10331 DataNode
>>
>> From the log i can see that hbase master has only one region server in its
>> list and it is not access able.
>>
>> 2012-09-18 23:59:13,841 DEBUG
>> org.apache.hadoop.hbase.master.AssignmentManager: No previous
>> transition plan was found (or we are ignoring an existing plan) for
>> -ROOT-,,0.70236052 so generated a random one; hri=-ROOT-,,0.70236052,
>> src=, dest=localhost,60020,1347968702214; 1 *(online=1, exclude=0)
>> available servers *
>>
>> 2012-09-18 23:59:13,841 INFO org.apache.hadoop.ipc.HBaseRPC: Server at
>> *localhost/127.0.0.1:60020 could not be reached after 1 tries, giving
>> up.*
>>
>>
>> The problem may be with u r cluster set up , check the region server logs
>> and see if they are alive , u cannot rely on jps
>> and tell for sure the process is up , since it can go down after u r look
>> up.
>>
>> Check u r region server logs , if u still have issues , post the region
>> server logs in paste bin and reply.
>>
>> Regards,
>> R.Monish
>>
>>
>> *
>> *
>>
>>
>>
>> On Thu, Sep 20, 2012 at 10:03 AM, Venkateswara Rao Dokku <
>> [email protected]> wrote:
>>
>> >
>> >
>> > On Tue, Sep 18, 2012 at 10:43 PM, Jean-Daniel Cryans <
>> [email protected]>wrote:
>> >
>> >> What's in the master's log?
>> >>
>> >> J-D
>> >> Please find the attached master logs.
>> >>
>> >> On Tue, Sep 18, 2012 at 3:41 AM, Venkateswara Rao Dokku
>> >> <[email protected]> wrote:
>> >> > Hi,
>> >> > I am new to Hbase & I wanted to Cluster Hbase on 2 nodes. I put
>> >> one
>> >> > of my nodes as hadoop-namenodeas well as hbase-master & the other
>> node
>> >> as
>> >> > hadoop-datanode1 as well as hbase-region-server1. I started hadoop
>> >> cluster
>> >> > as well as Hbase on the name-node side. They started fine. But when I
>> >> try
>> >> > to create tabes in Hbase shell I got the following error.
>> >> >
>> >> > hbase(main):001:0> create 't1','f1'
>> >> >
>> >> > ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7
>> >> times
>> >> >
>> >> > Here is some help for this command:
>> >> > Create table; pass table name, a dictionary of specifications per
>> >> > column family, and optionally a dictionary of table configuration.
>> >> > Dictionaries are described below in the GENERAL NOTES section.
>> >> > Examples:
>> >> >
>> >> > hbase> create 't1', {NAME => 'f1', VERSIONS => 5}
>> >> > hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'}
>> >> > hbase> # The above in shorthand would be the following:
>> >> > hbase> create 't1', 'f1', 'f2', 'f3'
>> >> > hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000,
>> >> > BLOCKCACHE => true}
>> >> > hbase> create 't1', 'f1', {SPLITS => ['10', '20', '30', '40']}
>> >> > hbase> create 't1', 'f1', {SPLITS_FILE => 'splits.txt'}
>> >> >
>> >> > But I could see HMaster running with Jps. The below given are the
>> >> processes
>> >> > running on the name-node & datanode.
>> >> > *NameNode:*
>> >> > *
>> >> > *
>> >> > 11578 HMaster
>> >> > 11476 HQuorumPeer
>> >> > 10921 TaskTracker
>> >> > 10246 NameNode
>> >> > 12430 Main
>> >> > 10746 JobTracker
>> >> > 12538 Jps
>> >> > 11798 HRegionServer
>> >> > 10618 SecondaryNameNode
>> >> > 10433 DataNode
>> >> >
>> >> > *DataNode:*
>> >> > *
>> >> > *
>> >> > 2202 NC
>> >> > 10772 Jps
>> >> > 10495 TaskTracker
>> >> > 2112 -- process information unavailable
>> >> > 10697 HRegionServer
>> >> > 10331 DataNode
>> >> >
>> >> > Could You please let me know whats wrong with my approach of creating
>> >> > tables. Thanks for replying
>> >> >
>> >> > P.S: forgot to mention I am using hadoop-0.20.2 & hbase-0.92.1
>> >> versions. So
>> >> > to avoid version mismatches I copied the hadoop Jar file in hadoop
>> >> > installation directory into habse/lib/ in all the cluster nodes.
>> >> >
>> >> >
>> >> > --
>> >> > Thanks & Regards,
>> >> >
>> >> > Venkateswara Rao Dokku
>> >>
>> >
>> >
>> >
>> > --
>> > Thanks & Regards,
>> > Venkateswara Rao Dokku,
>> > Software Engineer,One Convergence Devices Pvt Ltd.,
>> > Jubille Hills,Hyderabad.
>> >
>> >
>>
>
>
>
> --
> Thanks & Regards,
> Venkateswara Rao Dokku,
> Software Engineer,One Convergence Devices Pvt Ltd.,
> Jubille Hills,Hyderabad.
>
>
--
Thanks & Regards,
Venkateswara Rao Dokku,
Software Engineer,One Convergence Devices Pvt Ltd.,
Jubille Hills,Hyderabad.
2012-09-18 23:59:03,840 WARN org.apache.hadoop.hbase.master.AssignmentManager:
Unable to find a viable location to assign region -ROOT-,,0.70236052
2012-09-18 23:59:13,837 INFO org.apache.hadoop.hbase.master.AssignmentManager:
Regions in transition timed out: -ROOT-,,0.70236052 state=OFFLINE,
ts=1348037943840, server=null
2012-09-18 23:59:13,837 INFO org.apache.hadoop.hbase.master.AssignmentManager:
Region has been OFFLINE for too long, reassigning -ROOT-,,0.70236052 to a
random server
2012-09-18 23:59:13,838 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x139d9320d400000 Creating (or updating) unassigned node for
70236052 with OFFLINE state
2012-09-18 23:59:13,841 DEBUG org.apache.hadoop.hbase.master.AssignmentManager:
Found an existing plan for -ROOT-,,0.70236052 destination server is
localhost,60020,1347968702214
2012-09-18 23:59:13,841 DEBUG org.apache.hadoop.hbase.master.AssignmentManager:
No previous transition plan was found (or we are ignoring an existing plan) for
-ROOT-,,0.70236052 so generated a random one; hri=-ROOT-,,0.70236052, src=,
dest=localhost,60020,1347968702214; 1 (online=1, exclude=0) available servers
2012-09-18 23:59:13,841 DEBUG org.apache.hadoop.hbase.master.AssignmentManager:
Assigning region -ROOT-,,0.70236052 to localhost,60020,1347968702214
2012-09-18 23:59:13,841 DEBUG org.apache.hadoop.hbase.master.ServerManager: New
connection to localhost,60020,1347968702214
2012-09-18 23:59:13,841 DEBUG org.apache.hadoop.hbase.master.AssignmentManager:
Handling transition=M_ZK_REGION_OFFLINE,
server=oc-PowerEdge-R610,60000,1347968700983, region=70236052/-ROOT-
2012-09-18 23:59:13,841 INFO org.apache.hadoop.ipc.HBaseRPC: Server at
localhost/127.0.0.1:60020 could not be reached after 1 tries, giving up.
2012-09-18 23:59:13,841 WARN org.apache.hadoop.hbase.master.AssignmentManager:
Failed assignment of -ROOT-,,0.70236052 to localhost,60020,1347968702214,
trying to assign elsewhere instead; retry=0
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed setting up
proxy interface org.apache.hadoop.hbase.ipc.HRegionInterface to
localhost/127.0.0.1:60020 after attempts=1
at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:242)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1278)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1235)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1222)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1235)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1222)
at
org.apache.hadoop.hbase.master.ServerManager.getServerConnection(ServerManager.java:496)
at
org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:429)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1592)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1329)
at
org.apache.hadoop.hbase.master.AssignCallable.call(AssignCallable.java:44)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
at
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupConnection(HBaseClient.java:328)
at
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:362)
at
org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1045)
at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:897)
at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
at $Proxy10.getProtocolVersion(Unknown Source)
at
org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:183)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:303)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:280)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:332)
at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:236)
... 13 more
2012-09-20 17:18:39,966 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Attempting connect to
Master server at oc-PowerEdge-R610,60000,1348136566220
2012-09-20 17:18:39,966 WARN
org.apache.hadoop.hbase.regionserver.HRegionServer: Unable to connect to
master. Retrying. Error was:
java.net.UnknownHostException: unknown host: oc-PowerEdge-R610
at
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.<init>(HBaseClient.java:227)
at
org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1035)
at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:897)
at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
at $Proxy7.getProtocolVersion(Unknown Source)
at
org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:183)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:303)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:280)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:332)
at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:236)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.getMaster(HRegionServer.java:1643)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegionServer.java:1680)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:643)
at java.lang.Thread.run(Thread.java:662)
