Please find the below conf files from both the hadoop and hbase conf.
core-site.xml
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/rtit/hadoop/tmp</value>
</property>
<property>
<name>fs.default.name</name>
<value>hdfs://192.265.47.222:9000</value>
</property>
</configuration>
hdfs-site.xml
<configuration>
<property>
<name>dfs.name.dir</name>
<value>/home/rtit/hadoop/hdfs-data-name</value>
</property>
<property>
<name>dfs.data.dir</name>
<value>/home/rtit/hadoop/hdfs-data</value>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
hbase-site.xml
<configuration>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>hdfs://192.265.47.222:9000/hbase</value>
</property>
<property>
<name>hbase.zookeeper.property.clientPort</name>
<value>2181</value>
<description>Property from ZooKeeper's config zoo.cfg.
The port at which the clients will connect.
</description>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>192.265.47.222</value>
<description>Comma separated list of servers in the ZooKeeper Quorum.
For example, "host1.mydomain.com,host2.mydomain.com,host3.mydomain.com
".
By default this is set to localhost for local and pseudo-distributed
modes
of operation. For a fully-distributed setup, this should be set to a
full
list of ZooKeeper quorum servers. If HBASE_MANAGES_ZK is set in
hbase-env.sh
this is the list of servers which we will start/stop ZooKeeper on.
</description>
</property>
</configuration>
I did not get where is the port 60030 and 60010 will come.
Please find the netstat result below
[rtit@localhost conf]$ netstat -alnp | grep 900
(Not all processes could be identified, non-owned process info
will not be shown, you would have to be root to see it all.)
tcp 0 0 ::ffff:192.265.47.222:9000 :::*
LISTEN 15680/java
tcp 0 0 ::ffff:127.0.0.1:9001 :::*
LISTEN 16047/java
tcp 0 0 ::ffff:192.265.47.222:46092 ::ffff:192.265.47.222:9000
TIME_WAIT -
tcp 0 0 ::ffff:192.265.47.222:39922 ::ffff:192.265.47.222:9000
ESTABLISHED 15821/java
tcp 0 0 ::ffff:127.0.0.1:9001 ::ffff:127.0.0.1:33317
ESTABLISHED 16047/java
tcp 0 0 ::ffff:192.265.47.222:9000 ::ffff:192.265.47.222:39922
ESTABLISHED 15680/java
tcp 0 0 ::ffff:192.265.47.222:46084 ::ffff:192.265.47.222:9000
TIME_WAIT -
tcp 0 0 ::ffff:192.265.47.222:46089 ::ffff:192.265.47.222:9000
TIME_WAIT -
tcp 0 0 ::ffff:127.0.0.1:33317 ::ffff:127.0.0.1:9001
ESTABLISHED 16179/java
tcp 0 0 ::ffff:192.265.47.222:9000 ::ffff:192.265.47.222:46101
ESTABLISHED 15680/java
tcp 0 0 ::ffff:192.265.47.222:46101 ::ffff:192.265.47.222:9000
ESTABLISHED 22842/java
[rtit@localhost conf]$ netstat -alnp | grep 600
(Not all processes could be identified, non-owned process info
will not be shown, you would have to be root to see it all.)
tcp 0 0 :::60010 :::*
LISTEN 22642/java
tcp 0 0 ::ffff:127.0.0.1:60020 :::*
LISTEN 22842/java
tcp 0 0 :::60030 :::*
LISTEN 22842/java
tcp 0 0 ::ffff:127.0.0.1:60000 :::*
LISTEN 22642/java
tcp 0 0 ::ffff:192.265.47.222:60010 ::ffff:192.265.47.216:49870
ESTABLISHED 22642/java
tcp 0 0 ::ffff:192.265.47.222:2181 ::ffff:192.265.47.222:60094
ESTABLISHED 22572/java
tcp 0 0 ::ffff:127.0.0.1:48637 ::ffff:127.0.0.1:60000
ESTABLISHED 22842/java
tcp 0 0 ::ffff:192.265.47.222:2181 ::ffff:192.265.47.222:60098
ESTABLISHED 22572/java
tcp 0 0 ::ffff:192.265.47.222:60098 ::ffff:192.265.47.222:2181
ESTABLISHED 22642/java
tcp 0 0 ::ffff:192.265.47.222:60094 ::ffff:192.265.47.222:2181
ESTABLISHED 22842/java
tcp 0 0 ::ffff:127.0.0.1:62954 ::ffff:127.0.0.1:60020
TIME_WAIT -
tcp 0 0 ::ffff:127.0.0.1:60000 ::ffff:127.0.0.1:48637
ESTABLISHED 22642/java
tcp 0 0 ::ffff:192.265.47.222:60089 ::ffff:192.265.47.222:2181
ESTABLISHED 22642/java
tcp 0 0 ::ffff:192.265.47.222:2181 ::ffff:192.265.47.222:60089
ESTABLISHED 22572/java
telnet is working for 60010, 60030 and 9000 from both the local and remote
boxes.
I did not get the "netstat as sudo". Do I need to run netstat from root
user?
I do not have sudo user, but I have the root user credentials. so I can run
the netstat form root.
Thank You,
Jilani
On Thu, Aug 30, 2012 at 11:51 PM, anil gupta <anilgupt...@gmail.com> wrote:
> Can you also try to run telnet and netstat for port: 60030 and 60010 ? I
> dont see post 60030 and 60010 in the output of netstat. Did you configured
> some other ports for HBase Master?
>
> 2181 is the port of zookeeper.
>
>
> On Thu, Aug 30, 2012 at 8:45 AM, Jilani Shaik <jilani2...@gmail.com>
> wrote:
>
> > Hi Anil,
> >
> > Please see the below commands which I executed and respective outputs.
> >
> > on HBase and Hadoop box
> >
> > [rtit@localhost conf]$ netstat -alnp | grep 2181
> > (Not all processes could be identified, non-owned process info
> > will not be shown, you would have to be root to see it all.)
> > tcp 0 0 :::2181 :::*
> > LISTEN 22572/java
> > tcp 0 0 ::ffff:192.265.47.222:2181
> ::ffff:192.265.47.222:60094
> > ESTABLISHED 22572/java
> > tcp 0 0 ::ffff:192.265.47.222:2181
> ::ffff:192.265.47.222:60117
> > ESTABLISHED 22572/java
> > tcp 0 0 ::ffff:192.265.47.222:2181
> ::ffff:192.265.47.222:60098
> > ESTABLISHED 22572/java
> > tcp 0 0 ::ffff:192.265.47.222:60098
> ::ffff:192.265.47.222:2181
> > ESTABLISHED 22642/java
> > tcp 0 0 ::ffff:192.265.47.222:60094
> ::ffff:192.265.47.222:2181
> > ESTABLISHED 22842/java
> > tcp 0 0 ::ffff:192.265.47.222:60117
> ::ffff:192.265.47.222:2181
> > ESTABLISHED 22842/java
> > tcp 0 0 ::ffff:192.265.47.222:60089
> ::ffff:192.265.47.222:2181
> > ESTABLISHED 22642/java
> > tcp 0 0 ::ffff:192.265.47.222:2181
> ::ffff:192.265.47.222:60089
> > ESTABLISHED 22572/java
> >
> >
> > [rtit@localhost conf]$ telnet localhost 2181
> > Trying 127.0.0.1...
> > Connected to localhost.
> > Escape character is '^]'.
> >
> >
> > Connection closed by foreign host.
> > [rtit@localhost conf]$
> >
> >
> > [rtit@localhost conf]$ telnet 192.265.47.222 2181
> > Trying 192.265.47.222...
> > Connected to 192.265.47.222.
> > Escape character is '^]'.
> >
> >
> > Connection closed by foreign host.
> > [rtit@localhost conf]$
> >
> >
> >
> > --> From the remote box
> > [rtit@RTIT-1 hbasedemos]$ telnet 192.265.47.222 2181
> > Trying 192.265.47.222...
> > Connected to 192.265.47.222.
> > Escape character is '^]'.
> >
> >
> > Connection closed by foreign host.
> > [rtit@RTIT-1 hbasedemos]$
> >
> >
> >
> >
> > On Thu, Aug 30, 2012 at 8:58 PM, anil gupta <anilgupt...@gmail.com>
> wrote:
> >
> > > Then, it might be a issue with port binding. try to do telnet on the
> port
> > > to which HBase listens from localhost as well as remote machine.
> > > Also, try to run the netstat command and see the bindings of service.
> > >
> > > ~Anil
> > >
> > > On Thu, Aug 30, 2012 at 8:20 AM, Jilani Shaik <jilani2...@gmail.com>
> > > wrote:
> > >
> > > > Anil,
> > > >
> > > > Already I disabled firewall of linux using iptables service.
> > > >
> > > > Thank You,
> > > > Jilani
> > > >
> > > >
> > > > On Thu, Aug 30, 2012 at 8:35 PM, anil gupta <anilgupt...@gmail.com>
> > > wrote:
> > > >
> > > > > Hi Jilani,
> > > > >
> > > > > It seems like a firewall issue. You will need to open appropriate
> > ports
> > > > or
> > > > > disable the firewall on the machine you are running the service.
> > > > >
> > > > > HTH,
> > > > > Anil
> > > > >
> > > > > On Thu, Aug 30, 2012 at 7:46 AM, Jilani Shaik <
> jilani2...@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > I am able to connect to HBase using Java client if the client is
> on
> > > the
> > > > > > same box where Hadoop and HBase are installed. If the client is
> on
> > > > other
> > > > > > box either windows or linux, I am getting the error as below
> > > > > >
> > > > > > org.apache.zookeeper.server.NIOServerCnxn: Closed socket
> connection
> > > for
> > > > > > client
> > > > > >
> > > > > > Please suggest me how to identify and fix the issue.
> > > > > >
> > > > > > Thank You,
> > > > > > Jilani
> > > > > >
> > > > > > On Thu, Aug 30, 2012 at 7:00 PM, Jilani Shaik <
> > jilani2...@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > I have installed and configured Hadoop(hadoop-1.0.3) and
> > > > > > > HBase(hbase-0.94.1) in a single Fedora linux box, where HBase
> > > > > > > as pseudo cluster setup.
> > > > > > >
> > > > > > > I am able to connect the HBase suing shell from console and
> able
> > to
> > > > > > create
> > > > > > > and scan table. But when I tried to contact the same using java
> > > > > > application
> > > > > > > I am not able to connect the HBase.
> > > > > > >
> > > > > > > Output of "jps" as follows
> > > > > > > 16872 HRegionServer
> > > > > > > 16603 HQuorumPeer
> > > > > > > 15821 DataNode
> > > > > > > 16047 JobTracker
> > > > > > > 16667 HMaster
> > > > > > > 17984 Jps
> > > > > > > 15680 NameNode
> > > > > > > 15959 SecondaryNameNode
> > > > > > > 16179 TaskTracker
> > > > > > >
> > > > > > > The error log for zoo keeper of HBase is as follows
> > > > > > >
> > > > > > > 2012-08-30 18:44:19,231 INFO
> > > > > > > org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted
> socket
> > > > > > > connection from /192.265.47.219:58357
> > > > > > > 2012-08-30 18:44:19,232 INFO
> > > > > org.apache.zookeeper.server.ZooKeeperServer:
> > > > > > > Client attempting to establish new session at
> > /192.265.47.219:58357
> > > > > > > 2012-08-30 18:44:19,236 INFO
> > > > > org.apache.zookeeper.server.ZooKeeperServer:
> > > > > > > Established session 0x13977a18091000e with negotiated timeout
> > > 180000
> > > > > for
> > > > > > > client /192.265.47.219:58357
> > > > > > > 2012-08-30 18:45:16,245 INFO
> > > > > > > org.apache.zookeeper.server.PrepRequestProcessor: Processed
> > session
> > > > > > > termination for sessionid: 0x13977a18091000e
> > > > > > > 2012-08-30 18:45:16,252 INFO
> > > > org.apache.zookeeper.server.NIOServerCnxn:
> > > > > > > Closed socket connection for client /192.265.47.219 :58357
> which
> > > had
> > > > > > > sessionid 0x13977a18091000e
> > > > > > > 2012-08-30 18:45:16,256 INFO
> > > > > > > org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted
> socket
> > > > > > > connection from /192.265.47.219:58373
> > > > > > > 2012-08-30 18:45:16,257 INFO
> > > > > org.apache.zookeeper.server.ZooKeeperServer:
> > > > > > > Client attempting to establish new session at
> > /192.265.47.219:58373
> > > > > > > 2012-08-30 18:45:16,264 INFO
> > > > > org.apache.zookeeper.server.ZooKeeperServer:
> > > > > > > Established session 0x13977a18091000f with negotiated timeout
> > > 180000
> > > > > for
> > > > > > > client /192.265.47.219:58373
> > > > > > > 2012-08-30 18:46:21,279 INFO
> > > > > > > org.apache.zookeeper.server.PrepRequestProcessor: Processed
> > session
> > > > > > > termination for sessionid: 0x13977a18091000f
> > > > > > > 2012-08-30 18:46:21,286 INFO
> > > > org.apache.zookeeper.server.NIOServerCnxn:
> > > > > > > Closed socket connection for client /192.265.47.219:58373 which
> > had
> > > > > > > sessionid 0x13977a18091000f
> > > > > > > 2012-08-30 18:46:21,291 INFO
> > > > > > > org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted
> socket
> > > > > > > connection from /192.265.47.219:58391
> > > > > > > 2012-08-30 18:46:21,292 INFO
> > > > > org.apache.zookeeper.server.ZooKeeperServer:
> > > > > > > Client attempting to establish new session at
> > /192.265.47.219:58391
> > > > > > > 2012-08-30 18:46:21,298 INFO
> > > > > org.apache.zookeeper.server.ZooKeeperServer:
> > > > > > > Established session 0x13977a180910010 with negotiated timeout
> > > 180000
> > > > > for
> > > > > > > client /192.265.47.219:58391
> > > > > > > 2012-08-30 18:46:53,302 INFO
> > > > > > > org.apache.zookeeper.server.PrepRequestProcessor: Processed
> > session
> > > > > > > termination for sessionid: 0x13977a180910010
> > > > > > > 2012-08-30 18:46:53,309 INFO
> > > > org.apache.zookeeper.server.NIOServerCnxn:
> > > > > > > Closed socket connection for client /192.265.47.219:58391 which
> > had
> > > > > > > sessionid 0x13977a180910010
> > > > > > >
> > > > > > >
> > > > > > > Below is the exception from java program
> > > > > > >
> > > > > > > Aug 30, 2012 6:45:13 PM org.apache.zookeeper.ZooKeeper close
> > > > > > > INFO: Session: 0x13977a18091000e closed
> > > > > > > Aug 30, 2012 6:45:13 PM
> > org.apache.zookeeper.ClientCnxn$EventThread
> > > > run
> > > > > > > INFO: EventThread shut down
> > > > > > > Aug 30, 2012 6:45:13 PM org.apache.zookeeper.ZooKeeper <init>
> > > > > > > INFO: Initiating client connection, connectString=
> > > > 192.265.47.222:2181
> > > > > > > sessionTimeout=180000 watcher=hconnection
> > > > > > > Aug 30, 2012 6:45:13 PM
> > org.apache.zookeeper.ClientCnxn$SendThread
> > > > > > > startConnect
> > > > > > > INFO: Opening socket connection to server / 192.265.47.222:2181
> > > > > > > Aug 30, 2012 6:45:13 PM
> > org.apache.zookeeper.ClientCnxn$SendThread
> > > > > > > primeConnection
> > > > > > > INFO: Socket connection established to
> > > > > > 192.265.47.222/192.265.47.222:2181,
> > > > > > > initiating session
> > > > > > > Aug 30, 2012 6:45:13 PM
> > org.apache.zookeeper.ClientCnxn$SendThread
> > > > > > > onConnected
> > > > > > > INFO: Session establishment complete on server
> > > > > > > 192.265.47.222/192.265.47.222:2181, sessionid =
> > 0x13977a18091000f,
> > > > > > > negotiated timeout = 180000
> > > > > > > Aug 30, 2012 6:46:18 PM org.apache.zookeeper.ZooKeeper close
> > > > > > > INFO: Session: 0x13977a18091000f closed
> > > > > > > Aug 30, 2012 6:46:18 PM
> > org.apache.zookeeper.ClientCnxn$EventThread
> > > > run
> > > > > > > INFO: EventThread shut down
> > > > > > > Aug 30, 2012 6:46:18 PM org.apache.zookeeper.ZooKeeper <init>
> > > > > > > INFO: Initiating client connection,
> > > connectString=192.265.47.222:2181
> > > > > > > sessionTimeout=180000 watcher=hconnection
> > > > > > > Aug 30, 2012 6:46:18 PM
> > org.apache.zookeeper.ClientCnxn$SendThread
> > > > > > > startConnect
> > > > > > > INFO: Opening socket connection to server /192.265.47.222:2181
> > > > > > > Aug 30, 2012 6:46:18 PM
> > org.apache.zookeeper.ClientCnxn$SendThread
> > > > > > > primeConnection
> > > > > > > INFO: Socket connection established to
> > > > > > 192.265.47.222/192.265.47.222:2181,
> > > > > > > initiating session
> > > > > > > Aug 30, 2012 6:46:18 PM
> > org.apache.zookeeper.ClientCnxn$SendThread
> > > > > > > onConnected
> > > > > > > INFO: Session establishment complete on
> > > > > > > server 192.265.47.222/192.265.47.222:2181, sessionid =
> > > > > 0x13977a180910010,
> > > > > > > negotiated timeout = 180000
> > > > > > > Aug 30, 2012 6:46:50 PM org.apache.zookeeper.ZooKeeper close
> > > > > > > INFO: Session: 0x13977a180910010 closed
> > > > > > > 12/08/30 18:46:50
> > > org.apache.hadoop.hbase.MasterNotRunningException:
> > > > > > > Retried 10 times
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> > > org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:127)
> > > > > > > 12/08/30 18:46:50 at _hbase.demo(_hbase.java:59)
> > > > > > > 12/08/30 18:46:50 at _hbase._jspService(_hbase.java:208)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> > > >
> com.orionserver.http.OrionHttpJspPage.service(OrionHttpJspPage.java:56)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> oracle.jsp.runtimev2.JspPageTable.service(JspPageTable.java:347)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> > > oracle.jsp.runtimev2.JspServlet.internalService(JspServlet.java:509)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > > oracle.jsp.runtimev2.JspServlet.service(JspServlet.java:413)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > > javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> com.evermind.server.http.ServletRequestDispatcher.invoke(ServletRequestDispatcher.java:810)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> com.evermind.server.http.ServletRequestDispatcher.forwardInternal(ServletRequestDispatcher.java:322)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> com.evermind.server.http.HttpRequestHandler.processRequest(HttpRequestHandler.java:790)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> com.evermind.server.http.HttpRequestHandler.run(HttpRequestHandler.java:270)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> com.evermind.server.http.HttpRequestHandler.run(HttpRequestHandler.java:112)
> > > > > > > 12/08/30 18:46:50 at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:186)
> > > > > > > 12/08/30 18:46:50 at java.lang.Thread.run(Thread.java:662)
> > > > > > > Aug 30, 2012 6:46:50 PM
> > org.apache.zookeeper.ClientCnxn$EventThread
> > > > run
> > > > > > > INFO: EventThread shut down
> > > > > > >
> > > > > > >
> > > > > > > Please suggest me how to resolve this.
> > > > > > >
> > > > > > >
> > > > > > > Thank You,
> > > > > > > Jilani
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Thanks & Regards,
> > > > > Anil Gupta
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Thanks & Regards,
> > > Anil Gupta
> > >
> >
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
>
