Errors found in logs
Unable to load native-hadoop library for your platform... using builtin-java
classes where applicable
2016-02-09 09:21:30,012 WARN zookeeper.ClientCnxn - Session 0x0 for server
null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2016-02-09 09:21:30,128 WARN zookeeper.RecoverableZooKeeper - Possibly
transient ZooKeeper, quorum=localhost:2181,
exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2016-02-09 09:21:30,128 WARN zookeeper.RecoverableZooKeeper - Possibly
transient ZooKeeper, quorum=localhost:2181,
exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
I downloaded hbase-0.98.8-hadoop2, and set the following in hbase-site,xml
<property>
<name>hbase.cluster.distributed</name>
<value>false</value>
</property>
The question is Do I need to download zookeeper, which I did not do.
In the hbase/lib, I have jar files like
haddop-client-2.2.0.jar
hadoop-common-2.2.0.jar
hadoop-hdfs-2.2.0.jar
....
zookeeper-3.4.6.jar
MANY THANKS FOR HELPING!
________________________________________
Från: Divjot Singh [[email protected]]
Skickat: den 11 februari 2016 12:38
Till: [email protected]
Ämne: Re: no respond after inject
Hi
Can you please check *runtime/local/logs/hadoop.log* file. It would contain
the exact error. Also make sure that Hbase is running fine and you can
create/read table from hbase shell.
Also check that you have set this property to true in gora.properties.
*gora.datastore.autocreateschema=true*
Thanks
Divjot
On Thu, Feb 11, 2016 at 2:47 PM, <[email protected]> wrote:
> Yes, I was in the directory runtime/local, tried
> bin/nutch inject seed/urls.txt
> and ./bin/nutch inject seed/urls.txt
>
> the system reacts the same.
> two lines come first
> > InjectorJob: starting at 2016-02-09 09:21:29
> > InjectorJob: Injecting urlDir: seed/urls.txt
> after a long time, around 15 minutes, comes the third line
> > InjectorJob: Using class org.apache.gora.hbase.store.HBaseStore as the
> > Gora storage class.
> ________________________________________
> Från: Lewis John Mcgibbney [[email protected]]
> Skickat: den 10 februari 2016 16:00
> Till: [email protected]
> Ämne: Re: no respond after inject
>
> Hi Dan,
>
> On Wed, Feb 10, 2016 at 5:06 AM, <[email protected]>
> wrote:
>
> >
> > Sorry for another beginner question. After I installed nutch-2.3.1.
> > hbase-0.98.9 and elasticsearch-2.1.0
> > I start to test to crawl one website with 'nutch inject urls.txt'
> >
> > The terminal window shows only this, which seems the crawling work is
> > going on for ever.
> >
> > InjectorJob: starting at 2016-02-09 09:21:29
> > InjectorJob: Injecting urlDir: seed/urls.txt
> > InjectorJob: Using class org.apache.gora.hbase.store.HBaseStore as the
> > Gora storage class.
> >
> > what can be the possible error for this? Many thanks.
> >
> >
> I think the issue may be here that you are meant to pass a directory as the
> argument for the InjectorJob as oppose to a flat file. Can you please try
>
> ./bin/nutch inject urls/urls.txt
>
> Thanks
> Lewis
>
