thanks man, this worked:
<dependency org="org.apache.gora" name="gora-hbase" rev="0.2.1"
conf="*->default" >
<exclude org="org.apache.hbase" name="hbase" />
</dependency>
<dependency org="org.apache.hbase" name="hbase" rev="0.90.5"
conf="*->default" />
turned out maven repo1 doesn't even have the 90.6 in it, at least yet,
:) so I tried with 0.90.5, and I am still getting this:
13/02/21 15:39:37 WARN snappy.LoadSnappy: Snappy native library not loaded
13/02/21 15:39:37 INFO mapred.JobClient: Running job: job_201302191325_0006
13/02/21 15:39:38 INFO mapred.JobClient: map 0% reduce 0%
13/02/21 15:40:01 INFO mapred.JobClient: Task Id :
attempt_201302191325_0006_m_000000_0, Status : FAILED
org.apache.gora.util.GoraException:
org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to
connect to ZooKeeper but the connection closes immediately. This could
be a sign that the server has too many connections (30 is the default).
Consider inspecting your ZK server logs for that error and then make
sure you are reusing HBaseConfiguration as often as you can. See
HTable's javadoc for more information.
at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:167)
at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:118)
this is output of a nutch inject commoand.
BTW, what is snappy ?
On 02/21/2013 12:17 PM, Lewis John Mcgibbney wrote:
Try this
<dependency org="org.apache.gora" name="gora-hbase" rev="0.2.1"
conf="*->default" >
<exclude org="org.apache.hbase" name="hbase" rev="0.90.4" />
</dependency>
...
<dependency org="org.apache.hbase" name="hbase" rev="0.90.6"
conf="*->default" >
hth
On Thu, Feb 21, 2013 at 11:41 AM, kaveh minooie <[email protected]> wrote:
this is what i ended up in my ivy.xml:
<dependency org="org.apache.gora" name="gora-hbase" rev="0.2.1"
conf="*->default" >
<!-- exclude org="org.apache.hbase" name="hbase" rev="0.90.4" /-->
<include org="org.apache.hbase" name="hbase" rev="0.90.6" />
</dependency>
which caused this:
BUILD FAILED
/source/nutch/nutch/build.xml:**440: syntax errors in ivy file:
java.text.ParseException: [xml parsing: ivy.xml:115:63:
cvc-complex-type.3.2.2: Attribute 'org' is not allowed to appear in element
'include'. in file:/source/nutch/nutch/ivy/**ivy.xml
, xml parsing: ivy.xml:115:63: cvc-complex-type.3.2.2: Attribute 'rev' is
not allowed to appear in element 'include'. in file:/source/nutch/nutch/ivy/
**ivy.xml
it is the same with exclude tag included as well.
On 02/21/2013 11:19 AM, Lewis John Mcgibbney wrote:
replace
<dependency org="org.apache.gora" name="gora-hbase" rev="0.2.1"
conf="*->default" />
with
<dependency org="org.apache.gora" name="gora-hbase" rev="0.2.1"
conf="*->default"
<exclude org="org.apache.hbase" name="hbase" rev="0.90.4">
<include org="org.apache.hbase" name="hbase" rev="0.90.6">
</dependency>
hopefully something like this will work.
hth
On Thu, Feb 21, 2013 at 11:00 AM, kaveh minooie <[email protected]> wrote:
thanks Lewis.
I am sorry but i have to bother you with this. could tell me how I can
have nutch ant fetch the 0.90.6 instead of 0.90.4 because, according to
ant
report, it is being fetch indirectly by gora 0.2.1. I am actually using
0.90.6 for my hbase, but I don't how modify ivy.xml file to accomplish
that.
thanks,
On 02/21/2013 10:39 AM, Lewis John Mcgibbney wrote:
http://s.apache.org/WbGsorry for ridiculous size of font
hth
On Thu, Feb 21, 2013 at 10:31 AM, kaveh minooie <[email protected]>
wrote:
Has anyone encounter this error before:
org.apache.gora.util.******GoraException: org.apache.hadoop.hbase.****
ZooKeeperConnectionException:
HBase is able to connect to ZooKeeper but the connection closes
immediately. This could be a sign that the server has too many
connections
(30 is the default). Consider inspecting your ZK server logs for that
error
and then make sure you are reusing HBaseConfiguration as often as you
can.
See HTable's javadoc for more information.
at org.apache.gora.store.******DataStoreFactory.****
createDataStore(**
DataStoreFactory.java:167)
at org.apache.gora.store.******DataStoreFactory.****
createDataStore(**
DataStoreFactory.java:118)
at org.apache.gora.mapreduce.******GoraOutputFormat.****
getRecordWriter(
**GoraOutputFormat.java:88)
at org.apache.hadoop.mapred.******MapTask$****
NewDirectOutputCollector.<
**init>(MapTask.java:628)
at org.apache.hadoop.mapred.******
MapTask.runNewMapper(MapTask.****
**
java:753)
at org.apache.hadoop.mapred.******
MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.******
Child$4.run(Child.java:255)
at java.security.******AccessController.doPrivileged(**
****Native
Method)
at javax.security.auth.Subject.******doAs(Unknown Source)
at org.apache.hadoop.security.*****
*UserGroupInformation.doAs(**
UserGroupInformation.java:******1136)
at org.apache.hadoop.mapred.******Child.main(Child.java:249)
Caused by: org.apache.hadoop.hbase.******ZooKeeperConnectionException:
HBase
is able to connect to ZooKeeper but the connection closes immediately.
This
could be a sign that the server has too many connections (30 is the
default). Consider inspecting your ZK server logs for that error and
then
make sure you are reusing HBaseConfiguration as often as you can. See
HTable's javadoc for more information.
at org.apache.hadoop.hbase.******
zookeeper.ZooKeeperWatcher.<**
init>(ZooKeeperWatcher.java:******155)
at org.apache.hadoop.hbase.******
client.HConnectionManager$**
HConnectionImplementation.******getZooKeeperWatcher(**
HConnectionManager.java:1002)
at org.apache.hadoop.hbase.******
client.HConnectionManager$**
HConnectionImplementation.******setupZookeeperTrackers(**
HConnectionManager.java:304)
at org.apache.hadoop.hbase.******
client.HConnectionManager$**
HConnectionImplementation.<******init>(HConnectionManager.**
java:****295)
at org.apache.hadoop.hbase.******
client.HConnectionManager.**
getConnection(******HConnectionManager.java:157)
at org.apache.hadoop.hbase.******client.HBaseAdmin.<init>(**
HBaseAdmin.java:90)
at org.apache.gora.hbase.store.****
**HBaseStore.initialize(**
HBaseStore.java:108)
at org.apache.gora.store.******DataStoreFactory.****
initializeDataStore(
**DataStoreFactory.java:102)
at org.apache.gora.store.******DataStoreFactory.****
createDataStore(**
DataStoreFactory.java:161)
what configuration in zookeeper is it talking about?
for the record, I think, this is the error in the zookeeper log file
that
it is talking about ( it is the only error in my log file):
2013-02-21 02:57:43,099 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/*
*** <http://0.0.0.0/**>
** <http://0.0.0.0/**>
0.0.0.0:2181:NIOServerCnxn@349****<http://0.0.0.0/0.0.0.0:**2181:**<http://0.0.0.0/0.0.0.0:2181:**>
NIOServerCnxn@349
<http://0.0.0.0/0.0.0.0:2181:**NIOServerCnxn@349<http://0.0.0.0/0.0.0.0:2181:NIOServerCnxn@349>
**] - caught end of stream exception
EndOfStreamException: Unable to read additional data from client
sessionid
0x13cfc5527be0017, likely client has closed socket
at org.apache.zookeeper.server.******NIOServerCnxn.doIO(**
NIOServerCnxn.java:220)
at org.apache.zookeeper.server.****
**NIOServerCnxnFactory.run(**
NIOServerCnxnFactory.java:208)
at java.lang.Thread.run(Unknown Source)
2013-02-21 02:57:43,100 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/*
*** <http://0.0.0.0/**>
** <http://0.0.0.0/**>
0.0.0.0:2181:NIOServerCnxn@******1001<http://0.0.0.0/0.0.0.0:****<http://0.0.0.0/0.0.0.0:**>
2181:NIOServerCnxn@1001 <http://0.0.0.0/0.0.0.0:2181:**
NIOServerCnxn@1001 <http://0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1001>>
]
- Closed socket connection for client /127.0.0.1:42306 which had
sessionid 0x13cfc5527be0017
I am also concern about this happening on the loop back interface.
doesn't
look right to me.
oh and btw this is on hadoop cluster with 10 nodes
--
Kaveh Minooie
www.plutoz.com
--
Kaveh Minooie
www.plutoz.com
--
Kaveh Minooie
www.plutoz.com
--
Kaveh Minooie
www.plutoz.com
