Cool. Thanks again for pointing this out. I've created
https://issues.apache.org/jira/browse/ACCUMULO-1637 to track this and
try to come up with a fix that will work with older and newer versions
of Hadoop.
On 08/03/2013 10:49 PM, Carlos Mundi wrote:
Josh,
You are exactly correct. It needed 'true'. I'm i the accumulo shell
now!
Yeah! Thanks!
Carlos
On Sat, Aug 3, 2013 at 7:31 PM, Josh Elser <[email protected]
<mailto:[email protected]>> wrote:
Yes, I believe the value used to be "true".
On 08/03/2013 10:27 PM, Carlos Mundi wrote:
Hi Josh,
Thanks for your reply! I set dfs.durable.sync to 1 in my
hdfs-site.xml like this:
<property>
<name>dfs.durable.sync</name>
<value>1</value>
</property>
And then I stopped and restarted the whole chain: hadoop,
zookeeper, accumulo.
Same results! So I'm not sure what's going on. Maybe hadoop
needs 'true' instead of '1'.
I'm tinkering with it and will report any new info.
Cheers!
Carlos
On Sat, Aug 3, 2013 at 7:21 PM, Josh Elser
<[email protected] <mailto:[email protected]>
<mailto:[email protected] <mailto:[email protected]>>>
wrote:
Hi Carlos,
I pulled down the Apache Hadoop 1.2.0 source release and
took a
look at src/hdfs/hdfs-default.xml. Reading the description
on the
dfs.support.append property, dfs.support.append isn't
supported
and dfs.durable.sync is enabled by default. Looks like we
need to
change that check in the TabletServer code.
In the mean time, you can likely set that property in your
hdfs-site.xml to be true to fake out the tablet server and
make it
think that it's set.
Thanks for letting us know!
- Josh
On 08/03/2013 10:01 PM, Carlos Mundi wrote:
Hi.
This is my first time setting up accumulo. So I'm
starting
with a single node "cluster" on Ubuntu 13.04. My
setup is...
hadoop 1.2.0 (prebuilt tarball from Apache) -- The
version will turn out to be important!
zookeeper 3.4.5 (prebuilt tarball from Apache)
accumulo 1.5.0 (custom build, to target hadoop 1.2)
As I understand, because I am running hadoop 1.2, I
need to do
a custom build. So I did, following the README for
Accumulo.
So I fire up hadoop, then zookeeper and then accumulo.
Looks
good so far:
$ jps
21231 SecondaryNameNode
20733 NameNode
24274 Jps
22556 Main
21994 Main
20978 DataNode
22306 Main
21764 QuorumPeerMain
21570 TaskTracker
22409 Main
21322 JobTracker
Then I try to fire up an accumulo shell (still
following the
README) and I am told that there are no tablet
servers! Here
is what I get in
/usr/local/accumulo/logs/tracer_mybox.log:
2013-08-03 18:32:44,918 [impl.ServerClient] WARN :
There are
no tablet servers: check that zookeeper and accumulo
are running.
I check jps, and everything is still running. And here is
what I have in /usr/local/accumulo/logs/tserver_mybox.log:
2013-08-03 18:32:41,292 [tabletserver.TabletServer] FATAL:
Must set dfs.durable.sync OR dfs.support.append to true.
Which one needs to be set depends on your version of
HDFS.
See ACCUMULO-623.
HADOOP RELEASE VERSION SYNC NAME DEFAULT
Apache Hadoop 0.20.205 dfs.support.append
false
Apache Hadoop 0.23.x dfs.support.append true
Apache Hadoop 1.0.x dfs.support.append false
Apache Hadoop 1.1.x dfs.durable.sync true
Apache Hadoop 2.0.0-2.0.2
dfs.support.append true
Cloudera CDH 3u0-3u3 ????
true
Cloudera CDH 3u4 dfs.support.append
true
Hortonworks HDP `1.0 dfs.support.append
false
Hortonworks HDP `1.1 dfs.support.append
false
And, yes, I remember seeing that in the README. But
now you
see my problem. Hadoop 1.2 is not on the list!
At least, I assume that's my only problem. :)
Can someone please tell me which of the two dfs
options I need?
Thanks very much!
Carlos
