+1 only for HDFS and common. I compiled using source, now everything I tested is fine.
I configured QJM HA, enabled short circuit read, ran a MRv1 job; note: my testing cluster using HDFS-2.1.0-beta and common-2.1.0-beta, but MR is 1.1.2.( I did some change) On Wed, Jun 26, 2013 at 5:21 PM, Azuryy Yu <[email protected]> wrote: > Hi Arun, > > I downloaded bin-tar and deployed, then I ran a complicated MR jobs, it's > succeed. > But when I add the following entries [HDFS-347]: > <property> > <name>dfs.client.read.shortcircuit</name> > <value>true</value> > </property> > <property> > <name>dfs.domain.socket.path</name> > <value>/home/hadoop/dn_socket</value> > </property> > > I cannot start HDFS, log as following: > > 2013-06-26 17:11:42,413 FATAL > org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain > java.lang.RuntimeException: Although a UNIX domain socket path is > configured as /home/hadoop/dn_socket, we cannot start a > localDataXceiverServer because libhadoop cannot be loaded. > at > org.apache.hadoop.hdfs.server.datanode.DataNode.getDomainPeerServer(DataNode.java:597) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.initDataXceiver(DataNode.java:569) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:740) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:343) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1799) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1714) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1737) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1909) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1930) > 2013-06-26 17:11:42,425 INFO org.apache.hadoop.util.ExitUtil: Exiting with > status 1 > > > > > > > > > > On Wed, Jun 26, 2013 at 4:17 PM, Arun C Murthy <[email protected]>wrote: > >> Folks, >> >> I've created a release candidate (rc0) for hadoop-2.1.0-beta that I would >> like to get released. >> >> This release represents a *huge* amount of work done by the community >> (639 fixes) which includes several major advances including: >> # HDFS Snapshots >> # Windows support >> # YARN API stabilization >> # MapReduce Binary Compatibility with hadoop-1.x >> # Substantial amount of integration testing with rest of projects in the >> ecosystem >> >> The RC is available at: >> http://people.apache.org/~acmurthy/hadoop-2.1.0-beta-rc0/ >> The RC tag in svn is here: >> http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.1.0-beta-rc0 >> >> The maven artifacts are available via repository.apache.org. >> >> Please try the release and vote; the vote will run for the usual 7 days. >> >> thanks, >> Arun >> >> -- >> Arun C. Murthy >> Hortonworks Inc. >> http://hortonworks.com/ >> >> >> >
