The two reject files I got from compiling pig-0.9.1 were:
less build.xml.rej
--- build.xml 2011-09-26 11:30:09.444295122 -0700
+++ build.xml 2011-09-26 11:30:15.112364255 -0700
@@ -563,7 +563,9 @@
<attribute name="Svn-Revision" value="${svnString}" />
</section>
</manifest>
- <zipfileset src="${ivy.lib.dir}/hadoop-core-${hadoop-core.version}.jar" />
+ <zipfileset
src="${ivy.lib.dir}/hadoop-common-${hadoop-common.version}.jar" />
+ <zipfileset src="${ivy.lib.dir}/hadoop-hdfs-${hadoop-hdfs.version}.jar" />
+ <zipfileset
src="${ivy.lib.dir}/hadoop-mapred-${hadoop-mapred.version}.jar" />
<zipfileset src="${lib.dir}/${automaton.jarfile}" />
<zipfileset src="${ivy.lib.dir}/antlr-runtime-${antlr.version}.jar" />
<zipfileset src="${ivy.lib.dir}/ST4-${stringtemplate.version}.jar" />
less ivy.xml.rej
--- ivy.xml 2011-09-26 11:30:09.474296571 -0700
+++ ivy.xml 2011-09-26 11:30:24.543413316 -0700
@@ -54,9 +54,13 @@
conf="compile->master"/>
<dependency org="log4j" name="log4j" rev="${log4j.version}"
conf="compile->master"/>
- <dependency org="org.apache.hadoop" name="hadoop-core"
rev="${hadoop-core.version}"
+ <dependency org="org.apache.hadoop" name="hadoop-common"
rev="${hadoop-common.version}"
+ conf="compile->default;test->default"/>
+ <dependency org="org.apache.hadoop" name="hadoop-common-test"
rev="${hadoop-common.version}"
+ conf="compile->default;test->default"/>
+ <dependency org="org.apache.hadoop" name="hadoop-hdfs"
rev="${hadoop-hdfs.version}"
conf="compile->default;test->default"/>
- <dependency org="org.apache.hadoop" name="hadoop-test"
rev="${hadoop-test.version}"
+ <dependency org="org.apache.hadoop" name="hadoop-mapred"
rev="${hadoop-mapred.version}"
conf="compile->default;test->default"/>
<dependency org="org.mortbay.jetty" name="jetty-util" rev="${jetty-util.ver
Regards,
Graeme
PS. Better to post here or on the dev list?
On 19/12/11 18:49, Graeme Seaton wrote:
Hi,
Installed 2.8 manually (after figuring out that I needed to define the
XERCECROOT environment variable). Having read the upstream
documentation, not sure whether librecordio should be disabled - looks
useful despite the alternatives and potentialially others are using it
(but at the end of the day it is an upstream decision).
Continuing the build process but there seems to be a problem with a
couple of patches in hive-0.9.1 :-( (had to tweak zookeeper to upgrade
to 3.4.1 but notice that the same patch has already been applied to to
trunk) Will continue to investigate.
Thanks,
Graeme
On 16/12/11 22:14, Bruno Mahé wrote:
On 12/16/2011 09:36 AM, Graeme Seaton wrote:
Hi,
Trying to build the hadoop-0.22 branch on Centos 6.1 and fails (on
both 32 and 64 bit versions) with:
[exec] In file included from recordio.cc:22:
[exec] xmlarchive.hh:77: error: conflicting return type specified
for 'virtual unsigned int hadoop::MyBinInputStream::curPos() const'
[exec] /usr/include/xercesc/util/BinInputStream.hpp:41: error:
overriding 'virtual XMLFilePos xercesc_3_0::BinInputStream::curPos()
const'
[exec] xmlarchive.hh: In member function 'virtual
xercesc_3_0::BinInputStream* hadoop::MyInputSource::makeStream()
const':
[exec] xmlarchive.hh:97: error: cannot allocate an object of
abstract type 'hadoop::MyBinInputStream'
[exec] xmlarchive.hh:71: note: because the following virtual
functions are pure within 'hadoop::MyBinInputStream':
[exec] /usr/include/xercesc/util/BinInputStream.hpp:43:
note: virtual XMLSize_t
xercesc_3_0::BinInputStream::readBytes(XMLByte*, XMLSize_t)
[exec] /usr/include/xercesc/util/BinInputStream.hpp:67:
note: virtual const XMLCh*
xercesc_3_0::BinInputStream::getContentType() const
Version of xerces is:
rpm -qa | grep xerces-c
xerces-c-3.0.1-20.el6.x86_64
xerces-c-devel-3.0.1-20.el6.x86_64
Is there a dependency on xereces-c 3.1 (or earlier versions)? Have
searched G but not found any solutions. Will I need to install
xerces-c 3.1 manually?
Regards,
Graeme
Hi Graeme,
Somehow Roman is having some issues posting to this mailing list, so
please find his reply below:
Hi Graeme!
That's a know issue with CentOS 6 and Hadoop 0.22 build. I believe the
solution
here is to manually install xerces 2.7. It would be nice to fix this
compatibility
issue in Hadoop .22 branch, but given that xerces is only required for
librecordio
(and that seems to be depricated) may be a better option would be to
turn
it off completely in the Hadoop build.
Let us know what you think.
Thanks,
Roman.
