Hi,
I am using apache-maven-3.0.3 and i have set LD_LIBRARY_PATH=/usr/local/lib
which has google protocbuf library.
I am getting following error while building hadoop-yarn using mvn clean
install -DskipTests=true
[INFO] hadoop-yarn-api ... SUCCESS [14.904s]
[INFO]
Thanks Arun,
Now its working fine
Thanks Regards
Rajesh Putta
Development Engineer
Pramati Technologies
On Fri, Aug 19, 2011 at 12:25 PM, Arun Murthy a...@hortonworks.com wrote:
That means you don't have the autotool chain necessary for build the
native code.
For now pass -P-cbuild
Please check the defect in MAPREDUCE jira
https://issues.apache.org/jira/browse/MAPREDUCE-2264
This is because the compression is enabled for map outputs and statistics
are taken on compressed data instead of original data.
-Original Message-
From: Joey Echeverria
Hi all,
I am having issues using SequenceFileInputFormat to retrieve whole records
I have 1 job that is used to write to a SequenceFile
SequenceFileOutputFormat.setOutputPath(job, new Path(out/data));
SequenceFileOutputFormat.setOutputCompressionType(job,
SequenceFile.CompressionType.NONE);
I
Tim,
Do you also set your I/O formats explicitly to SequenceFileInputFormat
and SequenceFileOutputFormat? Via job.setInputFormat/setOutputFormat I
mean.
Hadoop should not be splitting records across maps/mappers. There are
specific test cases that ensure this does not happen, so it would seem
Harsh, that was exactly the issue!
Thanks very much for your help
Tim
On 19 August 2011 15:15, Harsh J ha...@cloudera.com wrote:
Tim,
Do you also set your I/O formats explicitly to SequenceFileInputFormat
and SequenceFileOutputFormat? Via job.setInputFormat/setOutputFormat I
mean.
Hadoop
Yup, that would do it. Thanks.
-Joey
On Fri, Aug 19, 2011 at 4:14 AM, Vinayakumar B vinayakuma...@huawei.com wrote:
Please check the defect in MAPREDUCE jira
https://issues.apache.org/jira/browse/MAPREDUCE-2264
This is because the compression is enabled for map outputs and statistics
are
