[jira] [Created] (MAPREDUCE-5664) java.lang.RuntimeException: javax.xml.parsers.ParserConfigurationException:
ranjini created MAPREDUCE-5664: -- Summary: java.lang.RuntimeException: javax.xml.parsers.ParserConfigurationException: Key: MAPREDUCE-5664 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5664 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: ranjini Hi, When processing xml file as input via map reduce, the error occurred is conf.Configuration: error parsing conf file: javax.xml.parsers.ParserConfigurationException: Feature 'http://apache.org/xml/features/xinclude' is not recognized. Exception in thread main java.lang.RuntimeException: javax.xml.parsers.ParserConfigurationException: Feature 'http://apache.org/xml/features/xinclude' is not recognized. at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1171) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1030) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:980) at org.apache.hadoop.conf.Configuration.get(Configuration.java:382) at org.apache.hadoop.util.RunJar.main(RunJar.java:109) Caused by: javax.xml.parsers.ParserConfigurationException: Feature 'http://apache.org/xml/features/xinclude' is not recognized. at org.apache.xerces.jaxp.DocumentBuilderFactoryImpl.newDocumentBuilder(Unknown Source) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1061) ... 4 more Please help to fix the issue -- This message was sent by Atlassian JIRA (v6.1#6144)
Hadoop-Mapreduce-trunk - Build # 1627 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1627/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 33098 lines...] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.673 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.669 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.32 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler Running org.apache.hadoop.mapreduce.jobhistory.TestEvents Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.717 sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents Results : Failed tests: TestRMContainerAllocator.testUpdatedNodes:779 null Tests run: 256, Failures: 1, Errors: 0, Skipped: 0 [INFO] [INFO] Reactor Summary: [INFO] [INFO] hadoop-mapreduce-client ... SUCCESS [2.474s] [INFO] hadoop-mapreduce-client-core .. SUCCESS [45.443s] [INFO] hadoop-mapreduce-client-common SUCCESS [25.551s] [INFO] hadoop-mapreduce-client-shuffle ... SUCCESS [2.423s] [INFO] hadoop-mapreduce-client-app ... FAILURE [6:36.403s] [INFO] hadoop-mapreduce-client-hs SKIPPED [INFO] hadoop-mapreduce-client-jobclient . SKIPPED [INFO] hadoop-mapreduce-client-hs-plugins SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] hadoop-mapreduce .. SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 7:53.317s [INFO] Finished at: Tue Dec 03 13:28:43 UTC 2013 [INFO] Final Memory: 24M/234M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-mapreduce-client-app: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports for the individual test results. [ERROR] - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :hadoop-mapreduce-client-app Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Updating YARN-1318 Updating HADOOP-10130 Updating MAPREDUCE-5640 Updating HDFS-5557 Updating HDFS-5581 Updating HDFS-5560 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
Re: [VOTE] Release Apache Hadoop 0.23.10
I've built the tag and ran some basic tests on a single node cluster. +1 (binding) Kihwal On Tuesday, December 3, 2013 12:24 AM, Thomas Graves tgra...@yahoo-inc.com wrote: Hey Everyone, There have been lots of improvements and bug fixes that have went into branch-0.23 since the 0.23.9 release. We think its time to do a 0.23.10 so I have created a release candidate (rc0) for a Hadoop-0.23.10 release. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.10-rc0/ The RC Tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.10-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days til December 9th. I am +1 (binding). thanks, Tom Graves
Re: [VOTE] Release Apache Hadoop 0.23.10
+1 (binding) Verified bits and ran sample jobs. Thanks for driving this Thomas. Arun On Dec 2, 2013, at 10:22 PM, Thomas Graves tgra...@yahoo-inc.com wrote: Hey Everyone, There have been lots of improvements and bug fixes that have went into branch-0.23 since the 0.23.9 release. We think its time to do a 0.23.10 so I have created a release candidate (rc0) for a Hadoop-0.23.10 release. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.10-rc0/ The RC Tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.10-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days til December 9th. I am +1 (binding). thanks, Tom Graves -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Created] (MAPREDUCE-5665) Add audience annotations to MiniMRYarnCluster and MiniMRCluster
Sandy Ryza created MAPREDUCE-5665: - Summary: Add audience annotations to MiniMRYarnCluster and MiniMRCluster Key: MAPREDUCE-5665 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5665 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Affects Versions: 2.2.0 Reporter: Sandy Ryza We should make it clear whether these are public interfaces. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (MAPREDUCE-5666) org/apache/hadoop/mapreduce/lib/input/FileInputFormat.java(org/apache/hadoop/mapreduce/lib/input:FileInputFormat.java):cannot find symbol
ranjini created MAPREDUCE-5666:
--
Summary:
org/apache/hadoop/mapreduce/lib/input/FileInputFormat.java(org/apache/hadoop/mapreduce/lib/input:FileInputFormat.java):cannot
find symbol
Key: MAPREDUCE-5666
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5666
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: ranjini
hi
I have written the below code , and facing the issue. i am using hadoop 0.20
vesion and java 1.6 the issue is
org/apache/hadoop/mapreduce/lib/input/FileInputFormat.java(org/apache/hadoop/mapreduce/lib/input:FileInputFormat.java):232:
cannot find symbol
symbol : method isDirectory()
location: class org.apache.hadoop.fs.FileStatus
if (globStat.isDirectory()) {
^
org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java(org/apache/hadoop/mapreduce/lib/output:FileOutputCommitter.java):208:
cannot find symbol
symbol : method isDirectory()
location: class org.apache.hadoop.fs.FileStatus
} else if(fs.getFileStatus(taskOutput).isDirectory()) {
^
org/apache/hadoop/mapred/JobConf.java(org/apache/hadoop/mapred:JobConf.java):433:
cannot find symbol
symbol : method getPattern(java.lang.String,java.util.regex.Pattern)
location: class org.apache.hadoop.mapred.JobConf
return getPattern(JobContext.JAR_UNPACK_PATTERN,
UNPACK_JAR_PATTERN_DEFAULT);
^
org/apache/hadoop/mapred/JobConf.java(org/apache/hadoop/mapred:JobConf.java):450:
cannot find symbol
symbol : method getTrimmedStrings(java.lang.String)
location: class org.apache.hadoop.mapred.JobConf
return getTrimmedStrings(MRConfig.LOCAL_DIR);
^
org/apache/hadoop/mapred/FileInputFormat.java(org/apache/hadoop/mapred:FileInputFormat.java):165:
cannot find symbol
symbol : method isDirectory()
location: class org.apache.hadoop.fs.FileStatus
if (stat.isDirectory()) {
^
org/apache/hadoop/mapred/FileInputFormat.java(org/apache/hadoop/mapred:FileInputFormat.java):215:
cannot find symbol
symbol : method isDirectory()
location: class org.apache.hadoop.fs.FileStatus
if (globStat.isDirectory()) {
^
org/apache/hadoop/mapred/FileInputFormat.java(org/apache/hadoop/mapred:FileInputFormat.java):218:
cannot find symbol
symbol : method isDirectory()
location: class org.apache.hadoop.fs.FileStatus
if (recursive stat.isDirectory()) {
^
org/apache/hadoop/mapred/FileInputFormat.java(org/apache/hadoop/mapred:FileInputFormat.java):258:
cannot find symbol
symbol : method isDirectory()
location: class org.apache.hadoop.fs.FileStatus
if (file.isDirectory()) {
^
org/apache/hadoop/mapred/FileOutputCommitter.java(org/apache/hadoop/mapred:FileOutputCommitter.java):166:
cannot find symbol
symbol : method isDirectory()
location: class org.apache.hadoop.fs.FileStatus
} else if(fs.getFileStatus(taskOutput).isDirectory()) {
^
org/apache/hadoop/mapred/LineRecordReader.java(org/apache/hadoop/mapred:LineRecordReader.java):100:
incompatible types
found : org.apache.hadoop.io.compress.SplitCompressionInputStream
required: org.apache.hadoop.fs.Seekable
filePosition = cIn; // take pos from compressed stream
^
org/apache/hadoop/mapreduce/lib/input/LineRecordReader.java(org/apache/hadoop/mapreduce/lib/input:LineRecordReader.java):98:
incompatible types
found : org.apache.hadoop.io.compress.SplitCompressionInputStream
required: org.apache.hadoop.fs.Seekable
filePosition = cIn;
I have attached the code
import java.io.DataInput;
import java.io.DataOutput;
import java.io.IOException;
import java.util.StringTokenizer;
import org.apache.hadoop.conf.Configured;
import org.apache.hadoop.fs.FSDataInputStream;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.io.WritableComparable;
import org.apache.hadoop.mapreduce.InputSplit;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;
import org.apache.hadoop.mapreduce.RecordReader;
import org.apache.hadoop.mapreduce.TaskAttemptContext;
import org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat;
import org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader;
import org.apache.hadoop.mapreduce.lib.input.CombineFileSplit;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
import org.apache.hadoop.mapreduce.lib.reduce.IntSumReducer;
import org.apache.hadoop.util.LineReader;
import org.apache.hadoop.util.Tool;
import org.apache.hadoop.util.ToolRunner;
/**
* MultiFileWordCount is an
[jira] [Created] (MAPREDUCE-5667) Error in runtime in mapreduce code
ranjini created MAPREDUCE-5667: -- Summary: Error in runtime in mapreduce code Key: MAPREDUCE-5667 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5667 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: ranjini Hi, While executing the code taking input xml file in mapreduce. The error occurred is Error: java.lang.ClassNotFoundException: org.jdom.input.SAXBuilder Error: java.lang.ClassNotFoundException: org.jdom.JDOMException I am using hadoop 0.20 and java 1.6 I used jdom-1.0.jar but still error coming. Please help this issue suggest what version jar should i use. Thanks in advance. -- This message was sent by Atlassian JIRA (v6.1#6144)
