Build failed in Jenkins: Hadoop-Common-trunk #131
See https://builds.apache.org/job/Hadoop-Common-trunk/131/changes Changes: [mahadev] Missing findbugs exclude file from MR-279 branch merge. [mahadev] MAPREDUCE-2854. update INSTALL with config necessary run mapred on yarn. (thomas graves via mahadev) [atm] HADOOP-7555. Add a eclipse-generated files to .gitignore. (atm) [vinodkv] Updating CHANGES.txt to reflect fixes from MR-279 branch that came into trunk when merging the two of them. [vinodkv] MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli. -- [...truncated 9232 lines...] Running org.apache.hadoop.io.TestObjectWritableProtos Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.291 sec Running org.apache.hadoop.io.compress.TestCodecFactory Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.227 sec Running org.apache.hadoop.metrics2.util.TestSampleStat Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.061 sec Running org.apache.hadoop.http.TestHttpServerWebapps Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.332 sec Running org.apache.hadoop.fs.viewfs.TestViewFsWithAuthorityLocalFs Tests run: 41, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.37 sec Running org.apache.hadoop.util.TestGenericOptionsParser Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.476 sec Running org.apache.hadoop.fs.TestLocalDirAllocator Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.423 sec Running org.apache.hadoop.ipc.TestSaslRPC Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.151 sec Running org.apache.hadoop.net.TestDNS Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.122 sec Running org.apache.hadoop.fs.viewfs.TestChRootedFileSystem Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.575 sec Running org.apache.hadoop.util.TestGenericsUtil Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.177 sec Running org.apache.hadoop.fs.permission.TestFsPermission Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.303 sec Running org.apache.hadoop.http.TestGlobalFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.644 sec Running org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.496 sec Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.988 sec Running org.apache.hadoop.conf.TestConfigurationSubclass Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.21 sec Running org.apache.hadoop.ipc.TestSocketFactory Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.19 sec Running org.apache.hadoop.metrics.TestMetricsServlet Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec Running org.apache.hadoop.fs.viewfs.TestViewFsConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.285 sec Running org.apache.hadoop.fs.TestLocalFileSystem Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.479 sec Running org.apache.hadoop.io.file.tfile.TestTFileSplit Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.559 sec Running org.apache.hadoop.fs.TestHardLink Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.208 sec Running org.apache.hadoop.fs.shell.TestPathExceptions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.064 sec Running org.apache.hadoop.conf.TestDeprecatedKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec Running org.apache.hadoop.security.token.TestToken Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.05 sec Running org.apache.hadoop.metrics2.impl.TestMetricsVisitor Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.319 sec Running org.apache.hadoop.io.TestMapFile Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.435 sec Running org.apache.hadoop.fs.TestFcLocalFsUtil Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.416 sec Running org.apache.hadoop.io.TestArrayWritable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.045 sec Running org.apache.hadoop.fs.TestFilterFileSystem Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.163 sec Running org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract Tests run: 36, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.755 sec Running org.apache.hadoop.fs.TestLocalFileSystemPermission Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.385 sec Running
[jira] [Created] (HADOOP-7557) Make IPC and RPC headers be extensible
Make IPC and RPC headers be extensible --- Key: HADOOP-7557 URL: https://issues.apache.org/jira/browse/HADOOP-7557 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-7321) The link to the documentation on the hadoop common page is broken
[ https://issues.apache.org/jira/browse/HADOOP-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-7321. - Resolution: Fixed The link to the documentation on the hadoop common page is broken - Key: HADOOP-7321 URL: https://issues.apache.org/jira/browse/HADOOP-7321 Project: Hadoop Common Issue Type: Bug Components: documentation Reporter: Roko Kruze Currently the following link is broken for the documentation: http://hadoop.apache.org/common/docs/stable/ -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7558) Add system tests instrumentation to the maven build
Add system tests instrumentation to the maven build --- Key: HADOOP-7558 URL: https://issues.apache.org/jira/browse/HADOOP-7558 Project: Hadoop Common Issue Type: Sub-task Components: build Reporter: Konstantin Boudnik AOP is used for fault injection tests as well as for cluster system validation (aka Herriot). The latter has been missed from the scope of this work. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7559) Broken Link On Web Access Source View
Broken Link On Web Access Source View - Key: HADOOP-7559 URL: https://issues.apache.org/jira/browse/HADOOP-7559 Project: Hadoop Common Issue Type: Bug Reporter: Nong Li Priority: Minor From this page, http://hadoop.apache.org/hdfs/version_control.html, the link to the Web Access (readonly), http://svn.apache.org/viewvc/hadoop/common/trunk/hdfs/, is broken. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-7559) Broken Link On Web Access Source View
[ https://issues.apache.org/jira/browse/HADOOP-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HADOOP-7559. - Resolution: Fixed Thanks for reporting the broken link. I just updated the page to point to http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-hdfs/ - it should propagate within an hour or so. Broken Link On Web Access Source View - Key: HADOOP-7559 URL: https://issues.apache.org/jira/browse/HADOOP-7559 Project: Hadoop Common Issue Type: Bug Reporter: Nong Li Assignee: Todd Lipcon Priority: Minor Labels: website From this page, http://hadoop.apache.org/hdfs/version_control.html, the link to the Web Access (readonly), http://svn.apache.org/viewvc/hadoop/common/trunk/hdfs/, is broken. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7560) Make hadoop-common a POM module with sub-modules (common alfredo)
Make hadoop-common a POM module with sub-modules (common alfredo) --- Key: HADOOP-7560 URL: https://issues.apache.org/jira/browse/HADOOP-7560 Project: Hadoop Common Issue Type: Sub-task Reporter: Alejandro Abdelnur Assignee: Alejandro Abdelnur Currently hadoop-common is a JAR module, thus it cannot aggregate sub-modules. Changing it to POM module it makes it an aggregator module, all the code under hadoop-common must be moved to a sub-module. I.e.: mkdir hadoop-common-project mv hadoop-common hadoop-common-project mv hadoop-alfredo hadoop-common-project hadoop-common-project/pom.xml is a POM module that aggregates common alfredo -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7561) Make test-patch only run tests for changed modules
Make test-patch only run tests for changed modules -- Key: HADOOP-7561 URL: https://issues.apache.org/jira/browse/HADOOP-7561 Project: Hadoop Common Issue Type: Sub-task Reporter: Tom White Assignee: Tom White Fix For: 0.23.0 By running test-patch from trunk we can check that a change in one project (e.g. common) doesn't cause compile errors in other projects (e.g. HDFS). To get this to work we only need to run tests for the modules that are affected by the patch. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
System tests on 0.20.20x releases
Has anyone tried running the system tests on a 0.20.20x release? Why don't we run these via Hudson? After following the instructions on the wiki [1] and making a bunch of additional fixes (setting dfs.datanode.ipc.address in the config, using sbin instead of bin, copying libs into the FI build lib dir, etc) I was able to get the tests running however the tests seem to have bitrot. The reason I ask is that it looks like the src/test/system tests are only compiled or run via the test-system target and it doesn't look like Hudson or developers use that target, therefore we're not doing anything to prevent people from breaking the tests. I tried to run them to see if one of my changes would break them but I can't imagine most people will jump through all the above hoops. On a related note, is there any way to run these against an existing build/cluster? It looks like they require running on a build that's been fault injected (ie they use custom protocol classes that are not present in the normal tarball) which makes them much less useful. Thanks, Eli 1. http://wiki.apache.org/hadoop/HowToUseSystemTestFramework