[jira] [Resolved] (MAPREDUCE-2608) Mavenize mapreduce contribs
[ https://issues.apache.org/jira/browse/MAPREDUCE-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur resolved MAPREDUCE-2608. --- Resolution: Invalid [doing self-clean up of JIRAs] closing as invalid as this has been done in different jiras. Mavenize mapreduce contribs --- Key: MAPREDUCE-2608 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2608 Project: Hadoop Map/Reduce Issue Type: Task Reporter: Alejandro Abdelnur Assignee: Alejandro Abdelnur Same as HADOOP-6671 for mapreduce contribs -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (MAPREDUCE-4658) Move tools JARs into separate lib directories and have common bootstrap script.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur resolved MAPREDUCE-4658. --- Resolution: Won't Fix [doing self-clean up of JIRAs] scripts have change significantly since this JIRA. Move tools JARs into separate lib directories and have common bootstrap script. --- Key: MAPREDUCE-4658 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4658 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 2.0.2-alpha Reporter: Alejandro Abdelnur Assignee: Alejandro Abdelnur This is a follow up of the discussion going on on MAPREDUCE-4644 -- Moving each tools JARs into separate lib/ dirs it is quite easy (modifying a single assembly). What we should think is a common bootstrap script for that so each tool does not have to duplicate (and get wrong) such script. I'll open a JIRA for that. -- -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (MAPREDUCE-5890) Support for encrypting Intermediate data and spills in local filesystem
Alejandro Abdelnur created MAPREDUCE-5890: - Summary: Support for encrypting Intermediate data and spills in local filesystem Key: MAPREDUCE-5890 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5890 Project: Hadoop Map/Reduce Issue Type: New Feature Components: security Affects Versions: 2.4.0 Reporter: Alejandro Abdelnur Assignee: Alejandro Abdelnur For some sensitive data, encryption while in flight (network) is not sufficient, it is required that while at rest it should be encrypted. HADOOP-10150 HDFS-6134 bring encryption at rest for data in filesystem using Hadoop FileSystem API. MapReduce intermediate data and spills should also be encrypted while at rest. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (MAPREDUCE-5888) Failed job leaves hung AM after it unregisters
Jason Lowe created MAPREDUCE-5888: - Summary: Failed job leaves hung AM after it unregisters Key: MAPREDUCE-5888 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5888 Project: Hadoop Map/Reduce Issue Type: Bug Components: mr-am Affects Versions: 2.2.0 Reporter: Jason Lowe Assignee: Jason Lowe When a job fails the AM hangs during shutdown. A non-daemon thread pool executor thread prevents the JVM teardown from completing, and the AM lingers on the cluster for the AM expiry interval in the FINISHING state until eventually the RM expires it and kills the container. If application limits on the queue are relatively low (e.g.: small queue or small cluster) this can cause unnecessary delays in resource scheduling on the cluster. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (MAPREDUCE-5885) build/test/test.mapred.spill causes release audit warnings
Jason Lowe created MAPREDUCE-5885: - Summary: build/test/test.mapred.spill causes release audit warnings Key: MAPREDUCE-5885 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5885 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Affects Versions: trunk Reporter: Jason Lowe Multiple unit tests are creating files under hadoop-mapreduce-client-jobclient/build/test/test.mapred.spill which are causing release audit warnings during Jenkins patch precommit builds. In addition to being in a poor location for test output and not cleaning up after the test, there are multiple tests using this location which will cause conflicts if tests are run in parallel. -- This message was sent by Atlassian JIRA (v6.2#6252)
Hadoop-Mapreduce-trunk - Build # 1779 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1779/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 34412 lines...] [INFO] hadoop-mapreduce-client-hs-plugins SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] hadoop-mapreduce .. SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 1:50:12.559s [INFO] Finished at: Wed May 14 22:43:36 UTC 2014 [INFO] Final Memory: 28M/112M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-mapreduce-client-jobclient: There was a timeout or other error in the fork - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :hadoop-mapreduce-client-jobclient Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Updating HDFS-6381 Updating HADOOP-10572 Updating YARN-2042 Updating HDFS-6186 Updating MAPREDUCE-5774 Updating MAPREDUCE-5652 Updating YARN-1751 Updating YARN-1975 Updating YARN-1976 Updating YARN-1957 Updating HDFS-6355 Updating HDFS-6334 Updating HDFS-5522 Updating MAPREDUCE-5814 Updating MAPREDUCE-5888 Updating HADOOP-10585 Updating MAPREDUCE-5821 Updating HDFS-6293 Updating HDFS-6370 Updating HADOOP-10583 Updating HADOOP-10566 Updating HDFS-6230 Updating YARN-1362 Updating YARN-2011 Updating YARN-1861 Updating YARN-1982 Updating YARN-1981 Updating YARN-1962 Updating YARN-2016 Updating YARN-1986 Updating YARN-1987 Updating HDFS-6367 Updating HDFS-6328 Updating HDFS-6305 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
