[jira] [Created] (HADOOP-9138) Coverage fixing for org.apache.hadoop.mapreduce.jobhistory
Aleksey Gorshkov created HADOOP-9138: Summary: Coverage fixing for org.apache.hadoop.mapreduce.jobhistory Key: HADOOP-9138 URL: https://issues.apache.org/jira/browse/HADOOP-9138 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.23.0, 0.2.0 Reporter: Aleksey Gorshkov Coverage fixing for org.apache.hadoop.mapreduce.jobhistory -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-9138) Coverage fixing for org.apache.hadoop.mapreduce.jobhistory
[ https://issues.apache.org/jira/browse/HADOOP-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Gorshkov resolved HADOOP-9138. -- Resolution: Invalid Coverage fixing for org.apache.hadoop.mapreduce.jobhistory --- Key: HADOOP-9138 URL: https://issues.apache.org/jira/browse/HADOOP-9138 Project: Hadoop Common Issue Type: Test Affects Versions: 0.2.0, 0.23.0 Reporter: Aleksey Gorshkov Should be deleted -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-3420) Recover the deprecated mapred.tasktracker.tasks.maximum
[ https://issues.apache.org/jira/browse/HADOOP-3420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iván de Prado resolved HADOOP-3420. --- Resolution: Won't Fix Seems too old and not very relevant now. Recover the deprecated mapred.tasktracker.tasks.maximum --- Key: HADOOP-3420 URL: https://issues.apache.org/jira/browse/HADOOP-3420 Project: Hadoop Common Issue Type: Improvement Components: conf Affects Versions: 0.16.0, 0.16.1, 0.16.2, 0.16.3, 0.16.4 Reporter: Iván de Prado https://issues.apache.org/jira/browse/HADOOP-1274 replaced the configuration attribute mapred.tasktracker.tasks.maximum with mapred.tasktracker.map.tasks.maximum and mapred.tasktracker.reduce.tasks.maximum because it sometimes make sense to have more mappers than reducers assigned to each node. But deprecating mapred.tasktracker.tasks.maximum could be an issue in some situations. For example, when more than one job is running, reduce tasks + map tasks eat too many resources. For avoid this cases an upper limit of tasks is needed. So I propose to have the configuration parameter mapred.tasktracker.tasks.maximum as a total limit of task. It is compatible with mapred.tasktracker.map.tasks.maximum and mapred.tasktracker.reduce.tasks.maximum. As an example: I have a 8 cores, 4GB, 4 nodes cluster. I want to limit the number of tasks per node to 8. 8 tasks per nodes would use almost 100% cpu and 4 GB of the memory. I have set: mapred.tasktracker.map.tasks.maximum - 8 mapred.tasktracker.reduce.tasks.maximum - 8 1) When running only one Job at the same time, it works smoothly: 8 task average per node, no swapping in nodes, almost 4 GB of memory usage and 100% of CPU usage. 2) When running more than one Job at the same time, it works really bad: 16 tasks average per node, 8 GB usage of memory (4 GB swapped), and a lot of System CPU usage. So, I think that have sense to restore the old attribute mapred.tasktracker.tasks.maximum making it compatible with the new ones. Task trackers could not: - run more than mapred.tasktracker.tasks.maximum tasks per node, - run more than mapred.tasktracker.map.tasks.maximum mappers per node, - run more than mapred.tasktracker.reduce.tasks.maximum reducers per node. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9139) improve script hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh
Ivan A. Veselovsky created HADOOP-9139: -- Summary: improve script hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh Key: HADOOP-9139 URL: https://issues.apache.org/jira/browse/HADOOP-9139 Project: Hadoop Common Issue Type: Bug Reporter: Ivan A. Veselovsky Assignee: Ivan A. Veselovsky Priority: Minor Script hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh is used in internal Kerberos tests to kill started apacheds server. There are 2 problems in the script: 1) it invokes kill even if there are no running apacheds servers; 2) it does not work correctly on all Linux platforms since cut -f4 -d ' ' command relies upon the exact number of spaces in the ps potput, but this number can be different. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9140) Cleanup rpc PB protos
Sanjay Radia created HADOOP-9140: Summary: Cleanup rpc PB protos Key: HADOOP-9140 URL: https://issues.apache.org/jira/browse/HADOOP-9140 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9141) Add support for createNonRecursive to ViewFileSystem
Sandy Ryza created HADOOP-9141: -- Summary: Add support for createNonRecursive to ViewFileSystem Key: HADOOP-9141 URL: https://issues.apache.org/jira/browse/HADOOP-9141 Project: Hadoop Common Issue Type: Bug Components: viewfs Affects Versions: 2.0.2-alpha Reporter: Sandy Ryza Assignee: Sandy Ryza Currently this is thrown: java.io.IOException: createNonRecursive unsupported for this filesystem class org.apache.hadoop.fs.viewfs.ViewFileSystem -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
need patch reviews
https://issues.apache.org/jira/browse/YARN-223 https://issues.apache.org/jira/browse/YARN-210 https://issues.apache.org/jira/browse/YARN-211 https://issues.apache.org/jira/browse/MAPREDUCE-4839 https://issues.apache.org/jira/browse/HADOOP-9088 https://issues.apache.org/jira/browse/MAPREDUCE-4827 https://issues.apache.org/jira/browse/MAPREDUCE-4594 https://issues.apache.org/jira/browse/MAPREDUCE-3968 https://issues.apache.org/jira/browse/HADOOP-9041
