[jira] [Updated] (MAPREDUCE-7274) Enable to limit running map and reduce tasks when job is running
[ https://issues.apache.org/jira/browse/MAPREDUCE-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated MAPREDUCE-7274: - Attachment: MAPREDUCE-7274.002.patch > Enable to limit running map and reduce tasks when job is running > > > Key: MAPREDUCE-7274 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7274 > Project: Hadoop Map/Reduce > Issue Type: New Feature > Components: mr-am, mrv2 >Reporter: Chengwei Wang >Priority: Major > Attachments: MAPREDUCE-7274.002.patch, MAPREDUCE-7274.patch > > > MRv2 enabled users to control the number of map or reduce tasks running > simultaneously by configuration *_mapreduce.job.running.map.limit_* or > _*mapreduce.job.running.reduce.limit*._ But users can only set limit number > before submitting the job to rm. So, it's meaningful to enable users to set > the limit of running map or reduce tasks when job is running, which can help > users to restrict resource usage of job and give resources to high-priority > job. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7280) MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable
[ https://issues.apache.org/jira/browse/MAPREDUCE-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated MAPREDUCE-7280: Status: Patch Available (was: Open) > MiniMRYarnCluster has hard-coded timeout waiting to start history server, > with no way to disable > > > Key: MAPREDUCE-7280 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7280 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Nick Dimiduk >Assignee: Masatake Iwasaki >Priority: Major > > Over in HBase, we've been chasing intermittent Jenkins failures in tests > involving MiniMRYarnCluster. In the latest incantion, HBASE-24493, we > finally tracked this down to a hard-coded 60sec timeout in MiniMRYarnCluster > on bringing up the JobHistoryServer... a feature we cannot disable for the > purpose of this test. We've had to disable running these tests for the time > being, which is less than ideal. > Would be great for MiniMRYarnCluster to (1) make JHS optional and/or (2) make > this timeout duration configurable. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Moved] (MAPREDUCE-7280) MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable
[ https://issues.apache.org/jira/browse/MAPREDUCE-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki moved HADOOP-17071 to MAPREDUCE-7280: -- Component/s: (was: test) test Key: MAPREDUCE-7280 (was: HADOOP-17071) Project: Hadoop Map/Reduce (was: Hadoop Common) > MiniMRYarnCluster has hard-coded timeout waiting to start history server, > with no way to disable > > > Key: MAPREDUCE-7280 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7280 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Nick Dimiduk >Assignee: Masatake Iwasaki >Priority: Major > > Over in HBase, we've been chasing intermittent Jenkins failures in tests > involving MiniMRYarnCluster. In the latest incantion, HBASE-24493, we > finally tracked this down to a hard-coded 60sec timeout in MiniMRYarnCluster > on bringing up the JobHistoryServer... a feature we cannot disable for the > purpose of this test. We've had to disable running these tests for the time > being, which is less than ideal. > Would be great for MiniMRYarnCluster to (1) make JHS optional and/or (2) make > this timeout duration configurable. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
