[jira] [Commented] (MAPREDUCE-5873) Measure bw of a single copy call and display the correct aggregated bw

[ https://issues.apache.org/jira/browse/MAPREDUCE-5873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169853#comment-14169853 ] Jason Lowe commented on MAPREDUCE-5873: --- Thanks for updating the patch, Siqi. I

[jira] [Commented] (MAPREDUCE-5970) Provide a boolean switch to enable MR-AM profiling

[ https://issues.apache.org/jira/browse/MAPREDUCE-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169691#comment-14169691 ] Jason Lowe commented on MAPREDUCE-5970: --- Thanks for updating the patch, Gera! T

[jira] [Updated] (MAPREDUCE-6115) TestPipeApplication#testSubmitter fails in trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6115: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6115) TestPipeApplication#testSubmitter fails in trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169437#comment-14169437 ] Jason Lowe commented on MAPREDUCE-6115: --- +1 committing this. > TestPipeApplicat

[jira] [Updated] (MAPREDUCE-6125) TestContainerLauncherImpl sometimes fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6125: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6125) TestContainerLauncherImpl sometimes fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169358#comment-14169358 ] Jason Lowe commented on MAPREDUCE-6125: --- +1 lgtm, committing this. The audit wa

[jira] [Updated] (MAPREDUCE-5958) Wrong reduce task progress if map output is compressed

[ https://issues.apache.org/jira/browse/MAPREDUCE-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5958: -- Target Version/s: 2.6.0 Fix Version/s: (was: 2.4.1) > Wrong reduce task progress

[jira] [Assigned] (MAPREDUCE-5958) Wrong reduce task progress if map output is compressed

[ https://issues.apache.org/jira/browse/MAPREDUCE-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-5958: - Assignee: Emilio Coppa Thanks for the report and patch, Emilio. We just ran across t

[jira] [Updated] (MAPREDUCE-6125) TestContainerLauncherImpl sometimes fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6125: -- Component/s: test Thanks for updating the patch, Mit. Comments: There should be a comment

[jira] [Moved] (MAPREDUCE-6125) TestContainerLauncherImpl sometimes fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-2633 to MAPREDUCE-6125: - Target Version/s: 2.6.0 (was: 2.6.0) Key: MAPREDUCE-

[jira] [Updated] (MAPREDUCE-6029) TestCommitterEventHandler fails in trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6029: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6029) TestCommitterEventHandler fails in trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161896#comment-14161896 ] Jason Lowe commented on MAPREDUCE-6029: --- +1 lgtm. Committing this. > TestCommi

[jira] [Commented] (MAPREDUCE-6029) TestCommitterEventHandler fails in trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161037#comment-14161037 ] Jason Lowe commented on MAPREDUCE-6029: --- Thanks for the update Mit, but the late

[jira] [Commented] (MAPREDUCE-5960) JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14160950#comment-14160950 ] Jason Lowe commented on MAPREDUCE-5960: --- Part of the issue is that Hadoop only a

[jira] [Commented] (MAPREDUCE-5970) Provide a boolean switch to enable MR-AM profiling

[ https://issues.apache.org/jira/browse/MAPREDUCE-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14160941#comment-14160941 ] Jason Lowe commented on MAPREDUCE-5970: --- Thanks for the patch, Gera! Looks good

[jira] [Updated] (MAPREDUCE-6119) Ability to disable node update processing in MR AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6119: -- Attachment: MAPREDUCE-6119.patch It is somewhat similar to the config change in YARN-1996 bu

[jira] [Commented] (MAPREDUCE-6119) Ability to disable node update processing in MR AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158591#comment-14158591 ] Jason Lowe commented on MAPREDUCE-6119: --- After MAPREDUCE-3921 the AM will re-run

[jira] [Created] (MAPREDUCE-6119) Ability to disable node update processing in MR AM

Jason Lowe created MAPREDUCE-6119: - Summary: Ability to disable node update processing in MR AM Key: MAPREDUCE-6119 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6119 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-5873) Measure bw of a single copy call and display the correct aggregated bw

[ https://issues.apache.org/jira/browse/MAPREDUCE-5873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158540#comment-14158540 ] Jason Lowe commented on MAPREDUCE-5873: --- [~jrottinghuis], agree the current meth

[jira] [Commented] (MAPREDUCE-6029) TestCommitterEventHandler fails in trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156927#comment-14156927 ] Jason Lowe commented on MAPREDUCE-6029: --- Thanks for the patch, Mit. I agree wit

[jira] [Commented] (MAPREDUCE-6099) Adding getSplits(JobContext job, List stats) to mapreduce CombineFileInputFormat

[ https://issues.apache.org/jira/browse/MAPREDUCE-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152343#comment-14152343 ] Jason Lowe commented on MAPREDUCE-6099: --- The FileInputFormat.listStatus method i

[jira] [Updated] (MAPREDUCE-6094) TestMRCJCFileInputFormat.testAddInputPath() fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6094: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6094) TestMRCJCFileInputFormat.testAddInputPath() fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151969#comment-14151969 ] Jason Lowe commented on MAPREDUCE-6094: --- +1 lgtm as well. Committing this. > T

[jira] [Resolved] (MAPREDUCE-6114) TestMRCJCFileInputFormat#testAddInputPath fails in trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-6114. --- Resolution: Duplicate Dup of MAPREDUCE-6094. > TestMRCJCFileInputFormat#testAddInputPath

[jira] [Commented] (MAPREDUCE-6107) Job history server becomes unresponsive due to stuck thread in epollWait

[ https://issues.apache.org/jira/browse/MAPREDUCE-6107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146771#comment-14146771 ] Jason Lowe commented on MAPREDUCE-6107: --- Wonder if the DFS client is not timing

[jira] [Updated] (MAPREDUCE-6104) TestJobHistoryParsing.testPartialJob fails in branch-2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6104: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6104) TestJobHistoryParsing.testPartialJob fails in branch-2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146463#comment-14146463 ] Jason Lowe commented on MAPREDUCE-6104: --- +1 lgtm, as the exiting timeout value w

[jira] [Updated] (MAPREDUCE-6095) Enable DistributedCache for uber-mode Jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6095: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6095) Enable DistributedCache for uber-mode Jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143296#comment-14143296 ] Jason Lowe commented on MAPREDUCE-6095: --- +1 lgtm. Committing this. > Enable Di

[jira] [Commented] (MAPREDUCE-6095) Enable DistributedCache for uber-mode Jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141353#comment-14141353 ] Jason Lowe commented on MAPREDUCE-6095: --- I think the "cannot stat" error is beni

[jira] [Updated] (MAPREDUCE-6091) YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view

[ https://issues.apache.org/jira/browse/MAPREDUCE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6091: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6091) YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view

[ https://issues.apache.org/jira/browse/MAPREDUCE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141207#comment-14141207 ] Jason Lowe commented on MAPREDUCE-6091: --- Thanks for the report and patch, Sangji

[jira] [Commented] (MAPREDUCE-6095) Enable DistributedCache for uber-mode Jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14140810#comment-14140810 ] Jason Lowe commented on MAPREDUCE-6095: --- Thanks for the report and patch, Gera!

[jira] [Resolved] (MAPREDUCE-6098) org.apache.hadoop.mapreduce.lib.input.TestMRCJCFileInputFormat intermittently failed in trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-6098. --- Resolution: Duplicate This is a duplicate of MAPREDUCE-6094. > org.apache.hadoop.mapreduc

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5891: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139577#comment-14139577 ] Jason Lowe commented on MAPREDUCE-5891: --- +1 lgtm. Committing this. > Improved

[jira] [Updated] (MAPREDUCE-6090) mapred hsadmin getGroups fails to connect in some cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6090: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6090) mapred hsadmin getGroups fails to connect in some cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139494#comment-14139494 ] Jason Lowe commented on MAPREDUCE-6090: --- +1 lgtm. Committing this. > mapred h

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139364#comment-14139364 ] Jason Lowe commented on MAPREDUCE-5891: --- Thanks for updating the patch, Junping.

[jira] [Commented] (MAPREDUCE-6090) mapred hsadmin getGroups fails to connect in some cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135542#comment-14135542 ] Jason Lowe commented on MAPREDUCE-6090: --- Thanks for the report and patch, Robert

[jira] [Commented] (MAPREDUCE-6082) Excessive logging by org.apache.hadoop.util.Progress when value is NaN

[ https://issues.apache.org/jira/browse/MAPREDUCE-6082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14130573#comment-14130573 ] Jason Lowe commented on MAPREDUCE-6082: --- +1 lgtm as well. Commiting this. > E

[jira] [Updated] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6070: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14130226#comment-14130226 ] Jason Lowe commented on MAPREDUCE-6070: --- +1 lgtm. Committing this. > yarn.app.

[jira] [Updated] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6075: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129219#comment-14129219 ] Jason Lowe commented on MAPREDUCE-6075: --- Thanks for the reviews, Tsuyoshi and Da

[jira] [Commented] (MAPREDUCE-6081) MapReduce should take cpu into account when doing headroom calculations

[ https://issues.apache.org/jira/browse/MAPREDUCE-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14128889#comment-14128889 ] Jason Lowe commented on MAPREDUCE-6081: --- Duplicate of MAPREDUCE-5279? > MapRedu

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127309#comment-14127309 ] Jason Lowe commented on MAPREDUCE-5891: --- bq. a) dynamic MR to YARN query, given

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127043#comment-14127043 ] Jason Lowe commented on MAPREDUCE-5891: --- Thanks for updating the patch, Junping,

[jira] [Updated] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6075: -- Status: Patch Available (was: Open) > HistoryServerFileSystemStateStore can create zero-len

[jira] [Updated] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6075: -- Attachment: MAPREDUCE-6075.patch Patch to call close() before IOUtils.cleanup so we don't si

[jira] [Created] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

Jason Lowe created MAPREDUCE-6075: - Summary: HistoryServerFileSystemStateStore can create zero-length files Key: MAPREDUCE-6075 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6075 Project: Hadoo

[jira] [Commented] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122970#comment-14122970 ] Jason Lowe commented on MAPREDUCE-6070: --- Do we want to put these details in the

[jira] [Updated] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6071: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122922#comment-14122922 ] Jason Lowe commented on MAPREDUCE-6071: --- +1 lgtm. Committing this. > JobImpl#m

[jira] [Updated] (MAPREDUCE-5279) Jobs can deadlock if headroom is limited by cpu instead of memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5279: -- Priority: Critical (was: Major) Target Version/s: 2.6.0 Summary: Jo

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118727#comment-14118727 ] Jason Lowe commented on MAPREDUCE-5891: --- Thanks for updating the patch, Junping.

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115958#comment-14115958 ] Jason Lowe commented on MAPREDUCE-5891: --- Thanks for updating the patch! Comment

[jira] [Updated] (MAPREDUCE-5931) Validate SleepJob command line parameters

[ https://issues.apache.org/jira/browse/MAPREDUCE-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5931: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-5931) Validate SleepJob command line parameters

[ https://issues.apache.org/jira/browse/MAPREDUCE-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115708#comment-14115708 ] Jason Lowe commented on MAPREDUCE-5931: --- The test failures are unrelated bind ex

[jira] [Commented] (MAPREDUCE-6057) Remove obsolete entries from mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113733#comment-14113733 ] Jason Lowe commented on MAPREDUCE-6057: --- Please be careful with this, as the ent

[jira] [Commented] (MAPREDUCE-5931) Validate SleepJob command line parameters

[ https://issues.apache.org/jira/browse/MAPREDUCE-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112604#comment-14112604 ] Jason Lowe commented on MAPREDUCE-5931: --- Thanks for updating the patch, Gera! A

[jira] [Commented] (MAPREDUCE-6043) Reducer-preemption does not kick in

[ https://issues.apache.org/jira/browse/MAPREDUCE-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112367#comment-14112367 ] Jason Lowe commented on MAPREDUCE-6043: --- For the first case you described, the A

[jira] [Updated] (MAPREDUCE-5885) build/test/test.mapred.spill causes release audit warnings

[ https://issues.apache.org/jira/browse/MAPREDUCE-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5885: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-5885) build/test/test.mapred.spill causes release audit warnings

[ https://issues.apache.org/jira/browse/MAPREDUCE-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112317#comment-14112317 ] Jason Lowe commented on MAPREDUCE-5885: --- bq. I guess they think there will never

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111538#comment-14111538 ] Jason Lowe commented on MAPREDUCE-5891: --- Thanks for updating the patch, Junping.

[jira] [Commented] (MAPREDUCE-4818) Easier identification of tasks that timeout during localization

[ https://issues.apache.org/jira/browse/MAPREDUCE-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109102#comment-14109102 ] Jason Lowe commented on MAPREDUCE-4818: --- It introduces a slight amount of extra

[jira] [Commented] (MAPREDUCE-5956) MapReduce AM should not use maxAttempts to determine if this is the last retry

[ https://issues.apache.org/jira/browse/MAPREDUCE-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107023#comment-14107023 ] Jason Lowe commented on MAPREDUCE-5956: --- When it comes to leaking staging direct

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107011#comment-14107011 ] Jason Lowe commented on MAPREDUCE-5891: --- bq. The reason I choose to do two thing

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106119#comment-14106119 ] Jason Lowe commented on MAPREDUCE-5891: --- Thanks for posting a prototype, Junping

[jira] [Commented] (MAPREDUCE-6039) mapreduce.v2.hs.webapp.dao.TestJobInfo is using old name of job history file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105368#comment-14105368 ] Jason Lowe commented on MAPREDUCE-6039: --- Sure, we can update it I guess. Howeve

[jira] [Commented] (MAPREDUCE-4818) Easier identification of tasks that timeout during localization

[ https://issues.apache.org/jira/browse/MAPREDUCE-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102893#comment-14102893 ] Jason Lowe commented on MAPREDUCE-4818: --- Just thinking out loud: I wonder if we

[jira] [Commented] (MAPREDUCE-6039) mapreduce.v2.hs.webapp.dao.TestJobInfo is using old name of job history file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102333#comment-14102333 ] Jason Lowe commented on MAPREDUCE-6039: --- The name is still valid, as the history

[jira] [Assigned] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-5891: - Assignee: Junping Du Thanks, Junping! I've been busy with other things and haven't s

[jira] [Updated] (MAPREDUCE-5885) build/test/test.mapred.spill causes release audit warnings

[ https://issues.apache.org/jira/browse/MAPREDUCE-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5885: -- Status: Open (was: Patch Available) Thanks for the patch, Chen! Some comments: We should

[jira] [Updated] (MAPREDUCE-6036) TestJobEndNotifier fails intermittently in branch-2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6036: -- Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags: Re

[jira] [Commented] (MAPREDUCE-6036) TestJobEndNotifier fails intermittently in branch-2

[ https://issues.apache.org/jira/browse/MAPREDUCE-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14100977#comment-14100977 ] Jason Lowe commented on MAPREDUCE-6036: --- +1 lgtm. Committing this. > TestJobEn

[jira] [Updated] (MAPREDUCE-5878) some standard JDK APIs are not part of system classes defaults

[ https://issues.apache.org/jira/browse/MAPREDUCE-5878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5878: -- Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags: Re

[jira] [Commented] (MAPREDUCE-5878) some standard JDK APIs are not part of system classes defaults

[ https://issues.apache.org/jira/browse/MAPREDUCE-5878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14097886#comment-14097886 ] Jason Lowe commented on MAPREDUCE-5878: --- +1 lgtm. Committing this. > some stan

[jira] [Updated] (MAPREDUCE-6010) HistoryServerFileSystemStateStore fails to update tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6010: -- Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags: Re

[jira] [Commented] (MAPREDUCE-6010) HistoryServerFileSystemStateStore fails to update tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14097104#comment-14097104 ] Jason Lowe commented on MAPREDUCE-6010: --- Thanks for the review, Daryn! Committi

[jira] [Commented] (MAPREDUCE-4818) Easier identification of tasks that timeout during localization

[ https://issues.apache.org/jira/browse/MAPREDUCE-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096088#comment-14096088 ] Jason Lowe commented on MAPREDUCE-4818: --- Not sure changing the long-standing mea

[jira] [Updated] (MAPREDUCE-6021) MR AM should have working directory in LD_LIBRARY_PATH

[ https://issues.apache.org/jira/browse/MAPREDUCE-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6021: -- Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags: Re

[jira] [Commented] (MAPREDUCE-6021) MR AM should have working directory in LD_LIBRARY_PATH

[ https://issues.apache.org/jira/browse/MAPREDUCE-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089743#comment-14089743 ] Jason Lowe commented on MAPREDUCE-6021: --- Thanks for the review, Daryn! Committi

[jira] [Updated] (MAPREDUCE-6014) New task status field in task attempts table can lead to an empty web page

[ https://issues.apache.org/jira/browse/MAPREDUCE-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6014: -- Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags: Re

[jira] [Commented] (MAPREDUCE-6014) New task status field in task attempts table can lead to an empty web page

[ https://issues.apache.org/jira/browse/MAPREDUCE-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086849#comment-14086849 ] Jason Lowe commented on MAPREDUCE-6014: --- +1 lgtm as well. Committing this. > N

[jira] [Updated] (MAPREDUCE-6022) map_input_file is missing from streaming job environment

[ https://issues.apache.org/jira/browse/MAPREDUCE-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6022: -- Attachment: MAPREDUCE-6022.patch Configuration is a touchy thing, so here's a prototype pat

[jira] [Commented] (MAPREDUCE-6022) map_input_file is missing from streaming job environment

[ https://issues.apache.org/jira/browse/MAPREDUCE-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14082800#comment-14082800 ] Jason Lowe commented on MAPREDUCE-6022: --- I believe this was caused by HADOOP-101

[jira] [Created] (MAPREDUCE-6022) map_input_file is missing from streaming job environment

Jason Lowe created MAPREDUCE-6022: - Summary: map_input_file is missing from streaming job environment Key: MAPREDUCE-6022 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6022 Project: Hadoop Map/R

[jira] [Updated] (MAPREDUCE-6021) MR AM should have working directory in LD_LIBRARY_PATH

[ https://issues.apache.org/jira/browse/MAPREDUCE-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6021: -- Attachment: MAPREDUCE-6021-v2.patch Thanks for the review, Daryn! I updated the patch to m

[jira] [Updated] (MAPREDUCE-6021) MR AM should have working directory in LD_LIBRARY_PATH

[ https://issues.apache.org/jira/browse/MAPREDUCE-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6021: -- Summary: MR AM should have working directory in LD_LIBRARY_PATH (was: MR AM should add wor

[jira] [Updated] (MAPREDUCE-6021) MR AM should add working directory to LD_LIBRARY_PATH

[ https://issues.apache.org/jira/browse/MAPREDUCE-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6021: -- Assignee: Jason Lowe Target Version/s: 2.6.0 Status: Patch Availab

[jira] [Updated] (MAPREDUCE-6021) MR AM should add working directory to LD_LIBRARY_PATH

[ https://issues.apache.org/jira/browse/MAPREDUCE-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6021: -- Attachment: MAPREDUCE-6021.patch Patch so YARNRunner adds {{PWD}} to the front of LD_LIBRAR

[jira] [Created] (MAPREDUCE-6021) MR AM should add working directory to LD_LIBRARY_PATH

Jason Lowe created MAPREDUCE-6021: - Summary: MR AM should add working directory to LD_LIBRARY_PATH Key: MAPREDUCE-6021 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6021 Project: Hadoop Map/Redu

[jira] [Updated] (MAPREDUCE-6010) HistoryServerFileSystemStateStore fails to update tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6010: -- Assignee: Jason Lowe Status: Patch Available (was: Open) > HistoryServerFileSystemSt

[jira] [Updated] (MAPREDUCE-6010) HistoryServerFileSystemStateStore fails to update tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6010: -- Attachment: MAPREDUCE-6010.patch The previous unit tests didn't catch the update failure be

[jira] [Commented] (MAPREDUCE-6011) Improve history server behavior during a recovery error

[ https://issues.apache.org/jira/browse/MAPREDUCE-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076493#comment-14076493 ] Jason Lowe commented on MAPREDUCE-6011: --- Sample error where a bad token state fa

[jira] [Created] (MAPREDUCE-6011) Improve history server behavior during a recovery error

Jason Lowe created MAPREDUCE-6011: - Summary: Improve history server behavior during a recovery error Key: MAPREDUCE-6011 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6011 Project: Hadoop Map/Re

[jira] [Commented] (MAPREDUCE-6010) HistoryServerFileSystemStateStore fails to update tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076324#comment-14076324 ] Jason Lowe commented on MAPREDUCE-6010: --- Example exception during a token update

[jira] [Created] (MAPREDUCE-6010) HistoryServerFileSystemStateStore fails to update tokens

Jason Lowe created MAPREDUCE-6010: - Summary: HistoryServerFileSystemStateStore fails to update tokens Key: MAPREDUCE-6010 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6010 Project: Hadoop Map/R

[jira] [Commented] (MAPREDUCE-6002) MR task should prevent report error to AM when process is shutting down

[ https://issues.apache.org/jira/browse/MAPREDUCE-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074398#comment-14074398 ] Jason Lowe commented on MAPREDUCE-6002: --- bq. In this extreme case, the exception

<    4   5   6   7   8   9   10   11   12   13   >