[jira] [Updated] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7053: -- Attachment: MAPREDUCE-7053-branch-2.001.patch > Timed out tasks can fail to produce thread

[jira] [Commented] (MAPREDUCE-7052) TestFixedLengthInputFormat#testFormatCompressedIn is flaky

[ https://issues.apache.org/jira/browse/MAPREDUCE-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366242#comment-16366242 ] Jason Lowe commented on MAPREDUCE-7052: --- Thanks for updating the patch! I agree this is a much

[jira] [Updated] (MAPREDUCE-7054) Configurable task attempt listener bind port range

[ https://issues.apache.org/jira/browse/MAPREDUCE-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7054: -- Summary: Configurable task attempt listener bind port range (was: Yarn task attempt

[jira] [Moved] (MAPREDUCE-7054) Yarn task attempt listener bind port range

[ https://issues.apache.org/jira/browse/MAPREDUCE-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-7938 to MAPREDUCE-7054: - Affects Version/s: (was: 2.7.5) 2.7.5

[jira] [Updated] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7053: -- Status: Patch Available (was: Open) Yeah, this is yet another latent bug that was exposed

[jira] [Updated] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7053: -- Attachment: MAPREDUCE-7053.001.patch > Timed out tasks can fail to produce thread dump >

[jira] [Assigned] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7053: - Assignee: Jason Lowe > Timed out tasks can fail to produce thread dump >

[jira] [Commented] (MAPREDUCE-7052) TestFixedLengthInputFormat#testFormatCompressedIn is flaky

[ https://issues.apache.org/jira/browse/MAPREDUCE-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364557#comment-16364557 ] Jason Lowe commented on MAPREDUCE-7052: --- Thanks for the report and the patch! The unit test is

[jira] [Commented] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364487#comment-16364487 ] Jason Lowe commented on MAPREDUCE-7053: --- The easiest "fix" for this issue is to have the AM

[jira] [Commented] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364484#comment-16364484 ] Jason Lowe commented on MAPREDUCE-7053: --- This is triggered by MAPREDUCE-5124. Before

[jira] [Created] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

Jason Lowe created MAPREDUCE-7053: - Summary: Timed out tasks can fail to produce thread dump Key: MAPREDUCE-7053 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7053 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-7048) Uber AM can crash due to unknown task in statusUpdate

[ https://issues.apache.org/jira/browse/MAPREDUCE-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7048: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.6

[jira] [Updated] (MAPREDUCE-7048) Uber AM can crash due to unknown task in statusUpdate

[ https://issues.apache.org/jira/browse/MAPREDUCE-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7048: -- Summary: Uber AM can crash due to unknown task in statusUpdate (was: AM can still crash

[jira] [Commented] (MAPREDUCE-7048) AM can still crash after MAPREDUCE-7020

[ https://issues.apache.org/jira/browse/MAPREDUCE-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361312#comment-16361312 ] Jason Lowe commented on MAPREDUCE-7048: --- +1 for the branch-2.7 patch as well. The ASF,

[jira] [Commented] (MAPREDUCE-7048) AM can still crash after MAPREDUCE-7020

[ https://issues.apache.org/jira/browse/MAPREDUCE-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361064#comment-16361064 ] Jason Lowe commented on MAPREDUCE-7048: --- Thanks for the patches! +1 for the branch-2 patch,

[jira] [Updated] (MAPREDUCE-7048) AM can still crash after MAPREDUCE-7020

[ https://issues.apache.org/jira/browse/MAPREDUCE-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7048: -- Attachment: MAPREDUCE-7048-branch-2.7.01.patch > AM can still crash after MAPREDUCE-7020 >

[jira] [Commented] (MAPREDUCE-7048) AM can still crash after MAPREDUCE-7020

[ https://issues.apache.org/jira/browse/MAPREDUCE-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358744#comment-16358744 ] Jason Lowe commented on MAPREDUCE-7048: --- Thanks for updating the patch! +1 lgtm. Could you

[jira] [Commented] (MAPREDUCE-7048) AM can still crash after MAPREDUCE-7020

[ https://issues.apache.org/jira/browse/MAPREDUCE-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357235#comment-16357235 ] Jason Lowe commented on MAPREDUCE-7048: --- Thanks for updating the patch! Now that we're looking

[jira] [Commented] (MAPREDUCE-7048) AM can still crash after MAPREDUCE-7020

[ https://issues.apache.org/jira/browse/MAPREDUCE-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355625#comment-16355625 ] Jason Lowe commented on MAPREDUCE-7048: --- Thanks for the report and patch! Yep, we missed a

[jira] [Resolved] (MAPREDUCE-7049) Testcase TestMRJobs#testJobClassloaderWithCustomClasses fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-7049. --- Resolution: Duplicate > Testcase TestMRJobs#testJobClassloaderWithCustomClasses fails >

[jira] [Commented] (MAPREDUCE-7049) Testcase TestMRJobs#testJobClassloaderWithCustomClasses fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354006#comment-16354006 ] Jason Lowe commented on MAPREDUCE-7049: --- I think this is a duplicate of YARN-7876. On latest

[jira] [Commented] (MAPREDUCE-7033) Map outputs implicitly rely on permissive umask for shuffle

[ https://issues.apache.org/jira/browse/MAPREDUCE-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345365#comment-16345365 ] Jason Lowe commented on MAPREDUCE-7033: --- Added a unit test. > Map outputs implicitly rely on

[jira] [Updated] (MAPREDUCE-7033) Map outputs implicitly rely on permissive umask for shuffle

[ https://issues.apache.org/jira/browse/MAPREDUCE-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7033: -- Attachment: MAPREDUCE-7033.002.patch > Map outputs implicitly rely on permissive umask for

[jira] [Updated] (MAPREDUCE-7020) Task timeout in uber mode can crash AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7020: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.6

[jira] [Commented] (MAPREDUCE-7020) Task timeout in uber mode can crash AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341626#comment-16341626 ] Jason Lowe commented on MAPREDUCE-7020: --- The findbug, whitespace, and ASF license warnings are

[jira] [Updated] (MAPREDUCE-7022) Fast fail rogue jobs based on task scratch dir size

[ https://issues.apache.org/jira/browse/MAPREDUCE-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7022: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status:

[jira] [Comment Edited] (MAPREDUCE-7022) Fast fail rogue jobs based on task scratch dir size

[ https://issues.apache.org/jira/browse/MAPREDUCE-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341561#comment-16341561 ] Jason Lowe edited comment on MAPREDUCE-7022 at 1/26/18 8:40 PM: Thanks

[jira] [Assigned] (MAPREDUCE-7022) Fast fail rogue jobs based on task scratch dir size

[ https://issues.apache.org/jira/browse/MAPREDUCE-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7022: - Assignee: Johan Gustavsson (was: Jason Lowe) Thanks for updating the patch! +1 for

[jira] [Commented] (MAPREDUCE-7020) Task timeout in uber mode can crash AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341525#comment-16341525 ] Jason Lowe commented on MAPREDUCE-7020: --- +1 for the branch-2, branch-2.9 and branch-2.8 patches.

[jira] [Updated] (MAPREDUCE-7020) Task timeout in uber mode can crash AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7020: -- Attachment: MAPREDUCE-7020-branch-2.7.01.patch > Task timeout in uber mode can crash AM >

[jira] [Updated] (MAPREDUCE-7033) Map outputs implicitly rely on permissive umask for shuffle

[ https://issues.apache.org/jira/browse/MAPREDUCE-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7033: -- Status: Patch Available (was: Open) Attaching a patch that updates the permissions of the

[jira] [Updated] (MAPREDUCE-7033) Map outputs implicitly rely on permissive umask for shuffle

[ https://issues.apache.org/jira/browse/MAPREDUCE-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7033: -- Attachment: MAPREDUCE-7033.001.patch > Map outputs implicitly rely on permissive umask for

[jira] [Assigned] (MAPREDUCE-7033) Map outputs implicitly rely on permissive umask for shuffle

[ https://issues.apache.org/jira/browse/MAPREDUCE-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7033: - Assignee: Jason Lowe Priority: Critical (was: Major) Target

[jira] [Commented] (MAPREDUCE-7020) Task timeout in uber mode can crash AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338385#comment-16338385 ] Jason Lowe commented on MAPREDUCE-7020: --- Thanks for updating the patch! bq. Do you think we

[jira] [Updated] (MAPREDUCE-7015) Possible race condition in JHS if the job is not loaded

[ https://issues.apache.org/jira/browse/MAPREDUCE-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7015: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.10.0

[jira] [Commented] (MAPREDUCE-7015) Possible race condition in JHS if the job is not loaded

[ https://issues.apache.org/jira/browse/MAPREDUCE-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338185#comment-16338185 ] Jason Lowe commented on MAPREDUCE-7015: --- Apologies for the delay. +1, the latest patch lgtm.

[jira] [Commented] (MAPREDUCE-7020) Task timeout in uber mode can crash AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332531#comment-16332531 ] Jason Lowe commented on MAPREDUCE-7020: --- Thanks! That is what I was originally thinking, but

[jira] [Updated] (MAPREDUCE-7029) FileOutputCommitter is slow on filesystems lacking recursive delete

[ https://issues.apache.org/jira/browse/MAPREDUCE-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7029: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.10.0

[jira] [Updated] (MAPREDUCE-7029) FileOutputCommitter is slow on filesystems lacking recursive delete

[ https://issues.apache.org/jira/browse/MAPREDUCE-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7029: -- Summary: FileOutputCommitter is slow on filesystems lacking recursive delete (was:

[jira] [Updated] (MAPREDUCE-7029) FileOutputCommitter#commitTask should delete task directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7029: -- Release Note: MapReduce jobs that output to filesystems without direct support for

[jira] [Commented] (MAPREDUCE-7029) FileOutputCommitter#commitTask should delete task directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16327841#comment-16327841 ] Jason Lowe commented on MAPREDUCE-7029: --- Thanks for updating the patch!  +1 for the trunk

[jira] [Assigned] (MAPREDUCE-7029) FileOutputCommitter#commitTask should delete task directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7029: - Assignee: Karthik Palaniappan > FileOutputCommitter#commitTask should delete task

[jira] [Updated] (MAPREDUCE-7029) FileOutputCommitter#commitTask should delete task directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7029: -- Attachment: MAPREDUCE-7029-branch-2.005.patch > FileOutputCommitter#commitTask should

[jira] [Commented] (MAPREDUCE-7020) Task timeout in uber mode can crash AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16327391#comment-16327391 ] Jason Lowe commented on MAPREDUCE-7020: --- Checking for a specific exception would fix this

[jira] [Commented] (MAPREDUCE-7037) Possible dead code in CombineFileInputFormat

[ https://issues.apache.org/jira/browse/MAPREDUCE-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16327299#comment-16327299 ] Jason Lowe commented on MAPREDUCE-7037: --- The array itself is not used, but the act of filling in

[jira] [Moved] (MAPREDUCE-7037) Possible dead code in CombineFileInputFormat

[ https://issues.apache.org/jira/browse/MAPREDUCE-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved HADOOP-15173 to MAPREDUCE-7037: Key: MAPREDUCE-7037 (was: HADOOP-15173) Project:

[jira] [Assigned] (MAPREDUCE-7022) Fast fail rogue jobs based on task scratch dir size

[ https://issues.apache.org/jira/browse/MAPREDUCE-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7022: - Assignee: Johan Gustavsson (was: Jason Lowe) Thanks for updating the patch! The

[jira] [Created] (MAPREDUCE-7033) Map outputs implicitly rely on permissive umask for shuffle

Jason Lowe created MAPREDUCE-7033: - Summary: Map outputs implicitly rely on permissive umask for shuffle Key: MAPREDUCE-7033 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7033 Project: Hadoop

[jira] [Commented] (MAPREDUCE-7020) Task timeout in uber mode can crash AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16322707#comment-16322707 ] Jason Lowe commented on MAPREDUCE-7020: --- Thinking about this a bit more, I'm not sure how

[jira] [Updated] (MAPREDUCE-7020) Task timeout in uber mode can crash AM

[ https://issues.apache.org/jira/browse/MAPREDUCE-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7020: -- Affects Version/s: 2.7.6 2.8.4 2.9.1

[jira] [Commented] (MAPREDUCE-7029) FileOutputCommitter#commitTask should delete task directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16322539#comment-16322539 ] Jason Lowe commented on MAPREDUCE-7029: --- Thanks for the patch! Overall looks good to me. It

[jira] [Commented] (MAPREDUCE-7015) Possible race condition in JHS if the job is not loaded

[ https://issues.apache.org/jira/browse/MAPREDUCE-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321081#comment-16321081 ] Jason Lowe commented on MAPREDUCE-7015: --- Thanks for the patch! CountDownLatch seems like a

[jira] [Updated] (MAPREDUCE-7028) Concurrent task progress updates causing NPE in Application Master

[ https://issues.apache.org/jira/browse/MAPREDUCE-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7028: -- Resolution: Fixed Fix Version/s: 2.7.6 2.8.4

[jira] [Updated] (MAPREDUCE-7028) Concurrent task progress updates causing NPE in Application Master

[ https://issues.apache.org/jira/browse/MAPREDUCE-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7028: -- Target Version/s: 3.1.0, 3.0.1, 2.10.0, 2.9.1, 2.8.4, 2.7.6 Thanks for updating the patch!

[jira] [Commented] (MAPREDUCE-7015) Possible race condition in JHS if the job is not loaded

[ https://issues.apache.org/jira/browse/MAPREDUCE-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309767#comment-16309767 ] Jason Lowe commented on MAPREDUCE-7015: --- IIRC one reason the moveToDoneExecutor was added was to

[jira] [Commented] (MAPREDUCE-7028) Concurrent task progress updates causing NPE in Application Master

[ https://issues.apache.org/jira/browse/MAPREDUCE-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306803#comment-16306803 ] Jason Lowe commented on MAPREDUCE-7028: --- bq. This pattern does not ensure that the updates keep

[jira] [Commented] (MAPREDUCE-7028) Concurrent task progress updates causing NPE in Application Master

[ https://issues.apache.org/jira/browse/MAPREDUCE-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298960#comment-16298960 ] Jason Lowe commented on MAPREDUCE-7028: --- Thanks for the report and the patch! The unit test

[jira] [Assigned] (MAPREDUCE-7022) Fast fail rogue jobs based on task scratch dir size

[ https://issues.apache.org/jira/browse/MAPREDUCE-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7022: - Assignee: Johan Gustavsson Thanks for the patch! Comments on the approach: This is

[jira] [Updated] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5124: -- Fix Version/s: 2.7.6 I committed this to branch-2.7 with a corresponding CHANGES.txt entry.

[jira] [Resolved] (MAPREDUCE-7019) java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 2

[ https://issues.apache.org/jira/browse/MAPREDUCE-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-7019. --- Resolution: Invalid Closing this since I believe the error is coming from the program

[jira] [Commented] (MAPREDUCE-7019) java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 2

[ https://issues.apache.org/jira/browse/MAPREDUCE-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278748#comment-16278748 ] Jason Lowe commented on MAPREDUCE-7019: --- This error implies the process being invoked by the

[jira] [Updated] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5124: -- Fix Version/s: (was: 2.7.5) > AM lacks flow control for task events >

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275375#comment-16275375 ] Jason Lowe commented on MAPREDUCE-5124: --- Sorry, Konstantin, I should have checked with you

[jira] [Updated] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5124: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.4

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274819#comment-16274819 ] Jason Lowe commented on MAPREDUCE-5124: --- The ASF license errors are not related. The unit test

[jira] [Updated] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5124: -- Attachment: MAPREDUCE-5124-branch-2.7.002.patch +1 for the branch-2.8 patch as well. The

[jira] [Updated] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5124: -- Attachment: MAPREDUCE-5124-branch-2.8.002.patch Thanks for updating the patches! +1 for

[jira] [Updated] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5124: -- Attachment: MAPREDUCE-5124-branch-2.8.001.patch Manually kicking the Jenkins build worked.

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267024#comment-16267024 ] Jason Lowe commented on MAPREDUCE-5124: --- Thanks for updating the patch! +1 lgtm. bq. Do you

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263439#comment-16263439 ] Jason Lowe commented on MAPREDUCE-5124: --- Thanks for updating the patch! Looks good overall. I

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261063#comment-16261063 ] Jason Lowe commented on MAPREDUCE-5124: --- I also kicked Jenkins which mysteriously did not

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261050#comment-16261050 ] Jason Lowe commented on MAPREDUCE-5124: --- Thanks for updating the patch! Sorry for the delay.

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252724#comment-16252724 ] Jason Lowe commented on MAPREDUCE-5124: --- Thanks for updating the patch! The approach looks good

[jira] [Commented] (MAPREDUCE-7007) Add LOG.isDebugEnabled() guard for each LOG.debug()

[ https://issues.apache.org/jira/browse/MAPREDUCE-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250286#comment-16250286 ] Jason Lowe commented on MAPREDUCE-7007: --- Migrating hadoop-mapreduce-client-jobclient to SLF4J is

[jira] [Commented] (MAPREDUCE-7007) Add LOG.isDebugEnabled() guard for each LOG.debug()

[ https://issues.apache.org/jira/browse/MAPREDUCE-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250235#comment-16250235 ] Jason Lowe commented on MAPREDUCE-7007: --- I would think this would be better addressed with the

[jira] [Commented] (MAPREDUCE-6633) AM should retry map attempts if the reduce task encounters commpression related errors.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248044#comment-16248044 ] Jason Lowe commented on MAPREDUCE-6633: --- If this is very repeatable and seemingly tied only to a

[jira] [Commented] (MAPREDUCE-6633) AM should retry map attempts if the reduce task encounters commpression related errors.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247954#comment-16247954 ] Jason Lowe commented on MAPREDUCE-6633: --- If you're getting the same stacktrace during shuffle

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247743#comment-16247743 ] Jason Lowe commented on MAPREDUCE-5124: --- bq. Are you sure we can't just replace the status

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247608#comment-16247608 ] Jason Lowe commented on MAPREDUCE-5124: --- Thanks for the patch! I'm not a fan of

[jira] [Commented] (MAPREDUCE-6633) AM should retry map attempts if the reduce task encounters commpression related errors.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247511#comment-16247511 ] Jason Lowe commented on MAPREDUCE-6633: --- If upgrading to get the fix isn't an option (i.e.: move

[jira] [Comment Edited] (MAPREDUCE-6659) Mapreduce App master waits long to kill containers on lost nodes.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243990#comment-16243990 ] Jason Lowe edited comment on MAPREDUCE-6659 at 11/8/17 2:08 PM: Ah,

[jira] [Commented] (MAPREDUCE-6659) Mapreduce App master waits long to kill containers on lost nodes.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243990#comment-16243990 ] Jason Lowe commented on MAPREDUCE-6659: --- Ah, looks like this would have "just worked" if the AM

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236485#comment-16236485 ] Jason Lowe commented on MAPREDUCE-5124: --- bq. So either we completely drop this approach or

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212598#comment-16212598 ] Jason Lowe commented on MAPREDUCE-5124: --- bq. Could you give me the location of the code that

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211818#comment-16211818 ] Jason Lowe commented on MAPREDUCE-5124: --- As you point out, it's probably going to be bad for the

[jira] [Commented] (MAPREDUCE-6987) JHS Log Scanner and Cleaner blocked

[ https://issues.apache.org/jira/browse/MAPREDUCE-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211769#comment-16211769 ] Jason Lowe commented on MAPREDUCE-6987: --- Thanks for the report! Is this a problem in 2.8? If

[jira] [Assigned] (MAPREDUCE-6659) Mapreduce App master waits long to kill containers on lost nodes.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-6659: - Assignee: Nicolas Fraison (was: Jun Gong) This has been sitting idle, so I'm

[jira] [Updated] (MAPREDUCE-6982) Containers on lost nodes are considered failed after a too long time.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6982: -- Resolution: Duplicate Status: Resolved (was: Patch Available) > Containers on lost

[jira] [Commented] (MAPREDUCE-6982) Containers on lost nodes are considered failed after a too long time.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203547#comment-16203547 ] Jason Lowe commented on MAPREDUCE-6982: --- This is a duplicate of MAPREDUCE-6659. My apologies

[jira] [Commented] (MAPREDUCE-6978) MR task counters deserialized through RPC throws OutOfBoundsException if Counter enum class version not match

[ https://issues.apache.org/jira/browse/MAPREDUCE-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198761#comment-16198761 ] Jason Lowe commented on MAPREDUCE-6978: --- Sure, there's plenty of ways to fix the problem if we

[jira] [Commented] (MAPREDUCE-6978) MR task counters deserialized through RPC throws OutOfBoundsException if Counter enum class version not match

[ https://issues.apache.org/jira/browse/MAPREDUCE-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197399#comment-16197399 ] Jason Lowe commented on MAPREDUCE-6978: --- This is a duplicate of MAPREDUCE-6922. Hadoop does not

[jira] [Resolved] (MAPREDUCE-6978) MR task counters deserialized through RPC throws OutOfBoundsException if Counter enum class version not match

[ https://issues.apache.org/jira/browse/MAPREDUCE-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-6978. --- Resolution: Duplicate > MR task counters deserialized through RPC throws

[jira] [Commented] (MAPREDUCE-6973) Comment refers to "_done" file instead of "_SUCCESS" file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190261#comment-16190261 ] Jason Lowe commented on MAPREDUCE-6973: --- Hmm Jenkins isn't picking up and commenting on the pull

[jira] [Commented] (MAPREDUCE-6973) Comment refers to "_done" file instead of "_SUCCESS" file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188505#comment-16188505 ] Jason Lowe commented on MAPREDUCE-6973: --- No problem! Be sure to check out the [How to

[jira] [Updated] (MAPREDUCE-6973) Comment refers to "_done" file instead of "_SUCCESS" file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6973: -- Fix Version/s: (was: 3.0.0-beta1) > Comment refers to "_done" file instead of

[jira] [Updated] (MAPREDUCE-6973) Comment refers to "_done" file instead of "_SUCCESS" file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6973: -- Hadoop Flags: (was: Incompatible change) > Comment refers to "_done" file instead of

[jira] [Updated] (MAPREDUCE-6973) Comment refers to "_done" file instead of "_SUCCESS" file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6973: -- Target Version/s: 3.0.0 (was: 3.0.0-beta1) > Comment refers to "_done" file instead of

[jira] [Assigned] (MAPREDUCE-6973) Comment refers to "_done" file instead of "_SUCCESS" file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-6973: - Assignee: Mehul Garnara (MG) Summary: Comment refers to "_done" file instead

[jira] [Updated] (MAPREDUCE-6969) AggregatedLogsBlock reports a bad 'end' value as a bad 'start' value

[ https://issues.apache.org/jira/browse/MAPREDUCE-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6969: -- Status: Patch Available (was: Open) > AggregatedLogsBlock reports a bad 'end' value as a

[jira] [Updated] (MAPREDUCE-6969) AggregatedLogsBlock reports a bad 'end' value as a bad 'start' value

[ https://issues.apache.org/jira/browse/MAPREDUCE-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6969: -- Attachment: MAPREDUCE-6969.001.patch Attaching a patch that fixes the error message. I

<    1   2   3   4   5   6   7   8   9   10   >