[jira] [Created] (MAPREDUCE-7065) Improve information stored in ATSv2 for MR jobs

2018-03-12 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-7065: - Summary: Improve information stored in ATSv2 for MR jobs Key: MAPREDUCE-7065 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7065 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-6955) remove unnecessary dependency from hadoop-mapreduce-client-app to hadoop-mapreduce-client-shuffle

2017-09-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6955. --- Resolution: Not A Problem > remove unnecessary dependency from

[jira] [Created] (MAPREDUCE-6955) remove unnecessary dependency from hadoop-mapreduce-client-app to hadoop-mapreduce-client-shuffle

2017-09-08 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6955: - Summary: remove unnecessary dependency from hadoop-mapreduce-client-app to hadoop-mapreduce-client-shuffle Key: MAPREDUCE-6955 URL:

[jira] [Resolved] (MAPREDUCE-6949) yarn.app.mapreduce.am.log.level is not documented in mapred-default.xml

2017-08-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6949. --- Resolution: Duplicate > yarn.app.mapreduce.am.log.level is not documented in

[jira] [Created] (MAPREDUCE-6949) yarn.app.mapreduce.am.log.level is not documented in mapred-default.xml

2017-08-30 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6949: - Summary: yarn.app.mapreduce.am.log.level is not documented in mapred-default.xml Key: MAPREDUCE-6949 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6949

[jira] [Created] (MAPREDUCE-6948) TestJobImpl.testUnusableNodeTransition failed

2017-08-30 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6948: - Summary: TestJobImpl.testUnusableNodeTransition failed Key: MAPREDUCE-6948 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6948 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6936) Remove unnecessary dependency of hadoop-yarn-server-common from hadoop-mapreduce-client-common

2017-08-10 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6936: - Summary: Remove unnecessary dependency of hadoop-yarn-server-common from hadoop-mapreduce-client-common Key: MAPREDUCE-6936 URL:

[jira] [Resolved] (MAPREDUCE-6929) TimelineV2Client hangs MR AM

2017-08-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6929. --- Resolution: Not A Problem > TimelineV2Client hangs MR AM > >

[jira] [Created] (MAPREDUCE-6929) TimelineClient hangs MR AM

2017-08-02 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6929: - Summary: TimelineClient hangs MR AM Key: MAPREDUCE-6929 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6929 Project: Hadoop Map/Reduce Issue Type:

[jira] [Created] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

2017-08-01 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6926: - Summary: Allow MR jobs to opt out of oversubscription Key: MAPREDUCE-6926 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6926 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-6886) Job History File Permissions configurable

2017-05-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6886. --- Resolution: Duplicate Closing this as a duplicate of MAPREDUCE-6288. [~Prabhu Joseph]

[jira] [Resolved] (MAPREDUCE-6346) mapred.nativetask.kvtest.KVTest crashes on PPC64LE

2017-05-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6346. --- Resolution: Duplicate > mapred.nativetask.kvtest.KVTest crashes on PPC64LE >

[jira] [Created] (MAPREDUCE-6872) RM does not blacklist node for AM launch failures

2017-03-29 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6872: - Summary: RM does not blacklist node for AM launch failures Key: MAPREDUCE-6872 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6872 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6851) Terasort does not work with S3 FileSystem

2017-02-24 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6851: - Summary: Terasort does not work with S3 FileSystem Key: MAPREDUCE-6851 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6851 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-6598) LineReader enhencement to support text records contains "\n"

2016-12-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6598. --- Resolution: Not A Problem > LineReader enhencement to support text records contains "\n"

[jira] [Created] (MAPREDUCE-6817) The format of job start time in JHS is different from those of submit and finish time

2016-12-02 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6817: - Summary: The format of job start time in JHS is different from those of submit and finish time Key: MAPREDUCE-6817 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6817

[jira] [Created] (MAPREDUCE-6815) Fix flaky TestKill.testKillTask()

2016-12-01 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6815: - Summary: Fix flaky TestKill.testKillTask() Key: MAPREDUCE-6815 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6815 Project: Hadoop Map/Reduce Issue

[jira] [Resolved] (MAPREDUCE-6802) TestKill.testKillJob() fails intermittently on Power

2016-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6802. --- Resolution: Duplicate > TestKill.testKillJob() fails intermittently on Power >

[jira] [Created] (MAPREDUCE-6801) Fix flaky TestKill.testKillJob()

2016-10-26 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6801: - Summary: Fix flaky TestKill.testKillJob() Key: MAPREDUCE-6801 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6801 Project: Hadoop Map/Reduce Issue

[jira] [Created] (MAPREDUCE-6791) module dependency from hadoop-mapreduce-client-jobclient to hadoop-mapreduce-client-shuffle is unnecessary

2016-10-11 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6791: - Summary: module dependency from hadoop-mapreduce-client-jobclient to hadoop-mapreduce-client-shuffle is unnecessary Key: MAPREDUCE-6791 URL:

[jira] [Reopened] (MAPREDUCE-6741) add MR support to redact job conf properties

2016-10-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reopened MAPREDUCE-6741: --- Reopen to upload a branch-2.8 patch > add MR support to redact job conf properties >

[jira] [Created] (MAPREDUCE-6771) Diagnostics information is lost in .jhist if task containers are killed by Node Manager.

2016-08-26 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6771: - Summary: Diagnostics information is lost in .jhist if task containers are killed by Node Manager. Key: MAPREDUCE-6771 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6771

[jira] [Created] (MAPREDUCE-6768) TestRecovery.testSpeculative failed with NPE

2016-08-25 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6768: - Summary: TestRecovery.testSpeculative failed with NPE Key: MAPREDUCE-6768 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6768 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

2016-08-23 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6765: - Summary: MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported Key: MAPREDUCE-6765 URL:

[jira] [Resolved] (MAPREDUCE-6723) Turn log level to Debug in test

2016-08-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6723. --- Resolution: Won't Fix > Turn log level to Debug in test > ---

[jira] [Created] (MAPREDUCE-6741) add JHS support to hide job conf properties from Web UI

2016-07-21 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6741: - Summary: add JHS support to hide job conf properties from Web UI Key: MAPREDUCE-6741 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6741 Project: Hadoop

[jira] [Resolved] (MAPREDUCE-6669) Jobs with encrypted spills don't tolerate AM failures

2016-07-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6669. --- Resolution: Duplicate > Jobs with encrypted spills don't tolerate AM failures >

[jira] [Resolved] (MAPREDUCE-5739) DirectoryCollection#createNonExistentDirs() may use an invalid iterator

2016-07-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-5739. --- Resolution: Fixed > DirectoryCollection#createNonExistentDirs() may use an invalid

[jira] [Resolved] (MAPREDUCE-5752) Potential invalid iterator in NMClientImpl#cleanupRunningContainers()

2016-07-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-5752. --- Resolution: Invalid > Potential invalid iterator in

[jira] [Resolved] (MAPREDUCE-6131) Integer overflow in RMContainerAllocator results in starvation of applications

2016-07-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6131. --- Resolution: Invalid > Integer overflow in RMContainerAllocator results in starvation of

[jira] [Resolved] (MAPREDUCE-6687) Allow specifing java home via job configuration

2016-07-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6687. --- Resolution: Implemented > Allow specifing java home via job configuration >

[jira] [Created] (MAPREDUCE-6740) Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval

2016-07-20 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6740: - Summary: Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval Key: MAPREDUCE-6740 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6740

[jira] [Created] (MAPREDUCE-6739) allow specifying range on the port that MR AM web server binds to

2016-07-20 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6739: - Summary: allow specifying range on the port that MR AM web server binds to Key: MAPREDUCE-6739 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6739 Project:

[jira] [Created] (MAPREDUCE-6728) Give fetchers hint when ShuffleHandler rejects a shuffling connection

2016-07-05 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6728: - Summary: Give fetchers hint when ShuffleHandler rejects a shuffling connection Key: MAPREDUCE-6728 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6728

[jira] [Created] (MAPREDUCE-6724) Unsafe conversion from long to int in MergeManagerImpl.unconditionalReserve()

2016-06-22 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6724: - Summary: Unsafe conversion from long to int in MergeManagerImpl.unconditionalReserve() Key: MAPREDUCE-6724 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6724

[jira] [Created] (MAPREDUCE-6723) Turn log level to Debug in test

2016-06-22 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6723: - Summary: Turn log level to Debug in test Key: MAPREDUCE-6723 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6723 Project: Hadoop Map/Reduce Issue

[jira] [Reopened] (MAPREDUCE-6718) add progress log to JHS during startup

2016-06-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reopened MAPREDUCE-6718: --- > add progress log to JHS during startup > -- > >

[jira] [Resolved] (MAPREDUCE-6718) add progress log to JHS during startup

2016-06-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6718. --- Resolution: Not A Problem Turns out MAPREDUCE-6059 limits the number of files to load in

[jira] [Created] (MAPREDUCE-6698) Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser

2016-05-16 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6698: - Summary: Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser Key: MAPREDUCE-6698 URL:

[jira] [Resolved] (MAPREDUCE-6681) TestUberAM fails intermittently

2016-05-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6681. --- Resolution: Fixed MAPREDUCE-6677 has been committed to fix the issue reported here. >

[jira] [Created] (MAPREDUCE-6684) High contention on scanning of user directory under immediate_done in Job History Server

2016-04-20 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6684: - Summary: High contention on scanning of user directory under immediate_done in Job History Server Key: MAPREDUCE-6684 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6684

[jira] [Created] (MAPREDUCE-6677) LocalContainerAllocator doesn't specify resource of the containers allocated.

2016-04-15 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6677: - Summary: LocalContainerAllocator doesn't specify resource of the containers allocated. Key: MAPREDUCE-6677 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6677

[jira] [Created] (MAPREDUCE-6675) TestJobImpl.testUnusableNode failed

2016-04-14 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6675: - Summary: TestJobImpl.testUnusableNode failed Key: MAPREDUCE-6675 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6675 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-03-22 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6657: - Summary: job history server can fail on startup when NameNode is in start phase Key: MAPREDUCE-6657 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6657

[jira] [Created] (MAPREDUCE-6652) Add configuration property to prevent JHS from loading jobs with a task count greater than X

2016-03-19 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6652: - Summary: Add configuration property to prevent JHS from loading jobs with a task count greater than X Key: MAPREDUCE-6652 URL:

[jira] [Created] (MAPREDUCE-6647) MR usage counters use the resources requested instead of the resources allocated

2016-03-02 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6647: - Summary: MR usage counters use the resources requested instead of the resources allocated Key: MAPREDUCE-6647 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6647

[jira] [Created] (MAPREDUCE-6643) org.apache.hadoop.mapred.TestTextInputFormat.testSplitableCodecs failed

2016-02-23 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6643: - Summary: org.apache.hadoop.mapred.TestTextInputFormat.testSplitableCodecs failed Key: MAPREDUCE-6643 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6643