[jira] [Commented] (MAPREDUCE-6557) Some tests in mapreduce-client-app are writing outside of target

[ https://issues.apache.org/jira/browse/MAPREDUCE-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026844#comment-15026844 ] Junping Du commented on MAPREDUCE-6557: --- The failed tests are unrelated and are tracked in

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024401#comment-15024401 ] Junping Du commented on MAPREDUCE-5485: --- Sure. Thanks [~ajisakaa] for reminding on this! >

[jira] [Assigned] (MAPREDUCE-6555) TestMRAppMaster fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-6555: - Assignee: Junping Du > TestMRAppMaster fails on trunk >

[jira] [Commented] (MAPREDUCE-6555) TestMRAppMaster fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024466#comment-15024466 ] Junping Du commented on MAPREDUCE-6555: --- The previous failure is because since MAPREDUCE-5485,

[jira] [Updated] (MAPREDUCE-6555) TestMRAppMaster fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6555: -- Status: Patch Available (was: Open) > TestMRAppMaster fails on trunk >

[jira] [Updated] (MAPREDUCE-6555) TestMRAppMaster fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6555: -- Attachment: MAPREDUCE-6555.patch Upload a quick fix to test failure. > TestMRAppMaster

[jira] [Updated] (MAPREDUCE-6555) TestMRAppMaster fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6555: -- Target Version/s: 3.0.0 > TestMRAppMaster fails on trunk > -- >

[jira] [Assigned] (MAPREDUCE-6545) Test committer.commitJob() behavior during committing when MR AM get failed.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-6545: - Assignee: Junping Du > Test committer.commitJob() behavior during committing when MR

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007167#comment-15007167 ] Junping Du commented on MAPREDUCE-5485: --- bq. Junping Du, there are some findbugs and ut

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-v5-branch-2.7.patch Upload a patch for branch-2.7 in case we

[jira] [Updated] (MAPREDUCE-6542) HistoryViewer use SimpleDateFormat,But SimpleDateFormat is not threadsafe

[ https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6542: -- Hadoop Flags: (was: Reviewed) > HistoryViewer use SimpleDateFormat,But SimpleDateFormat

[jira] [Commented] (MAPREDUCE-6542) HistoryViewer use SimpleDateFormat,But SimpleDateFormat is not threadsafe

[ https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002265#comment-15002265 ] Junping Du commented on MAPREDUCE-6542: --- Hi [~piaoyu zhang], thanks for the patch! The

[jira] [Updated] (MAPREDUCE-6542) HistoryViewer use SimpleDateFormat,But SimpleDateFormat is not threadsafe

[ https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6542: -- Status: Patch Available (was: Open) > HistoryViewer use SimpleDateFormat,But

[jira] [Commented] (MAPREDUCE-6533) testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken

[ https://issues.apache.org/jira/browse/MAPREDUCE-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000263#comment-15000263 ] Junping Du commented on MAPREDUCE-6533: --- The test failure for testDetermineCache() is quite

[jira] [Commented] (MAPREDUCE-6505) Migrate io test cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000240#comment-15000240 ] Junping Du commented on MAPREDUCE-6505: --- I think this jira should be moved to hadoop project

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-v4.1.patch Fix minor issues with white spaces, findbugs, etc. in

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000727#comment-15000727 ] Junping Du commented on MAPREDUCE-5485: --- The test failure is not related and I believe nothing

[jira] [Created] (MAPREDUCE-6544) yarn rmadmin -updateNodeResource doesn't work

Junping Du created MAPREDUCE-6544: - Summary: yarn rmadmin -updateNodeResource doesn't work Key: MAPREDUCE-6544 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6544 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-v5.patch Update v5 patch to address Bikas comments above. >

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000472#comment-15000472 ] Junping Du commented on MAPREDUCE-5485: --- bq. This introduces duplication of code for checking

[jira] [Moved] (MAPREDUCE-6545) Test committer.commitJob() behavior during committing when MR AM get failed.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved YARN-4346 to MAPREDUCE-6545: - Target Version/s: (was: 2.8.0) Key: MAPREDUCE-6545

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000916#comment-15000916 ] Junping Du commented on MAPREDUCE-5485: --- bq. About the overall test. The main overall change is

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-v4.patch > Allow repeating job commit by extending

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998995#comment-14998995 ] Junping Du commented on MAPREDUCE-5485: --- Thanks [~bikassaha] for comments! bq. Is the above

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997796#comment-14997796 ] Junping Du commented on MAPREDUCE-5485: --- Actually, the test failure of

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996979#comment-14996979 ] Junping Du commented on MAPREDUCE-5485: --- bq. doing ++retries here can remove code duplication

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-v2.patch Update patch according to review comments from Bikas.

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-v3.patch > Allow repeating job commit by extending

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997661#comment-14997661 ] Junping Du commented on MAPREDUCE-5485: --- Upload v3 patch to address following comments: bq. I am

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-v3.1.patch v3.1 patch to fix minor issues (whitespace,

[jira] [Updated] (MAPREDUCE-6096) SummarizedJob class NPEs with some jhist files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6096: -- Labels: easyfix patch (was: BB2015-05-TBR easyfix patch) > SummarizedJob class NPEs with

[jira] [Updated] (MAPREDUCE-6096) SummarizedJob class NPEs with some jhist files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6096: -- Assignee: zhangyubiao > SummarizedJob class NPEs with some jhist files >

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992102#comment-14992102 ] Junping Du commented on MAPREDUCE-5485: --- Thanks Bikas for review and comments! bq. If the commit

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-v1.patch Attach a new patch to address Bikas comments above,

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Priority: Critical (was: Major) > Allow repeating job commit by extending OutputCommitter

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Target Version/s: 2.6.3, 2.7.3 > Allow repeating job commit by extending OutputCommitter

[jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982214#comment-14982214 ] Junping Du commented on MAPREDUCE-6528: --- Good point, Vinod! Let's keep the patch as it is now as

[jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982852#comment-14982852 ] Junping Du commented on MAPREDUCE-6528: --- Thanks Jason to review and commit this in! > Memory

[jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982317#comment-14982317 ] Junping Du commented on MAPREDUCE-6528: --- Thanks [~brahmareddy]! Can someone commit this patch

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982375#comment-14982375 ] Junping Du commented on MAPREDUCE-5485: --- Thanks [~bikassaha] for the comments! I agree it makes

[jira] [Updated] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6528: -- Status: Patch Available (was: Open) > Memory leak for HistoryFileManager.getJobSummary() >

[jira] [Updated] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6528: -- Attachment: MAPREDUCE-6528.patch Attach a simple patch to fix it. The fix is quite

[jira] [Created] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

Junping Du created MAPREDUCE-6528: - Summary: Memory leak for HistoryFileManager.getJobSummary() Key: MAPREDUCE-6528 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6528 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980892#comment-14980892 ] Junping Du commented on MAPREDUCE-6528: --- bq. Thanks for reporting this..can you use

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-demo-2.patch Update 2nd demo patch, with fixing: 1. Make sure

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Status: Patch Available (was: Open) > Allow repeating job commit by extending

[jira] [Resolved] (MAPREDUCE-6201) TestNetworkedJob fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-6201. --- Resolution: Duplicate > TestNetworkedJob fails on trunk > ---

[jira] [Commented] (MAPREDUCE-6508) TestNetworkedJob fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971204#comment-14971204 ] Junping Du commented on MAPREDUCE-6508: --- Thanks for your reply, [~ajisakaa]! I agree it is right

[jira] [Reopened] (MAPREDUCE-6201) TestNetworkedJob fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened MAPREDUCE-6201: --- I believe TestNetworkedJob still get consistently failed on trunk, so we shouldn't close

[jira] [Commented] (MAPREDUCE-6201) TestNetworkedJob fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970991#comment-14970991 ] Junping Du commented on MAPREDUCE-6201: --- MAPREDUCE-6508 is still open for tracking failures of

[jira] [Commented] (MAPREDUCE-6449) MR Code should not throw and catch YarnRuntimeException to communicate internal exceptions

[ https://issues.apache.org/jira/browse/MAPREDUCE-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971033#comment-14971033 ] Junping Du commented on MAPREDUCE-6449: --- Is this patch breaking our MR rolling upgrade story

[jira] [Updated] (MAPREDUCE-6508) TestNetworkedJob fails consistently due to delegation token changes on RM.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6508: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (MAPREDUCE-6201) TestNetworkedJob fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971415#comment-14971415 ] Junping Du commented on MAPREDUCE-6201: --- Oh. My bad... I will roll back as Cannot Reproduce.

[jira] [Resolved] (MAPREDUCE-6201) TestNetworkedJob fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-6201. --- Resolution: Cannot Reproduce > TestNetworkedJob fails on trunk >

[jira] [Reopened] (MAPREDUCE-6201) TestNetworkedJob fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened MAPREDUCE-6201: --- > TestNetworkedJob fails on trunk > --- > > Key:

[jira] [Updated] (MAPREDUCE-6508) TestNetworkedJob fails consistently due to delegation token changes on RM.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6508: -- Summary: TestNetworkedJob fails consistently due to delegation token changes on RM. (was:

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-demo.patch Upload a demo patch first. More unit test will be

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955012#comment-14955012 ] Junping Du commented on MAPREDUCE-5485: --- The proposal above sounds good to me. [~nemon], thanks

[jira] [Commented] (MAPREDUCE-6478) Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob().

[ https://issues.apache.org/jira/browse/MAPREDUCE-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14876054#comment-14876054 ] Junping Du commented on MAPREDUCE-6478: --- Thanks [~leftnoteasy] for review and commit! > Add an

[jira] [Updated] (MAPREDUCE-6478) Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob().

[ https://issues.apache.org/jira/browse/MAPREDUCE-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6478: -- Attachment: MAPREDUCE-6478-v1.1.patch Fix whitespace issue in v1.1. patch. > Add an option

[jira] [Updated] (MAPREDUCE-6478) Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob().

[ https://issues.apache.org/jira/browse/MAPREDUCE-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6478: -- Attachment: MAPREDUCE-6478-v1.patch Put a quick patch to add two configurations to allow

[jira] [Updated] (MAPREDUCE-6478) Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob().

[ https://issues.apache.org/jira/browse/MAPREDUCE-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6478: -- Status: Patch Available (was: Open) > Add an option to skip cleanupJob stage or ignore

[jira] [Updated] (MAPREDUCE-6478) Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob().

[ https://issues.apache.org/jira/browse/MAPREDUCE-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6478: -- Description: In some of our test cases for MR on public cloud scenario, a very big MR job

[jira] [Created] (MAPREDUCE-6478) Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob().

Junping Du created MAPREDUCE-6478: - Summary: Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob(). Key: MAPREDUCE-6478 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6478

[jira] [Updated] (MAPREDUCE-6458) Figure out the way to pass build-in classpath (files in distributed cache, etc.) from parent to spawned shells

[ https://issues.apache.org/jira/browse/MAPREDUCE-6458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6458: -- Description: In MAPREDUCE-6454 (target for branch-2.x), we provide a way with constraints

[jira] [Commented] (MAPREDUCE-6458) Figure out the way to pass build-in classpath (files in distributed cache, etc.) from parent to spawned shells

[ https://issues.apache.org/jira/browse/MAPREDUCE-6458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14706488#comment-14706488 ] Junping Du commented on MAPREDUCE-6458: --- bq. Re-assigning this to me and

[jira] [Commented] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14706044#comment-14706044 ] Junping Du commented on MAPREDUCE-6454: --- Thanks [~vinodkv] for review/commit and

[jira] [Created] (MAPREDUCE-6458) Figure out the way to pass build-in classpath (files in distributed cache, etc.) from parent to spawned shells

Junping Du created MAPREDUCE-6458: - Summary: Figure out the way to pass build-in classpath (files in distributed cache, etc.) from parent to spawned shells Key: MAPREDUCE-6458 URL:

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Attachment: MAPREDUCE-6454-v3.1.patch Fix minor issues like: javadoc warnings, checkstyle,

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Attachment: MAPREDUCE-6454-v3.patch Previous fixes are not right to resolve the issues we

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Status: Patch Available (was: Open) MapReduce doesn't set the HADOOP_CLASSPATH for jar

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Status: Open (was: Patch Available) MapReduce doesn't set the HADOOP_CLASSPATH for jar

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Status: Patch Available (was: Open) MapReduce doesn't set the HADOOP_CLASSPATH for jar

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Attachment: MAPREDUCE-6454-v2.1.patch Fix some whitespace issue in v2.1 patch. MapReduce

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Attachment: MAPREDUCE-6454-v2.patch The test failure is because

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Status: Open (was: Patch Available) MapReduce doesn't set the HADOOP_CLASSPATH for jar

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Status: Patch Available (was: Open) MapReduce doesn't set the HADOOP_CLASSPATH for jar

[jira] [Updated] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6454: -- Attachment: MAPREDUCE-6454.patch MRApps already include files in distributed cache when

[jira] [Created] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

Junping Du created MAPREDUCE-6454: - Summary: MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache. Key: MAPREDUCE-6454 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6454

[jira] [Commented] (MAPREDUCE-6443) Add JvmPauseMonitor to Job History Server

[ https://issues.apache.org/jira/browse/MAPREDUCE-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660017#comment-14660017 ] Junping Du commented on MAPREDUCE-6443: --- +1. 002 patch LGTM. Will commit it

[jira] [Updated] (MAPREDUCE-6443) Add JvmPauseMonitor to Job History Server

[ https://issues.apache.org/jira/browse/MAPREDUCE-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6443: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-6443) Add JvmPauseMonitor to Job History Server

[ https://issues.apache.org/jira/browse/MAPREDUCE-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660053#comment-14660053 ] Junping Du commented on MAPREDUCE-6443: --- I have commit the patch to trunk and

[jira] [Commented] (MAPREDUCE-6443) Add JvmPauseMonitor to Job History Server

[ https://issues.apache.org/jira/browse/MAPREDUCE-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655241#comment-14655241 ] Junping Du commented on MAPREDUCE-6443: --- Thanks for the patch, Robert. A similar

[jira] [Moved] (MAPREDUCE-6441) LocalDistributedCacheManager for concurrent sqoop processes fails to create unique directories

[ https://issues.apache.org/jira/browse/MAPREDUCE-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved HADOOP-10924 to MAPREDUCE-6441: Key: MAPREDUCE-6441 (was: HADOOP-10924) Project:

[jira] [Created] (MAPREDUCE-6424) Store MR counters as timeline metrics instead of event

Junping Du created MAPREDUCE-6424: - Summary: Store MR counters as timeline metrics instead of event Key: MAPREDUCE-6424 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6424 Project: Hadoop

[jira] [Commented] (MAPREDUCE-5965) Hadoop streaming throws error if list of input files is high. Error is: error=7, Argument list too long at if number of input file is high

[ https://issues.apache.org/jira/browse/MAPREDUCE-5965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555957#comment-14555957 ] Junping Du commented on MAPREDUCE-5965: --- Thanks guys for good discussions here.

[jira] [Updated] (MAPREDUCE-6232) Task state is running when all task attempts fail

[ https://issues.apache.org/jira/browse/MAPREDUCE-6232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6232: -- Target Version/s: (was: 2.6.0) Task state is running when all task attempts fail

[jira] [Updated] (MAPREDUCE-6232) Task state is running when all task attempts fail

[ https://issues.apache.org/jira/browse/MAPREDUCE-6232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6232: -- Labels: (was: BB2015-05-RFC) Task state is running when all task attempts fail

[jira] [Commented] (MAPREDUCE-6164) mapreduce.reduce.shuffle.fetch.retry.timeout-ms should be set to 3 minutes instead of 30 seconds by default to be consistent with other retry timeout

[ https://issues.apache.org/jira/browse/MAPREDUCE-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550284#comment-14550284 ] Junping Du commented on MAPREDUCE-6164: --- Do we still need this? It seems to be

[jira] [Updated] (MAPREDUCE-6361) NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host

[ https://issues.apache.org/jira/browse/MAPREDUCE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6361: -- Target Version/s: 2.7.1 (was: 2.8.0) Fix Version/s: (was: 2.8.0)

[jira] [Updated] (MAPREDUCE-6361) NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host

[ https://issues.apache.org/jira/browse/MAPREDUCE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6361: -- Attachment: MAPREDUCE-6361-v1.patch Upload the patch with the 2nd solution proposed above

[jira] [Updated] (MAPREDUCE-6361) NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host

[ https://issues.apache.org/jira/browse/MAPREDUCE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6361: -- Status: Patch Available (was: Open) NPE issue in shuffle caused by concurrent issue

[jira] [Commented] (MAPREDUCE-6361) NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host

[ https://issues.apache.org/jira/browse/MAPREDUCE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539594#comment-14539594 ] Junping Du commented on MAPREDUCE-6361: --- There are basically two ways to fix the

[jira] [Created] (MAPREDUCE-6361) NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host

Junping Du created MAPREDUCE-6361: - Summary: NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host Key: MAPREDUCE-6361 URL:

[jira] [Commented] (MAPREDUCE-6361) NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host

[ https://issues.apache.org/jira/browse/MAPREDUCE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538071#comment-14538071 ] Junping Du commented on MAPREDUCE-6361: --- NPE get throw in copyFailed() in

[jira] [Updated] (MAPREDUCE-6361) NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host

[ https://issues.apache.org/jira/browse/MAPREDUCE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6361: -- Priority: Critical (was: Major) NPE issue in shuffle caused by concurrent issue between

[jira] [Updated] (MAPREDUCE-6164) mapreduce.reduce.shuffle.fetch.retry.timeout-ms should be set to 3 minutes instead of 30 seconds by default to be consistent with other retry timeout

[ https://issues.apache.org/jira/browse/MAPREDUCE-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6164: -- Target Version/s: 2.8.0 (was: 2.6.1) mapreduce.reduce.shuffle.fetch.retry.timeout-ms

[jira] [Updated] (MAPREDUCE-6359) RM HA setup, Cluster tab links populated with AM hostname instead of RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6359: -- Labels: (was: BB2015-05-TBR) RM HA setup, Cluster tab links populated with AM hostname

[jira] [Updated] (MAPREDUCE-6359) RM HA setup, Cluster tab links populated with AM hostname instead of RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6359: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status:

[jira] [Moved] (MAPREDUCE-6359) RM HA setup, Cluster tab links populated with AM hostname instead of RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved YARN-3423 to MAPREDUCE-6359: - Component/s: (was: resourcemanager) Affects Version/s:

<    1   2   3   4   5   6   7   >