[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193691#comment-14193691 ] Junping Du commented on MAPREDUCE-6052: --- Filed MAPREDUCE-6149 for documentation.

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191561#comment-14191561 ] Junping Du commented on MAPREDUCE-6052: --- Thanks for review and comments,

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191568#comment-14191568 ] Junping Du commented on MAPREDUCE-6052: --- bq. I don't see any. Only some

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Attachment: MAPREDUCE-6052-v4.patch Support overriding log4j.properties per job

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192957#comment-14192957 ] Junping Du commented on MAPREDUCE-6052: --- bq. In copyAndConfigureFiles, the

[jira] [Moved] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved HADOOP-11177 to MAPREDUCE-6146: Component/s: (was: build) build

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: MAPREDUCE-6146.patch Reduce tar ball size for MR over distributed cache

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: (was: MAPREDUCE-6146.patch) Reduce tar ball size for MR over distributed

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: MAPREDUCE-6146.patch Reduce tar ball size for MR over distributed cache

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: (was: MAPREDUCE-6146.patch) Reduce tar ball size for MR over distributed

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: MAPREDUCE-6146.patch Reduce tar ball size for MR over distributed cache

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Status: Patch Available (was: Open) Thanks [~vinodkv] for review and comments! I move the

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Attachment: MAPREDUCE-6052-v3.patch Support overriding log4j.properties per job

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184118#comment-14184118 ] Junping Du commented on MAPREDUCE-6052: --- Sounds good. In v3 patch, implement

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178488#comment-14178488 ] Junping Du commented on MAPREDUCE-6052: --- bq. Was asked to comment. This makes

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Attachment: MAPREDUCE-6052-v2.patch Support overriding log4j.properties per job

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179464#comment-14179464 ] Junping Du commented on MAPREDUCE-6052: --- bq. That or hey this is my log4j

[jira] [Commented] (MAPREDUCE-6126) (Rumen) Rumen tool returns error ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179537#comment-14179537 ] Junping Du commented on MAPREDUCE-6126: --- Thanks [~jianhe] for review and

[jira] [Updated] (MAPREDUCE-6126) (Rumen) Rumen tool returns error ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6126: -- Attachment: MAPREDUCE-6126-v2.patch (Rumen) Rumen tool returns error

[jira] [Created] (MAPREDUCE-6126) (Rumen) Rumen tool returns error ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type

Junping Du created MAPREDUCE-6126: - Summary: (Rumen) Rumen tool returns error ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type Key: MAPREDUCE-6126 URL:

[jira] [Commented] (MAPREDUCE-6126) (Rumen) Rumen tool returns error ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14165289#comment-14165289 ] Junping Du commented on MAPREDUCE-6126: --- Like MAPREDUCE-3241,

[jira] [Updated] (MAPREDUCE-6126) (Rumen) Rumen tool returns error ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6126: -- Attachment: MAPREDUCE-6126.patch (Rumen) Rumen tool returns error

[jira] [Updated] (MAPREDUCE-6126) (Rumen) Rumen tool returns error ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6126: -- Status: Patch Available (was: Open) (Rumen) Rumen tool returns error

[jira] [Commented] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147948#comment-14147948 ] Junping Du commented on MAPREDUCE-5831: --- Thanks [~zjshen] for review and

[jira] [Commented] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148477#comment-14148477 ] Junping Du commented on MAPREDUCE-5831: --- bq. It's fine too. If so, we need to

[jira] [Updated] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5831: -- Attachment: MAPREDUCE-5831-v3.patch Thanks [~zjshen] for review and comments. v3 patch just

[jira] [Updated] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5831: -- Attachment: MAPREDUCE-5831.patch Upload a patch to fix this issue. Old MR client is not

[jira] [Updated] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5831: -- Status: Patch Available (was: Open) Old MR client is not compatible with new MR

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Issue Type: Sub-task (was: Improvement) Parent: MAPREDUCE-4150 Improved shuffle

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v6.patch Improved shuffle error handling across NM restarts

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139511#comment-14139511 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for reviewing the

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137615#comment-14137615 ] Junping Du commented on MAPREDUCE-5891: --- Sorry for coming a little late as busy

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v5.patch Fix the default value as discussion above in v5 patch.

[jira] [Commented] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136315#comment-14136315 ] Junping Du commented on MAPREDUCE-5831: --- Taking it over and mark this as blocker

[jira] [Updated] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5831: -- Priority: Blocker (was: Critical) Old MR client is not compatible with new MR application

[jira] [Created] (MAPREDUCE-6084) Load MR Configuration from distributed cache rather than individual node

Junping Du created MAPREDUCE-6084: - Summary: Load MR Configuration from distributed cache rather than individual node Key: MAPREDUCE-6084 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6084

[jira] [Updated] (MAPREDUCE-6084) Load MR Configuration from distributed cache rather than individual node

[ https://issues.apache.org/jira/browse/MAPREDUCE-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6084: -- Attachment: Compatibility of Configuration Across Different MR Versions.pdf Load MR

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125114#comment-14125114 ] Junping Du commented on MAPREDUCE-5891: --- Hi [~jlowe] and [~mingma], any

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v4.patch Improved shuffle error handling across NM restarts

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120850#comment-14120850 ] Junping Du commented on MAPREDUCE-5891: --- Thanks for comments, [~mingma] and

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116244#comment-14116244 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for comments! bq.

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v3.patch Improved shuffle error handling across NM restarts

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v2.patch Thanks [~jlowe] for review and comments! In v2 patch,

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891.patch Improved shuffle error handling across NM restarts

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Status: Patch Available (was: Open) Improved shuffle error handling across NM restarts

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110947#comment-14110947 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for review! I just

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Attachment: MAPREDUCE-6052.patch Attache a quick patch to fix it. Support overriding

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Status: Patch Available (was: Open) Support overriding log4j.properties per job

[jira] [Created] (MAPREDUCE-6052) Support overriding log4j.properties per job

Junping Du created MAPREDUCE-6052: - Summary: Support overriding log4j.properties per job Key: MAPREDUCE-6052 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6052 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-demo.patch Thanks [~jlowe] for sharing the thoughts. I have a

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106341#comment-14106341 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for quickly feedback!

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101731#comment-14101731 ] Junping Du commented on MAPREDUCE-5891: --- Hi [~jlowe], I like to work on this if

[jira] [Created] (MAPREDUCE-6023) Fix SuppressWarnings from unchecked to rawtypes in O.A.H.mapreduce.lib.input.TaggedInputSplit

Junping Du created MAPREDUCE-6023: - Summary: Fix SuppressWarnings from unchecked to rawtypes in O.A.H.mapreduce.lib.input.TaggedInputSplit Key: MAPREDUCE-6023 URL:

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963-v2.1.patch In latest patch, fix the findbug warning.

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963-v2.patch Update patch to latest trunk and do some fix on

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Status: Patch Available (was: Open) ShuffleHandler DB schema should be versioned with

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963.patch Upload a draft patch. It should need some code in

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Issue Type: Sub-task (was: New Feature) Parent: MAPREDUCE-4150 ShuffleHandler DB

[jira] [Moved] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved YARN-2265 to MAPREDUCE-5963: - Component/s: (was: nodemanager) Target Version/s:

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051345#comment-14051345 ] Junping Du commented on MAPREDUCE-5940: --- bq. Silently making the elapsed time as

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052116#comment-14052116 ] Junping Du commented on MAPREDUCE-5940: --- Kick off Jenkins test. Patch looks good

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051046#comment-14051046 ] Junping Du commented on MAPREDUCE-5940: --- Thanks [~zjshen] to work on this and

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051048#comment-14051048 ] Junping Du commented on MAPREDUCE-5940: --- Also adding a test in TestTimes.java

[jira] [Updated] (MAPREDUCE-5861) finishedSubMaps field in LocalContainerLauncher does not need to be volatile

[ https://issues.apache.org/jira/browse/MAPREDUCE-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5861: -- Issue Type: Improvement (was: Bug) finishedSubMaps field in LocalContainerLauncher does

[jira] [Updated] (MAPREDUCE-5861) finishedSubMaps field in LocalContainerLauncher does not need to be volatile

[ https://issues.apache.org/jira/browse/MAPREDUCE-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5861: -- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch

[jira] [Commented] (MAPREDUCE-5861) finishedSubMaps field in LocalContainerLauncher does not need to be volatile

[ https://issues.apache.org/jira/browse/MAPREDUCE-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996234#comment-13996234 ] Junping Du commented on MAPREDUCE-5861: --- Agree volatile is not help here so

[jira] [Updated] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5593: -- Status: Open (was: Patch Available) Cleanup code for AssignMapsWithLocality() in

[jira] [Commented] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820906#comment-13820906 ] Junping Du commented on MAPREDUCE-5593: --- The test failure seems to be unrelated

[jira] [Updated] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5593: -- Attachment: MAPREDUCE-5593-v4.patch Sync patch with recently trunk branch. Cleanup code

[jira] [Moved] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved YARN-1163 to MAPREDUCE-5593: - Component/s: (was: applications)

[jira] [Updated] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5593: -- Attachment: MAPREDUCE-5593-v3.patch rename the patch to MAPREDUCE in v3 patch and submit

[jira] [Commented] (MAPREDUCE-4900) Dynamic configuration for task slots on TT

[ https://issues.apache.org/jira/browse/MAPREDUCE-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792110#comment-13792110 ] Junping Du commented on MAPREDUCE-4900: --- Thanks Binglin for the patch and

[jira] [Updated] (MAPREDUCE-5301) Update MR code to work with YARN-635 changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5301: -- Assignee: Siddharth Seth Update MR code to work with YARN-635 changes

[jira] [Created] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

Junping Du created MAPREDUCE-5421: - Summary: TestNonExistentJob is failed due to recent changes in YARN Key: MAPREDUCE-5421 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5421 Project: Hadoop

[jira] [Updated] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5421: -- Attachment: MAPREDUCE-5421.patch Upload a quick patch to fix it.

[jira] [Updated] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5421: -- Target Version/s: 2.1.0-beta Status: Patch Available (was: Open)

[jira] [Updated] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5421: -- Attachment: MAPREDUCE-5421-v2.patch The ApplicationNotFoundException in server side should

[jira] [Commented] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13721341#comment-13721341 ] Junping Du commented on MAPREDUCE-5421: --- Thanks Vinod and Xuan for review!

[jira] [Commented] (MAPREDUCE-4944) Backport YARN-40 to support listClusterNodes and printNodeStatus in command line tool

[ https://issues.apache.org/jira/browse/MAPREDUCE-4944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13557031#comment-13557031 ] Junping Du commented on MAPREDUCE-4944: --- I prefer to break AdminOpProtocol if we

[jira] [Commented] (MAPREDUCE-4900) Dynamic configuration for task slots on TT

[ https://issues.apache.org/jira/browse/MAPREDUCE-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13554820#comment-13554820 ] Junping Du commented on MAPREDUCE-4900: --- Binglin, Thanks for the work. I see

[jira] [Updated] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4904: -- Attachment: MAPREDUCE-4904-v2.patch Incorporate Luke's comments with adding comments to

[jira] [Updated] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4904: -- Attachment: MAPREDUCE-4904-v2.patch use --no-prefix to generate patch in new v2 patch.

[jira] [Commented] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13542687#comment-13542687 ] Junping Du commented on MAPREDUCE-4904: --- Sure. Thanks Luke for comments. If

[jira] [Updated] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4904: -- Attachment: MAPREDUCE-4904.patch Attach a quick fix. Meng, Would you verify it works on

[jira] [Commented] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13540404#comment-13540404 ] Junping Du commented on MAPREDUCE-4660: --- Thanks Luke! A very trivial bug related

[jira] [Created] (MAPREDUCE-4900) Dynamic configuration for task slots on TT

Junping Du created MAPREDUCE-4900: - Summary: Dynamic configuration for task slots on TT Key: MAPREDUCE-4900 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4900 Project: Hadoop Map/Reduce

[jira] [Assigned] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-4886: - Assignee: meng gong TestCapacityScheduler failed in branch-1

[jira] [Commented] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13536914#comment-13536914 ] Junping Du commented on MAPREDUCE-4886: --- Yes. It should due to -noFile

[jira] [Resolved] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-4886. --- Resolution: Not A Problem TestCapacityScheduler failed in branch-1

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Attachment: MAPREDUCE-4660-v3.patch As HDFS-3942 is checked in to branch-1, so remove some

[jira] [Commented] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533744#comment-13533744 ] Junping Du commented on MAPREDUCE-4660: --- The test-patch result is as following:

[jira] [Created] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

Junping Du created MAPREDUCE-4886: - Summary: TestCapacityScheduler failed in branch-1 Key: MAPREDUCE-4886 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4886 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Attachment: MAPREDUCE-4660-v2.patch Update patch to address recent changes on branch-1 in

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Attachment: MAPREDUCE-4660.patch Update task placement policy for NetworkTopology

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Target Version/s: 1.2.0 (was: 1.0.3, 2.0.1-alpha) Update task placement policy for

[jira] [Created] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

Junping Du created MAPREDUCE-4660: - Summary: Update task placement policy for NetworkTopology with 'NodeGroup' layer Key: MAPREDUCE-4660 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4660

[jira] [Assigned] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-4660: - Assignee: Junping Du Update task placement policy for NetworkTopology with

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13429048#comment-13429048 ] Junping Du commented on MAPREDUCE-4309: --- Bikas, Thanks for your review and help

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13428959#comment-13428959 ] Junping Du commented on MAPREDUCE-4309: --- Anyone can take a look at this patch.

[jira] [Commented] (MAPREDUCE-4327) Enhance CS to schedule accounting for both memory and cpu cores

[ https://issues.apache.org/jira/browse/MAPREDUCE-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427672#comment-13427672 ] Junping Du commented on MAPREDUCE-4327: --- It looks like these findbugs warnings

<    1   2   3   4   5   6   7   >