[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167004#comment-16167004 ] Junping Du commented on YARN-7162: -- wait... Sorry for coming late on this. I think it coul

[jira] [Commented] (YARN-7174) Add retry logic in LogsCLI when fetch running application logs

2017-09-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166895#comment-16166895 ] Junping Du commented on YARN-7174: -- Thanks [~xgong] for updating the patch. The patch look

[jira] [Commented] (YARN-7194) Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat

2017-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165764#comment-16165764 ] Junping Du commented on YARN-7194: -- I have commit the patch to trunk and branch-2. Thanks

[jira] [Commented] (YARN-7194) Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat

2017-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165755#comment-16165755 ] Junping Du commented on YARN-7194: -- Thanks [~xgong] for fixing this issue. +1. Committing

[jira] [Commented] (YARN-7174) Add retry logic in LogsCLI when fetch running application logs

2017-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165395#comment-16165395 ] Junping Du commented on YARN-7174: -- Thanks [~xgong] for reporting the issue and delivering

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165266#comment-16165266 ] Junping Du commented on YARN-6570: -- Fix with a simple unit test. > No logs were found for

[jira] [Updated] (YARN-6570) No logs were found for running application, running container

2017-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6570: - Attachment: YARN-6570-v2.patch > No logs were found for running application, running container > --

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7034: - Target Version/s: 2.9.0, 3.0.0-beta1, 2.8.2 Add target versions to remind as a potentially blocker. > Defa

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2017-09-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16163455#comment-16163455 ] Junping Du commented on YARN-6630: -- Sorry for coming late on this. Sounds like the patch d

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162099#comment-16162099 ] Junping Du commented on YARN-6622: -- bq. Then let's backport YARN-5258. Enabling docker sup

[jira] [Updated] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6622: - Target Version/s: 2.9.0, 3.0.0-beta1 (was: 3.0.0-beta1, 2.8.3) > Document Docker work as experimental > --

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162072#comment-16162072 ] Junping Du commented on YARN-6622: -- I just find that YARN-5258 (documentation for docker c

[jira] [Commented] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162012#comment-16162012 ] Junping Du commented on YARN-7185: -- Container Scheduler should get disabled by default. Bu

[jira] [Updated] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7185: - Target Version/s: 3.0.0-beta1 > Application fails to go to FINISHED state or sometimes to RUNNING state > -

[jira] [Updated] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7185: - Fix Version/s: (was: 3.0.0) > Application fails to go to FINISHED state or sometimes to RUNNING state >

[jira] [Updated] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7185: - Priority: Blocker (was: Critical) > Application fails to go to FINISHED state or sometimes to RUNNING stat

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161771#comment-16161771 ] Junping Du commented on YARN-6622: -- This is out of my radar too as marked as major instead

[jira] [Updated] (YARN-6771) Use classloader inside configuration class to make new classes

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6771: - Target Version/s: 3.0.0-beta1, 2.8.3 (was: 3.0.0-beta1, 2.8.2) > Use classloader inside configuration clas

[jira] [Updated] (YARN-6378) Negative usedResources memory in CapacityScheduler

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6378: - Target Version/s: 2.8.3 (was: 2.8.2) > Negative usedResources memory in CapacityScheduler > --

[jira] [Updated] (YARN-6842) Implement a new access type for queue

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6842: - Target Version/s: 2.8.3 (was: 2.8.2) > Implement a new access type for queue > ---

[jira] [Updated] (YARN-7027) Log aggregation finish time should get logged for trouble shooting.

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7027: - Target Version/s: 2.8.3 (was: 2.8.2) > Log aggregation finish time should get logged for trouble shooting.

[jira] [Updated] (YARN-6862) Nodemanager resource usage metrics sometimes are negative

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6862: - Target Version/s: 2.8.3 (was: 2.8.2) > Nodemanager resource usage metrics sometimes are negative > ---

[jira] [Updated] (YARN-6622) Document Docker work as experimental

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6622: - Target Version/s: 3.0.0-beta1, 2.8.3 (was: 2.8.1, 3.0.0-beta1) > Document Docker work as experimental > --

[jira] [Updated] (YARN-6426) Compress ZK YARN keys to scale up (especially AppStateData

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6426: - Target Version/s: 2.9.0, 3.0.0-beta1, 2.8.3 (was: 2.9.0, 2.8.1, 3.0.0-beta1) > Compress ZK YARN keys to s

[jira] [Commented] (YARN-7072) Add a new log aggregation file format controller

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160695#comment-16160695 ] Junping Du commented on YARN-7072: -- I also verified locally. Most tests get passed locally

[jira] [Commented] (YARN-7072) Add a new log aggregation file format controller

2017-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16159687#comment-16159687 ] Junping Du commented on YARN-7072: -- Jenkins report indicates many UT get failed. [~xgong],

[jira] [Commented] (YARN-7072) Add a new log aggregation file format controller

2017-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16159213#comment-16159213 ] Junping Du commented on YARN-7072: -- Thanks Xuan for updating the patch. Latest patch LGTM.

[jira] [Commented] (YARN-7072) Add a new log aggregation file format controller

2017-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158305#comment-16158305 ] Junping Du commented on YARN-7072: -- Patch LGTM in overall. The findbug warning is not rela

[jira] [Updated] (YARN-7144) Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader.

2017-09-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7144: - Fix Version/s: 3.1.0 > Log Aggregation controller should not swallow the exceptions when it calls > closeW

[jira] [Commented] (YARN-7144) Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader.

2017-09-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157620#comment-16157620 ] Junping Du commented on YARN-7144: -- I have commit the patch to trunk, branch-3.0 and branc

[jira] [Commented] (YARN-7144) Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader.

2017-09-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16155975#comment-16155975 ] Junping Du commented on YARN-7144: -- Re-kick off Jenkins to test if YARN-7148 fixed the jav

[jira] [Commented] (YARN-7148) TestLogsCLI fails in trunk and branch-2 and javadoc error

2017-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154690#comment-16154690 ] Junping Du commented on YARN-7148: -- The javadoc error is still report as error but looks l

[jira] [Commented] (YARN-7144) Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader.

2017-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154681#comment-16154681 ] Junping Du commented on YARN-7144: -- +1. Patch LGTM. The javadoc issue is not related to th

[jira] [Updated] (YARN-7148) TestLogsCLI fails in trunk and branch-2 and javadoc error

2017-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7148: - Summary: TestLogsCLI fails in trunk and branch-2 and javadoc error (was: TestLogsCLI fails in trunk and br

[jira] [Commented] (YARN-7148) TestLogsCLI fails in trunk and branch-2

2017-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154678#comment-16154678 ] Junping Du commented on YARN-7148: -- Thanks [~xgong] for uploading the patch. 004 patch LGT

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154586#comment-16154586 ] Junping Du commented on YARN-7162: -- Hi [~rkanter], if removing XML format, how server-side

[jira] [Commented] (YARN-7023) Incorrect ReservationId.compareTo() implementation

2017-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154580#comment-16154580 ] Junping Du commented on YARN-7023: -- no worry. It happens always. :) > Incorrect Reservati

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154487#comment-16154487 ] Junping Du commented on YARN-6877: -- It is very tricky to find out real errors among thousa

[jira] [Commented] (YARN-7023) Incorrect ReservationId.compareTo() implementation

2017-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154456#comment-16154456 ] Junping Du commented on YARN-7023: -- Hi [~ajisakaa], as mentioned in my 2.8.2 release threa

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-09-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16151035#comment-16151035 ] Junping Du commented on YARN-6877: -- Thanks [~ajisakaa] for noticing us. bq. In short, the

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-09-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150319#comment-16150319 ] Junping Du commented on YARN-6877: -- Thanks [~xgong]. The test failures should be unrelated

[jira] [Commented] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

2017-09-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150300#comment-16150300 ] Junping Du commented on YARN-7138: -- Thanks [~leftnoteasy] for response. bq. Regarding to s

[jira] [Commented] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149882#comment-16149882 ] Junping Du commented on YARN-5547: -- Thanks [~vrushalic] for uploading the patch. branch-2.

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149792#comment-16149792 ] Junping Du commented on YARN-6877: -- I have commit the patch to trunk. However, trying to b

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149769#comment-16149769 ] Junping Du commented on YARN-6877: -- The test failures (and findbugs warning) shouldn't be

[jira] [Commented] (YARN-5731) Preemption calculation is not accurate when reserved containers are present in queue.

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149745#comment-16149745 ] Junping Du commented on YARN-5731: -- Sounds like we forget to commit to branch-2.8.2. Just

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149739#comment-16149739 ] Junping Du commented on YARN-5892: -- Sounds like we forget to commit to branch-2.8.2. Just

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149727#comment-16149727 ] Junping Du commented on YARN-6877: -- Thanks [~xgong]. 008 patch LGTM. +1 pending on Jenkins

[jira] [Updated] (YARN-5703) ReservationAgents are not correctly configured

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5703: - Fix Version/s: (was: 2.8.2) > ReservationAgents are not correctly configured >

[jira] [Commented] (YARN-5703) ReservationAgents are not correctly configured

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149699#comment-16149699 ] Junping Du commented on YARN-5703: -- bq. Thanks for the contributions Manikandan R have com

[jira] [Commented] (YARN-5876) TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149696#comment-16149696 ] Junping Du commented on YARN-5876: -- [~yufeigu], branch-2 map to 2.9 release so we should p

[jira] [Updated] (YARN-5876) TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5876: - Fix Version/s: (was: 2.8.2) 2.9.0 > TestResourceTrackerService#testGracefulDecommiss

[jira] [Updated] (YARN-6463) correct spelling mistake in FileSystemRMStateStore

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6463: - Fix Version/s: (was: 2.8.2) > correct spelling mistake in FileSystemRMStateStore >

[jira] [Commented] (YARN-6463) correct spelling mistake in FileSystemRMStateStore

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149689#comment-16149689 ] Junping Du commented on YARN-6463: -- Drop 2.8.2 in fix version given the patch only lands o

[jira] [Updated] (YARN-6764) Simplify the logic in FairScheduler#attemptScheduling

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6764: - Fix Version/s: (was: 2.8.2) > Simplify the logic in FairScheduler#attemptScheduling > -

[jira] [Commented] (YARN-6764) Simplify the logic in FairScheduler#attemptScheduling

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149686#comment-16149686 ] Junping Du commented on YARN-6764: -- Drop 2.8.2 in fix version given the patch only lands o

[jira] [Commented] (YARN-6771) Use classloader inside configuration class to make new classes

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149681#comment-16149681 ] Junping Du commented on YARN-6771: -- Drop 2.8.2 in fix version. We should only use fix vers

[jira] [Updated] (YARN-6771) Use classloader inside configuration class to make new classes

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6771: - Fix Version/s: (was: 2.8.2) > Use classloader inside configuration class to make new classes > ---

[jira] [Commented] (YARN-6890) If UI is not secured, we allow user to kill other users' job even yarn cluster is secured.

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149639#comment-16149639 ] Junping Du commented on YARN-6890: -- Sounds like we forget to merge patch to branch-2.8.2.

[jira] [Commented] (YARN-7087) NM failed to perform log aggregation due to absent container

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149636#comment-16149636 ] Junping Du commented on YARN-7087: -- Sounds like we forget to merge patch to branch-2.8.2.

[jira] [Commented] (YARN-7051) Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149635#comment-16149635 ] Junping Du commented on YARN-7051: -- Sounds like we forget to merge patch to branch-2.8.2.

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149560#comment-16149560 ] Junping Du commented on YARN-6877: -- Thanks [~xgong] for updating the patch. 007 patch look

[jira] [Updated] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7138: - Target Version/s: 2.9.0, 3.0.0-beta1 (was: 3.0.0-beta1, 2.8.2) > Fix incompatible API change for YarnSched

[jira] [Comment Edited] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149505#comment-16149505 ] Junping Du edited comment on YARN-7138 at 8/31/17 8:12 PM: --- Thank

[jira] [Updated] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7138: - Priority: Critical (was: Blocker) > Fix incompatible API change for YarnScheduler involved by YARN-5521 >

[jira] [Commented] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149505#comment-16149505 ] Junping Du commented on YARN-7138: -- Thanks [~leftnoteasy] for reply. I agree in API defini

[jira] [Commented] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149474#comment-16149474 ] Junping Du commented on YARN-5547: -- Hi [~vrushalic], I am open to it if it can land on 2.8

[jira] [Updated] (YARN-7094) Document the current known issue with server-side NM graceful decom

2017-08-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7094: - Target Version/s: 2.9.0, 3.0.0-beta1 (was: 3.0.0-beta1) > Document the current known issue with server-sid

[jira] [Commented] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2017-08-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148294#comment-16148294 ] Junping Du commented on YARN-5221: -- This patch involve an incompatible change on YarnSched

[jira] [Commented] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

2017-08-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148295#comment-16148295 ] Junping Du commented on YARN-7138: -- CC [~leftnoteasy], [~asuresh]. > Fix incompatible API

[jira] [Created] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

2017-08-30 Thread Junping Du (JIRA)
Junping Du created YARN-7138: Summary: Fix incompatible API change for YarnScheduler involved by YARN-5521 Key: YARN-7138 URL: https://issues.apache.org/jira/browse/YARN-7138 Project: Hadoop YARN

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148098#comment-16148098 ] Junping Du commented on YARN-6877: -- Thanks Xuan for uploading a patch! Looks like in late

[jira] [Updated] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6091: - Target Version/s: 2.8.3 (was: 2.8.1) > the AppMaster register failed when use Docker on LinuxContainer >

[jira] [Commented] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146701#comment-16146701 ] Junping Du commented on YARN-6091: -- Thanks [~ebadger] for updating patch. This patch seems

[jira] [Commented] (YARN-7094) Document that server-side graceful decom is currently not recommended

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146488#comment-16146488 ] Junping Du commented on YARN-7094: -- Thanks Robert for updating the patch. +1 on 002 patch.

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146249#comment-16146249 ] Junping Du commented on YARN-6877: -- btw, I just commit YARN-7037 which may need a bit reba

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146181#comment-16146181 ] Junping Du commented on YARN-6877: -- Thanks [~xgong] for working on a patch. The patch is

[jira] [Updated] (YARN-7124) CLONE - Log aggregation deletes/renames while file is open

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7124: - Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.8.2) > CLONE - Log aggregation deletes/renames while file is

[jira] [Commented] (YARN-7083) Log aggregation deletes/renames while file is open

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146054#comment-16146054 ] Junping Du commented on YARN-7083: -- Ok. I have filed YARN-7124 to fix for trunk and branch

[jira] [Commented] (YARN-7094) Document that server-side graceful decom is currently not recommended

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146049#comment-16146049 ] Junping Du commented on YARN-7094: -- Hi [~rkanter], thanks for the patch here. The content

[jira] [Commented] (YARN-7124) CLONE - Log aggregation deletes/renames while file is open

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146034#comment-16146034 ] Junping Du commented on YARN-7124: -- YARN-7083 fixed branch-2.8 and branch-2.8.2. However,

[jira] [Assigned] (YARN-7124) CLONE - Log aggregation deletes/renames while file is open

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-7124: Assignee: (was: Jason Lowe) > CLONE - Log aggregation deletes/renames while file is open > -

[jira] [Created] (YARN-7124) CLONE - Log aggregation deletes/renames while file is open

2017-08-29 Thread Junping Du (JIRA)
Junping Du created YARN-7124: Summary: CLONE - Log aggregation deletes/renames while file is open Key: YARN-7124 URL: https://issues.apache.org/jira/browse/YARN-7124 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144635#comment-16144635 ] Junping Du commented on YARN-7076: -- btw, personally, I don't think it will be an incompati

[jira] [Updated] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7076: - Fix Version/s: 2.8.2 3.0.0-beta1 2.9.0 > yarn application -list -appT

[jira] [Commented] (YARN-7011) yarn-daemon.sh is not respecting --config option

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144625#comment-16144625 ] Junping Du commented on YARN-7011: -- I tried all 4 ways of config in HADOOP 2.7.3, 2.8.1 an

[jira] [Commented] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144602#comment-16144602 ] Junping Du commented on YARN-7076: -- Patch LGTM. +1. Committing it now. > yarn application

[jira] [Commented] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144412#comment-16144412 ] Junping Du commented on YARN-7076: -- Thanks [~jianhe] for updating the patch. 02 patch LGTM

[jira] [Commented] (YARN-7037) Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144398#comment-16144398 ] Junping Du commented on YARN-7037: -- bq. LogToolUtils#outputContainerLog was used for both

[jira] [Comment Edited] (YARN-7083) Log aggregation deletes/renames while file is open

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144317#comment-16144317 ] Junping Du edited comment on YARN-7083 at 8/28/17 8:48 PM: --- Trunk

[jira] [Commented] (YARN-7083) Log aggregation deletes/renames while file is open

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144317#comment-16144317 ] Junping Du commented on YARN-7083: -- Trunk code has changed significantly since YARN-6877 s

[jira] [Commented] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144268#comment-16144268 ] Junping Du commented on YARN-7076: -- Thanks [~jianhe] for delivering a quick fix. The patch

[jira] [Assigned] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-7076: Assignee: Jian He > yarn application -list -appTypes is not working > -

[jira] [Commented] (YARN-7076) yarn application -list -appTypes is not working

2017-08-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143275#comment-16143275 ] Junping Du commented on YARN-7076: -- Forget about my comments above, applicaitonState and o

[jira] [Commented] (YARN-7076) yarn application -list -appTypes is not working

2017-08-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143272#comment-16143272 ] Junping Du commented on YARN-7076: -- It sounds like submit an application against appType w

[jira] [Commented] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2017-08-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143262#comment-16143262 ] Junping Du commented on YARN-6091: -- bq. This will end up having stderr print to stderr of

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-08-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143259#comment-16143259 ] Junping Du commented on YARN-6550: -- Update 3.0.0-beta from fixed version to target version

[jira] [Updated] (YARN-6550) Capture launch_container.sh logs

2017-08-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6550: - Fix Version/s: (was: 3.0.0-beta1) > Capture launch_container.sh logs >

[jira] [Updated] (YARN-6550) Capture launch_container.sh logs

2017-08-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6550: - Target Version/s: 3.0.0-beta1 > Capture launch_container.sh logs > > >

[jira] [Commented] (YARN-7083) Log aggregation deletes/renames while file is open

2017-08-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143247#comment-16143247 ] Junping Du commented on YARN-7083: -- Thanks [~daryn] for reporting the issue and [~jlowe] f

<    1   2   3   4   5   6   7   8   9   10   >