[jira] [Created] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-11 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10312: -- Summary: Add support for yarn logs -logFile to retain backward compatibility Key: YARN-10312 URL: https://issues.apache.org/jira/browse/YARN-10312 Project: Hadoop YARN

[jira] [Assigned] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-10312: -- Attachment: YARN-10312.001.patch Assignee: Jim Brennan > Add support for yarn logs -logF

[jira] [Updated] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10312: --- Labels: compatibility (was: ) > Add support for yarn logs -logFile to retain backward compatibility

[jira] [Assigned] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-10297: -- Assignee: Jim Brennan > TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime

[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-8011: -- Attachment: YARN-8011-branch-2.10.001.patch > TestOpportunisticContainerAllocatorAMService#testContainer

[jira] [Commented] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133660#comment-17133660 ] Jim Brennan commented on YARN-8011: --- [~Tao Yang], [~cheersyang] we are seeing this inter

[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133708#comment-17133708 ] Jim Brennan commented on YARN-10312: Thanks [~ebadger]! I will put up a patches for

[jira] [Updated] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10312: --- Attachment: YARN-10312-branch-3.2.001.patch > Add support for yarn logs -logFile to retain backward c

[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133729#comment-17133729 ] Jim Brennan commented on YARN-10312: [~ebadger] I put up a patch for branch-3.2 and I

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133736#comment-17133736 ] Jim Brennan commented on YARN-10297: The unit test failures are unrelated to this fix

[jira] [Commented] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2020-06-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134242#comment-17134242 ] Jim Brennan commented on YARN-8011: --- Thanks [~Tao Yang]! > TestOpportunisticContainerA

[jira] [Updated] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-06-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10297: --- Attachment: YARN-10297.002.patch > TestContinuousScheduling#testFairSchedulerContinuousSchedulingInit

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-06-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134254#comment-17134254 ] Jim Brennan commented on YARN-10297: Thanks [~maniraj...@gmail.com]! patch 002 fixes

[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134283#comment-17134283 ] Jim Brennan commented on YARN-10312: I'm investigating that unit test failure in Test

[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134284#comment-17134284 ] Jim Brennan commented on YARN-10312: Looks like that test failure is reported in YARN

[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134287#comment-17134287 ] Jim Brennan commented on YARN-10312: I've also verified that it fails for me locally

[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility

2020-06-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134481#comment-17134481 ] Jim Brennan commented on YARN-10312: Thanks [~ebadger]! > Add support for yarn logs

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-06-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136003#comment-17136003 ] Jim Brennan commented on YARN-10297: Whitespace issues have been fixed, and the unit

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138833#comment-17138833 ] Jim Brennan commented on YARN-9809: --- [~eyang] I believe the health check script output m

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-18 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139451#comment-17139451 ] Jim Brennan commented on YARN-9809: --- [~eyang], [~ebadger] changing the behavior of healt

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-18 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139516#comment-17139516 ] Jim Brennan commented on YARN-9809: --- I have started reviewing the patch, but I will need

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140841#comment-17140841 ] Jim Brennan commented on YARN-9809: --- Thanks for the patch [~ebadger]! Overall I think t

[jira] [Updated] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-24 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-9903: -- Attachment: YARN-9903.003.patch > Support reservations continue looking for Node Labels > --

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-24 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17144181#comment-17144181 ] Jim Brennan commented on YARN-9903: --- [~epayne], I have added unit tests in patch 003.   

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-24 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17144241#comment-17144241 ] Jim Brennan commented on YARN-9903: --- I will put up a patch 004 to fix the checkstyle iss

[jira] [Updated] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-24 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-9903: -- Attachment: YARN-9903.004.patch > Support reservations continue looking for Node Labels > --

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-24 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17144290#comment-17144290 ] Jim Brennan commented on YARN-9903: --- patch 004 fixes the checkstyle issues.   > Suppor

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-24 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17144439#comment-17144439 ] Jim Brennan commented on YARN-9903: --- The two tests I added are basically the same, excep

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17144944#comment-17144944 ] Jim Brennan commented on YARN-9903: --- Thanks [~pbacsko]! {quote}I'm not sure if it's real

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17145096#comment-17145096 ] Jim Brennan commented on YARN-9903: --- Thanks [~epayne]! I will put up a patch for branch

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-06-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17145782#comment-17145782 ] Jim Brennan commented on YARN-10251: Thanks for the patch [~epayne]! Overall I think

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17145869#comment-17145869 ] Jim Brennan commented on YARN-9809: --- Thanks for the updates [~ebadger]!   I have one com

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-06-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17145875#comment-17145875 ] Jim Brennan commented on YARN-10251: Thanks [~epayne] for the updated patch and the e

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-06-26 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146397#comment-17146397 ] Jim Brennan commented on YARN-10251: Not sure why the precommit build did not run for

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-26 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146402#comment-17146402 ] Jim Brennan commented on YARN-9809: --- Thanks for the update [~ebadger]! I am +1 (non-bin

[jira] [Updated] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-26 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-9903: -- Attachment: YARN-9903-branch-3.2.001.patch > Support reservations continue looking for Node Labels > ---

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-26 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146497#comment-17146497 ] Jim Brennan commented on YARN-9903: --- [~epayne] I have uploaded a patch for branch-3.2 an

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17148075#comment-17148075 ] Jim Brennan commented on YARN-9903: --- Thanks [~epayne]!  I appreciate the followup on tho

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-07-01 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149673#comment-17149673 ] Jim Brennan commented on YARN-10251: Thanks for the additional patches [~epayne]!  I

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-07-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17150405#comment-17150405 ] Jim Brennan commented on YARN-10297: [~jhung] can you please review? > TestContinuou

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-07-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17150539#comment-17150539 ] Jim Brennan commented on YARN-10251: I agree that we ideally should be including all

[jira] [Created] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-08 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10348: -- Summary: Allow RM to always cancel tokens after app completes Key: YARN-10348 URL: https://issues.apache.org/jira/browse/YARN-10348 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153754#comment-17153754 ] Jim Brennan commented on YARN-10348: patch 001 adds a new YARN configuration property

[jira] [Updated] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10348: --- Attachment: YARN-10348.002.patch > Allow RM to always cancel tokens after app completes > ---

[jira] [Commented] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154011#comment-17154011 ] Jim Brennan commented on YARN-10348: patch 002 addresses the checkstyle issues and ad

[jira] [Commented] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154048#comment-17154048 ] Jim Brennan commented on YARN-10348: I have verified that TestDelegationTokenRenewer.

[jira] [Commented] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-09 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154647#comment-17154647 ] Jim Brennan commented on YARN-10348: The TestFairSchedulerPreemption unit test failur

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-07-09 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154720#comment-17154720 ] Jim Brennan commented on YARN-10297: As reported in [YARN-10329], TestFairScheduler i

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-07-09 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154732#comment-17154732 ] Jim Brennan commented on YARN-10297: I put up patch 003 which includes the fix for Te

[jira] [Updated] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-07-09 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10297: --- Attachment: YARN-10297.003.patch > TestContinuousScheduling#testFairSchedulerContinuousSchedulingInit

[jira] [Commented] (YARN-10329) Flaky test cases in Fair Scheduler

2020-07-09 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154945#comment-17154945 ] Jim Brennan commented on YARN-10329: I included a possible fix for the TestFairSchedu

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-07-10 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17155480#comment-17155480 ] Jim Brennan commented on YARN-10297: Thanks [~epayne]! The unit test failure in Test

[jira] [Commented] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156941#comment-17156941 ] Jim Brennan commented on YARN-10348: Anyone interested in reviewing this patch? cc: [

[jira] [Commented] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156965#comment-17156965 ] Jim Brennan commented on YARN-10343: Thanks for the patch, [~epayne]. A few comments

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-07-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157377#comment-17157377 ] Jim Brennan commented on YARN-10297: Thanks [~epayne] for committing this! > TestCon

[jira] [Commented] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157384#comment-17157384 ] Jim Brennan commented on YARN-10348: Thanks [~ebadger]! I will put up patches for th

[jira] [Updated] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10348: --- Attachment: YARN-10348-branch-3.2.001.patch > Allow RM to always cancel tokens after app completes >

[jira] [Commented] (YARN-10348) Allow RM to always cancel tokens after app completes

2020-07-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157442#comment-17157442 ] Jim Brennan commented on YARN-10348: I put up a patch for branch-3.2 and I verified t

[jira] [Commented] (YARN-1741) XInclude support broken for YARN ResourceManager

2020-07-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159326#comment-17159326 ] Jim Brennan commented on YARN-1741: --- While reviewing changes we made for our internal br

[jira] [Comment Edited] (YARN-1741) XInclude support broken for YARN ResourceManager

2020-07-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159326#comment-17159326 ] Jim Brennan edited comment on YARN-1741 at 7/16/20, 4:10 PM: -

[jira] [Created] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-16 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10353: -- Summary: Log vcores used and cumulative cpu in containers monitor Key: YARN-10353 URL: https://issues.apache.org/jira/browse/YARN-10353 Project: Hadoop YARN Issu

[jira] [Commented] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159975#comment-17159975 ] Jim Brennan commented on YARN-10353: This is just adding some extra data to an Audit

[jira] [Commented] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160121#comment-17160121 ] Jim Brennan commented on YARN-10353: Thanks for the comments [~ebadger]!  I am defini

[jira] [Commented] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160233#comment-17160233 ] Jim Brennan commented on YARN-10353: Here's another proposal: {noformat} 2020-07-17 2

[jira] [Updated] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10353: --- Attachment: YARN-10353.002.patch > Log vcores used and cumulative cpu in containers monitor > ---

[jira] [Commented] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160239#comment-17160239 ] Jim Brennan commented on YARN-10353: I put up patch 002 based on the latest proposal.

[jira] [Commented] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-20 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161286#comment-17161286 ] Jim Brennan commented on YARN-10343: Thanks for the updates and explanations [~epayne

[jira] [Commented] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-20 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161448#comment-17161448 ] Jim Brennan commented on YARN-10353: Thanks [~ebadger]! > Log vcores used and cumula

[jira] [Assigned] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-07-21 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-4771: - Assignee: Jim Brennan > Some containers can be skipped during log aggregation after NM restart >

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-07-21 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-4771: -- Attachment: YARN-4771.003.patch > Some containers can be skipped during log aggregation after NM restart

[jira] [Commented] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-07-22 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162728#comment-17162728 ] Jim Brennan commented on YARN-4771: --- I don't think the TestFederationInterceptor unit te

[jira] [Commented] (YARN-10363) TestRMAdminCLI.testHelp is failing in branch-2.10

2020-07-22 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162926#comment-17162926 ] Jim Brennan commented on YARN-10363: cc: [~aajisaka], [~risyomei] > TestRMAdminCLI.t

[jira] [Created] (YARN-10363) TestRMAdminCLI.testHelp is failing in branch-2.10

2020-07-22 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10363: -- Summary: TestRMAdminCLI.testHelp is failing in branch-2.10 Key: YARN-10363 URL: https://issues.apache.org/jira/browse/YARN-10363 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-07-23 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163705#comment-17163705 ] Jim Brennan commented on YARN-4771: --- I think this is ready for review. cc: [~epayne], [~

[jira] [Commented] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-07-27 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165736#comment-17165736 ] Jim Brennan commented on YARN-4771: --- Thanks [~ebadger]! > Some containers can be skippe

[jira] [Commented] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-07-27 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165985#comment-17165985 ] Jim Brennan commented on YARN-10369: Other RM log messages contain the same informati

[jira] [Assigned] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-07-27 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-10369: -- Assignee: Jim Brennan > Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG > -

[jira] [Created] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-07-27 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10369: -- Summary: Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG Key: YARN-10369 URL: https://issues.apache.org/jira/browse/YARN-10369 Project: Hadoop YARN

[jira] [Commented] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-07-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17166430#comment-17166430 ] Jim Brennan commented on YARN-10369: Thanks [~BilwaST], I will make the suggested cha

[jira] [Updated] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-07-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10369: --- Attachment: YARN-10369.002.patch > Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG > -

[jira] [Commented] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-07-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17166674#comment-17166674 ] Jim Brennan commented on YARN-10369: The unit test TestDelegationTokenRenewer failure

[jira] [Commented] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-07-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167218#comment-17167218 ] Jim Brennan commented on YARN-10369: Thanks for the review [~BilwaST]! [~ebadger] ca

[jira] [Assigned] (YARN-1529) Add Localization overhead metrics to NM

2020-07-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-1529: - Assignee: Jim Brennan (was: Chris Trezzo) > Add Localization overhead metrics to NM > --

[jira] [Commented] (YARN-10363) TestRMAdminCLI.testHelp is failing in branch-2.10

2020-07-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167379#comment-17167379 ] Jim Brennan commented on YARN-10363: Thanks for the patch [~BilwaST]! It looks good

[jira] [Commented] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-07-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167445#comment-17167445 ] Jim Brennan commented on YARN-10369: Thanks [~bibinchundatt]! > Make NMTokenSecretMa

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167465#comment-17167465 ] Jim Brennan commented on YARN-1529: --- The TestContainerLaunch failures look like they ar

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167499#comment-17167499 ] Jim Brennan commented on YARN-1529: --- [~epayne], for the checkstyle issues: {quote}./hado

[jira] [Updated] (YARN-1529) Add Localization overhead metrics to NM

2020-07-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-1529: -- Attachment: YARN-1529.006.patch > Add Localization overhead metrics to NM >

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167516#comment-17167516 ] Jim Brennan commented on YARN-1529: --- [~epayne] I trust you to resolve the minor conflict

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-30 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168136#comment-17168136 ] Jim Brennan commented on YARN-1529: --- Thanks [~epayne]!  I will put up a patch for branch

[jira] [Updated] (YARN-1529) Add Localization overhead metrics to NM

2020-07-30 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-1529: -- Attachment: YARN-1529-branch-2.10.001.patch > Add Localization overhead metrics to NM >

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-30 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168161#comment-17168161 ] Jim Brennan commented on YARN-1529: --- [~epayne] I have uploaded a patch for branch-2.10. 

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-30 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168213#comment-17168213 ] Jim Brennan commented on YARN-1529: --- Thanks [~epayne]! > Add Localization overhead metr

[jira] [Commented] (YARN-2695) Support continuously looking reserved container with node labels

2020-07-31 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169103#comment-17169103 ] Jim Brennan commented on YARN-2695: --- [~epayne] I believe this can be closed as a duplica

[jira] [Commented] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-07-31 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169104#comment-17169104 ] Jim Brennan commented on YARN-4575: --- [~epayne] this looks good to me.  I also downloaded

[jira] [Reopened] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2020-08-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reopened YARN-7677: --- Reopening so I can put up a patch for branch-2.10 > Docker image cannot set HADOOP_CONF_DIR > ---

[jira] [Updated] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2020-08-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-7677: -- Attachment: YARN-7677-branch-2.10.002.patch > Docker image cannot set HADOOP_CONF_DIR >

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2020-08-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170403#comment-17170403 ] Jim Brennan commented on YARN-7677: --- I submitted patch branch-2.10-002 to fix most of th

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2020-08-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170449#comment-17170449 ] Jim Brennan commented on YARN-7677: --- The TestFederationInterceptor unit test failure is

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-08-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170947#comment-17170947 ] Jim Brennan commented on YARN-10251: [~epayne] thanks for the update!  I am +1 on pat

  1   2   3   4   5   6   7   8   9   >