[jira] [Commented] (YARN-9509) Capped cpu usage with cgroup strict-resource-usage based on a mulitplier

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902693#comment-16902693 ] Hadoop QA commented on YARN-9509: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902675#comment-16902675 ] Hadoop QA commented on YARN-9009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-9601) Potential NPE in ZookeeperFederationStateStore#getPoliciesConfigurations

2019-08-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved YARN-9601. --- Resolution: Fixed Fix Version/s: 3.3.0 I reviewed and merged the PR. Close this patch.

[jira] [Commented] (YARN-9468) Fix inaccurate documentations in Placement Constraints

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902667#comment-16902667 ] Hadoop QA commented on YARN-9468: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9579) the property of sharedcache in mapred-default.xml

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902650#comment-16902650 ] Hadoop QA commented on YARN-9579: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-9683) Remove reapDockerContainerNoPid left behind by YARN-9074

2019-08-07 Thread kevin su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevin su reassigned YARN-9683: -- Assignee: kevin su > Remove reapDockerContainerNoPid left behind by YARN-9074 >

[jira] [Commented] (YARN-9601) Potential NPE in ZookeeperFederationStateStore#getPoliciesConfigurations

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902641#comment-16902641 ] Hadoop QA commented on YARN-9601: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902521#comment-16902521 ] Hadoop QA commented on YARN-7427: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2019-08-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902454#comment-16902454 ] Jonathan Hung commented on YARN-7427: - Nope, no objections. Thanks for following up on this! >

[jira] [Commented] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2019-08-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902424#comment-16902424 ] Eric Payne commented on YARN-7427: -- [~jhung], this appears to be fixed by YARN-9685. Any objections if I

[jira] [Commented] (YARN-9685) NPE when rendering the info table of leaf queue in non-accessible partitions

2019-08-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902422#comment-16902422 ] Eric Payne commented on YARN-9685: -- Thanks a lot, [~Tao Yang], for raising this issue and providing the

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-07 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902405#comment-16902405 ] Jim Brennan commented on YARN-9442: --- [~ebadger], I've put up a new patch that applies to trunk.   >

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902378#comment-16902378 ] Hadoop QA commented on YARN-9442: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9442) container working directory has group read permissions

2019-08-07 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-9442: -- Attachment: YARN-9442.003.patch > container working directory has group read permissions >

[jira] [Commented] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902199#comment-16902199 ] Eric Yang commented on YARN-9719: - [~kyungwan nam] The failed test cases are related to this patch. Could

[jira] [Updated] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-08-07 Thread Thomas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas updated YARN-9728: - Description: When a spark job throws an exception with a message containing a character out of the range

[jira] [Updated] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-08-07 Thread Thomas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas updated YARN-9728: - Description: When a spark job throws an exception with a message containing a character out of the range

[jira] [Created] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-08-07 Thread Thomas (JIRA)
Thomas created YARN-9728: Summary:  ResourceManager REST API can produce an illegal xml response Key: YARN-9728 URL: https://issues.apache.org/jira/browse/YARN-9728 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-9727) Allowed Origin pattern is discouraged if regex contains *

2019-08-07 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902153#comment-16902153 ] Zoltan Siegl commented on YARN-9727: There is a test case for the given problem, where a warning was

[jira] [Commented] (YARN-9727) Allowed Origin pattern is discouraged if regex contains *

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902077#comment-16902077 ] Hadoop QA commented on YARN-9727: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-07 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902072#comment-16902072 ] Jim Brennan commented on YARN-9442: --- Thanks [~ebadger].  The current patch no longer applies, so I will

[jira] [Commented] (YARN-8045) Reduce log output from container status calls

2019-08-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902067#comment-16902067 ] Shane Kumpf commented on YARN-8045: --- +1 on the 2.8 patch. Feel free to go ahead with committing it. >

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902044#comment-16902044 ] Hadoop QA commented on YARN-9134: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902031#comment-16902031 ] Hadoop QA commented on YARN-9217: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-07 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902027#comment-16902027 ] Zac Zhou commented on YARN-9721: Thanks, [~tangzhankun], I prefer method 1 and 2.  Method 2 can work the

[jira] [Updated] (YARN-9727) Allowed Origin pattern is discouraged if regex contains *

2019-08-07 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Siegl updated YARN-9727: --- Attachment: YARN-9727.001.patch > Allowed Origin pattern is discouraged if regex contains * >

[jira] [Moved] (YARN-9727) Allowed Origin pattern is discouraged if regex contains *

2019-08-07 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Siegl moved HADOOP-16497 to YARN-9727: - Key: YARN-9727 (was: HADOOP-16497) Project: Hadoop YARN (was:

[jira] [Updated] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-07 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9134: --- Attachment: YARN-9134.003.patch > No test coverage for redefining FPGA / GPU resource types in

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-07 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902007#comment-16902007 ] Peter Bacsko commented on YARN-9134: Rebased the patch. > No test coverage for redefining FPGA / GPU

[jira] [Commented] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-07 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901986#comment-16901986 ] Peter Bacsko commented on YARN-9217: This patch needed yet another rebase due to renames. >

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-07 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.006.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Updated] (YARN-9725) [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications - Logs Section

2019-08-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9725: Description: [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications -

[jira] [Updated] (YARN-9726) [YARN UI2] Implement server side pagination for logs in application, service and nodes pages

2019-08-07 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-9726: --- Description: Currently in application and service logs pages, logs are shown using client side pagging. This

[jira] [Updated] (YARN-9726) [YARN UI2] Implement server side pagination for logs in application, service and nodes pages

2019-08-07 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-9726: --- Summary: [YARN UI2] Implement server side pagination for logs in application, service and nodes pages (was:

[jira] [Created] (YARN-9726) [YARN UI2] Implement server side pagging in logs in application/service and nodes pages

2019-08-07 Thread Akhil PB (JIRA)
Akhil PB created YARN-9726: -- Summary: [YARN UI2] Implement server side pagging in logs in application/service and nodes pages Key: YARN-9726 URL: https://issues.apache.org/jira/browse/YARN-9726 Project:

[jira] [Updated] (YARN-9726) [YARN UI2] Implement server side pagination for logs in application/service and nodes pages

2019-08-07 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-9726: --- Summary: [YARN UI2] Implement server side pagination for logs in application/service and nodes pages (was:

[jira] [Updated] (YARN-9725) [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications - Logs Section

2019-08-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9725: Description: [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications -

[jira] [Updated] (YARN-9725) [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications - Logs Section

2019-08-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9725: Summary: [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications - Logs

[jira] [Updated] (YARN-9725) [YARN UI2] Running Containers Logs are not shown in Applications - Logs Section

2019-08-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9725: Description: [YARN UI2] Running Containers Logs are not shown in Applications - Logs Section. It

[jira] [Updated] (YARN-9725) [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications - Logs Section

2019-08-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9725: Description: [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications -

[jira] [Updated] (YARN-9725) [YARN UI2] Running Containers Logs are not shown in Applications - Logs Section

2019-08-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9725: Attachment: Running_Container2_UI.png Running_Container_Log_Dir.png > [YARN UI2]

[jira] [Updated] (YARN-9725) [YARN UI2] Running Containers Logs are not shown in Applications - Logs Section

2019-08-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9725: Attachment: Running_Container_Logs.png NM_Local_Dir.png

[jira] [Created] (YARN-9725) [YARN UI2] Running Containers Logs are not shown in Applications - Logs Section

2019-08-07 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9725: --- Summary: [YARN UI2] Running Containers Logs are not shown in Applications - Logs Section Key: YARN-9725 URL: https://issues.apache.org/jira/browse/YARN-9725 Project:

[jira] [Commented] (YARN-5857) TestLogAggregationService.testFixedSizeThreadPool fails intermittently on trunk

2019-08-07 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901915#comment-16901915 ] Adam Antal commented on YARN-5857: -- Agree on the idea [~ajithshetty] has written previously. Would you

[jira] [Commented] (YARN-5857) TestLogAggregationService.testFixedSizeThreadPool fails intermittently on trunk

2019-08-07 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901898#comment-16901898 ] Adam Antal commented on YARN-5857: -- This test still fails (look last patch build on YARN-9559). I was

[jira] [Updated] (YARN-5857) TestLogAggregationService.testFixedSizeThreadPool fails intermittently on trunk

2019-08-07 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-5857: - Attachment: testFixedSizeThreadPool failure reproduction >

[jira] [Updated] (YARN-9725) [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications - Logs Section

2019-08-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9725: Description: [YARN UI2] Running Containers Logs from NM Local Dir are not shown in Applications -

[jira] [Commented] (YARN-9724) ERROR SparkContext: Error initializing SparkContext.

2019-08-07 Thread panlijie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901801#comment-16901801 ] panlijie commented on YARN-9724: @[~ste...@apache.org] I confirm that in 

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-08-07 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901762#comment-16901762 ] Szilard Nemeth commented on YARN-9667: -- Thanks [~eyang]! > Container-executor.c duplicates messages