[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862821#comment-16862821 ] Tao Yang commented on YARN-8995: Thanks [~zhuqi] for updating the patch. Comments for the new patch: *

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-13 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862867#comment-16862867 ] Abhishek Modi commented on YARN-9608: - Thanks [~tangzhankun] for reviewing it. >

[jira] [Comment Edited] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862821#comment-16862821 ] Tao Yang edited comment on YARN-8995 at 6/13/19 8:27 AM: - Thanks [~zhuqi] for

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862866#comment-16862866 ] Tao Yang commented on YARN-8995: I did a simple test on performance comparison between sequential stream

[jira] [Comment Edited] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862866#comment-16862866 ] Tao Yang edited comment on YARN-8995 at 6/13/19 9:29 AM: - I did a simple test

[jira] [Updated] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8995: --- Attachment: TestStreamPerf.java > Log the event type of the too big AsyncDispatcher event queue size, and add

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-13 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862793#comment-16862793 ] Abhishek Modi commented on YARN-9608: - Thanks [~tangzhankun] for going through patch: {quote} # If

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862826#comment-16862826 ] Zhankun Tang commented on YARN-9608: [~abmodi], Yeah. Thanks for the explanation! +1 from me. I can

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862988#comment-16862988 ] Szilard Nemeth commented on YARN-9607: -- Oh, one more thing: As you are overriding the config in

[jira] [Updated] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8995: --- Attachment: (was: TestStreamPerf.java) > Log the event type of the too big AsyncDispatcher event queue

[jira] [Updated] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8995: --- Attachment: TestStreamPerf.java > Log the event type of the too big AsyncDispatcher event queue size, and add

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862984#comment-16862984 ] Szilard Nemeth commented on YARN-9607: -- Hi [~adam.antal]! 2 comments: 1. In the test code, you are

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-13 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863169#comment-16863169 ] Adam Antal commented on YARN-9525: -- Sorry for the delayed answer, let me recap my current progress. I

[jira] [Created] (YARN-9621) Test failure TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9621: -- Summary: Test failure TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1 Key: YARN-9621 URL: https://issues.apache.org/jira/browse/YARN-9621

[jira] [Updated] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9622: --- Affects Version/s: 3.2.0 > All testcase fails in TestTimelineReaderWebServicesHBaseStorage on

[jira] [Created] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage

2019-06-13 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9622: -- Summary: All testcase fails in TestTimelineReaderWebServicesHBaseStorage Key: YARN-9622 URL: https://issues.apache.org/jira/browse/YARN-9622 Project: Hadoop YARN

[jira] [Commented] (YARN-4042) YARN registry should handle the absence of ZK node

2019-06-13 Thread wangxiangchun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863058#comment-16863058 ] wangxiangchun commented on YARN-4042: - hi, can I ask that how you solve the problem? I encountered the

[jira] [Updated] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9622: --- Summary: All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2 (was: All

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-13 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9525: - Attachment: YARN-9525.004.patch > IFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-06-13 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863066#comment-16863066 ] Tarun Parimi commented on YARN-9209: Hi [~cheersyang], [~leftnoteasy] , Any way to proceed further

[jira] [Assigned] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph reassigned YARN-9622: --- Assignee: Prabhu Joseph > All testcase fails in TestTimelineReaderWebServicesHBaseStorage on

[jira] [Assigned] (YARN-9621) Test failure TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph reassigned YARN-9621: --- Assignee: Prabhu Joseph > Test failure >

[jira] [Commented] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863128#comment-16863128 ] Prabhu Joseph commented on YARN-9622: - Will work on this, assigning to me. > All testcase fails in

[jira] [Commented] (YARN-9621) Test failure TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863059#comment-16863059 ] Peter Bacsko commented on YARN-9621: [~Prabhu Joseph] do you know how to fix this? Branch 3.1 is still

[jira] [Updated] (YARN-9621) Test failure TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9621: --- Component/s: test distributed-shell > Test failure >

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863205#comment-16863205 ] Hadoop QA commented on YARN-9209: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863207#comment-16863207 ] Peter Bacsko commented on YARN-9525: That's some nice finding [~adam.antal]. Looks like I

[jira] [Updated] (YARN-9621) FIX TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9621: Summary: FIX TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on

[jira] [Commented] (YARN-9621) FIX TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863472#comment-16863472 ] Hadoop QA commented on YARN-9621: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9621) FIX TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9621: Attachment: YARN-9621-branch-3.1.001.patch > FIX

[jira] [Commented] (YARN-8856) TestTimelineReaderWebServicesHBaseStorage tests failing with NoClassDefFoundError

2019-06-13 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863471#comment-16863471 ] Íñigo Goiri commented on YARN-8856: --- [~Prabhu Joseph], backported to branch-3.2. >

[jira] [Commented] (YARN-9621) FIX TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863409#comment-16863409 ] Prabhu Joseph commented on YARN-9621: - {{TestDSWithMultipleNodeManager}} does not have tearDown

[jira] [Commented] (YARN-6055) ContainersMonitorImpl need be adjusted when NM resource changed.

2019-06-13 Thread Pradeep Ambati (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863228#comment-16863228 ] Pradeep Ambati commented on YARN-6055: -- Patch looks good. +1 > ContainersMonitorImpl need be

[jira] [Commented] (YARN-8856) TestTimelineReaderWebServicesHBaseStorage tests failing with NoClassDefFoundError

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863287#comment-16863287 ] Prabhu Joseph commented on YARN-8856: - [~Sushil-K-S] [~elgoiri] The testcases are failing in

[jira] [Commented] (YARN-9599) TestContainerSchedulerQueuing#testQueueShedding fails intermittently.

2019-06-13 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863345#comment-16863345 ] Giovanni Matteo Fumarola commented on YARN-9599: Committed to trunk. Thanks [~elgoiri] for

[jira] [Commented] (YARN-8499) ATS v2 Generic TimelineStorageMonitor

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863324#comment-16863324 ] Prabhu Joseph commented on YARN-8499: - Thanks [~snemeth] for the review. [~eyang] Can you review this

[jira] [Updated] (YARN-9599) TestContainerSchedulerQueuing#testQueueShedding fails intermittently.

2019-06-13 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-9599: --- Fix Version/s: 3.3.0 > TestContainerSchedulerQueuing#testQueueShedding fails

[jira] [Commented] (YARN-9599) TestContainerSchedulerQueuing#testQueueShedding fails intermittently.

2019-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863343#comment-16863343 ] Hudson commented on YARN-9599: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16739 (See

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863230#comment-16863230 ] Hadoop QA commented on YARN-9525: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863280#comment-16863280 ] Prabhu Joseph commented on YARN-9622: - [~pbacsko] This issues is fixed by YARN-8856 in trunk. It also

[jira] [Resolved] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2

2019-06-13 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph resolved YARN-9622. - Resolution: Duplicate > All testcase fails in TestTimelineReaderWebServicesHBaseStorage on

[jira] [Assigned] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9525: -- Assignee: Adam Antal (was: Peter Bacsko) > IFile format is not working against s3a remote

[jira] [Commented] (YARN-9619) Transfer error AM host/ip when launching app using docker container with bridge network

2019-06-13 Thread caozhiqiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863616#comment-16863616 ] caozhiqiang commented on YARN-9619: --- Thanks for your comments, [~eyang]. Launching application with

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: (was: image-2019-06-14-11-14-31-874.png) > Add diagnostics for outstanding resource requests

[jira] [Comment Edited] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855530#comment-16855530 ] Tao Yang edited comment on YARN-9567 at 6/14/19 3:24 AM: - Some updates about this

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: YARN-9567.001.patch > Add diagnostics for outstanding resource requests on app attempts page >

[jira] [Created] (YARN-9623) Auto adjust queue length of app activities to make sure activities on all nodes can be covered

2019-06-13 Thread Tao Yang (JIRA)
Tao Yang created YARN-9623: -- Summary: Auto adjust queue length of app activities to make sure activities on all nodes can be covered Key: YARN-9623 URL: https://issues.apache.org/jira/browse/YARN-9623

[jira] [Updated] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-13 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-8995: Attachment: YARN-8995.004.patch > Log the event type of the too big AsyncDispatcher event queue size, and add >

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862789#comment-16862789 ] Zhankun Tang commented on YARN-9608: [~abmodi], Thanks. Just read through the whole patch. Two

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863691#comment-16863691 ] Tao Yang commented on YARN-9567: Thanks [~cheersyang]. Attached v1 patch for review. > Add diagnostics

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-13 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863712#comment-16863712 ] zhuqi commented on YARN-8995: - cc  [~Tao Yang] Thanks [~Tao Yang] for your comment and persuasive test

[jira] [Updated] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9623: --- Summary: Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

[jira] [Commented] (YARN-9619) Transfer error AM host/ip when launching app using docker container with bridge network

2019-06-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863509#comment-16863509 ] Eric Yang commented on YARN-9619: - [~caozhiqiang] Sorry, I am not entirely sure that I understand the