[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko edited comment on YARN-9899 at 10/14/19 8:28 PM: -- [~snemeth] my

[jira] [Commented] (YARN-9773) Add QueueMetrics for Custom Resources

2019-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951386#comment-16951386 ] Eric Payne commented on YARN-9773: -- Thanks again, [~maniraj...@gmail.com]. The changes look good. I'm

[jira] [Commented] (YARN-9656) Plugin to avoid scheduling jobs on node which are not in "schedulable" state, but are healthy otherwise.

2019-10-14 Thread Mayank Bansal (Jira)
[ https://issues.apache.org/jira/browse/YARN-9656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951393#comment-16951393 ] Mayank Bansal commented on YARN-9656: - [~wangda] We should not make full cluster unhealthy otherwise

[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko edited comment on YARN-9899 at 10/14/19 8:29 PM: -- [~snemeth] my

[jira] [Commented] (YARN-9656) Plugin to avoid scheduling jobs on node which are not in "schedulable" state, but are healthy otherwise.

2019-10-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951399#comment-16951399 ] Wangda Tan commented on YARN-9656: -- [~pgolash], [~mayank_bansal], to me if a node cannot schedule new

[jira] [Commented] (YARN-9881) Change Cluster_Scheduler_API's Item memory‘s datatype from int to long.

2019-10-14 Thread jenny (Jira)
[ https://issues.apache.org/jira/browse/YARN-9881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951474#comment-16951474 ] jenny commented on YARN-9881: - I need review, Thanks in advance:-) Sunil G Wangda Tan Weiwei Yang Giovanni

[jira] [Commented] (YARN-5718) TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior

2019-10-14 Thread Wang, Xinglong (Jira)
[ https://issues.apache.org/jira/browse/YARN-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951623#comment-16951623 ] Wang, Xinglong commented on YARN-5718: -- I went through hdfs code, and also found the issue is only

[jira] [Comment Edited] (YARN-9881) Change Cluster_Scheduler_API's Item memory‘s datatype from int to long.

2019-10-14 Thread jenny (Jira)
[ https://issues.apache.org/jira/browse/YARN-9881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951474#comment-16951474 ] jenny edited comment on YARN-9881 at 10/15/19 2:10 AM: --- I need review, Thanks in

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

2019-10-14 Thread Amithsha (Jira)
[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951535#comment-16951535 ] Amithsha commented on YARN-8737: 2019-10-12 04:38:04,409 FATAL event.EventDispatcher (?:?

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

2019-10-14 Thread Amithsha (Jira)
[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951536#comment-16951536 ] Amithsha commented on YARN-8737: Observed same issue in 2.9.0 > Race condition in ParentQueue when

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

2019-10-14 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951552#comment-16951552 ] Tao Yang commented on YARN-8737: Thanks [~Amithsha] for the feedback. Sorry to have forgot this issue for

[jira] [Commented] (YARN-9901) Comparison method violates its general contract!

2019-10-14 Thread Amithsha (Jira)
[ https://issues.apache.org/jira/browse/YARN-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951541#comment-16951541 ] Amithsha commented on YARN-9901: https://issues.apache.org/jira/browse/YARN-8764 > Comparison method

[jira] [Updated] (YARN-9901) Comparison method violates its general contract!

2019-10-14 Thread Amithsha (Jira)
[ https://issues.apache.org/jira/browse/YARN-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amithsha updated YARN-9901: --- Description: 2019-10-12 04:38:04,409 FATAL event.EventDispatcher (?:?

[jira] [Comment Edited] (YARN-9901) Comparison method violates its general contract!

2019-10-14 Thread Amithsha (Jira)
[ https://issues.apache.org/jira/browse/YARN-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951541#comment-16951541 ] Amithsha edited comment on YARN-9901 at 10/15/19 3:48 AM: --

[jira] [Created] (YARN-9901) Comparison method violates its general contract!

2019-10-14 Thread Amithsha (Jira)
Amithsha created YARN-9901: -- Summary: Comparison method violates its general contract! Key: YARN-9901 URL: https://issues.apache.org/jira/browse/YARN-9901 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5748) Backport YARN-5718 to branch-2

2019-10-14 Thread Wang, Xinglong (Jira)
[ https://issues.apache.org/jira/browse/YARN-5748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951621#comment-16951621 ] Wang, Xinglong commented on YARN-5748: -- I went through hdfs code, and also found the issue is only

[jira] [Commented] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950865#comment-16950865 ] Hadoop QA commented on YARN-8453: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-9899) [Phase 2] Migration tool that help to generate CS config based on FS config

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9899: Assignee: (was: Peter Bacsko) > [Phase 2] Migration tool that help to generate CS

[jira] [Created] (YARN-9899) [Phase 2] Migration tool that help to generate CS config based on FS config

2019-10-14 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-9899: Summary: [Phase 2] Migration tool that help to generate CS config based on FS config Key: YARN-9899 URL: https://issues.apache.org/jira/browse/YARN-9899 Project:

[jira] [Commented] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-10-14 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950890#comment-16950890 ] zhoukang commented on YARN-9739: [~Prabhu Joseph] [~tangzhankun]any suggestion?if not, i will post a patch

[jira] [Updated] (YARN-9899) [Phase 2] Migration tool that help to generate CS config based on FS config

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9899: - Reporter: Szilard Nemeth (was: Wanqiang Ji) > [Phase 2] Migration tool that help to generate CS

[jira] [Assigned] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9899: Assignee: Szilard Nemeth > Migration tool that help to generate CS config based on FS

[jira] [Assigned] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9899: -- Assignee: Peter Bacsko (was: Szilard Nemeth) > Migration tool that help to generate CS config

[jira] [Updated] (YARN-9689) Router does not support kerberos proxy when in secure mode

2019-10-14 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9689: --- Attachment: YARN-9689.001.patch > Router does not support kerberos proxy when in secure mode >

[jira] [Commented] (YARN-9689) Router does not support kerberos proxy when in secure mode

2019-10-14 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950913#comment-16950913 ] zhoukang commented on YARN-9689: [~botong][~giovanni.fumarola] Could help review this? > Router does not

[jira] [Updated] (YARN-9836) General usability improvements in showSimulationTrace.html

2019-10-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9836: - Attachment: YARN-9836.branch-3.1.001.patch > General usability improvements in showSimulationTrace.html >

[jira] [Commented] (YARN-9836) General usability improvements in showSimulationTrace.html

2019-10-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950919#comment-16950919 ] Adam Antal commented on YARN-9836: -- Thanks for the review [~shuzirra], and [~snemeth] for the commit!

[jira] [Updated] (YARN-9836) General usability improvements in showSimulationTrace.html

2019-10-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9836: - Attachment: YARN-9836.branch-3.2.001.patch > General usability improvements in showSimulationTrace.html >

[jira] [Commented] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

2019-10-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950923#comment-16950923 ] Adam Antal commented on YARN-8453: -- Thanks [~snemeth] for the commit! > Additional Unit tests to verify

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950863#comment-16950863 ] Peter Bacsko commented on YARN-9840: [~snemeth]: I think so - this is an enhancement. A couple of

[jira] [Commented] (YARN-9537) Add configuration to disable AM preemption

2019-10-14 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950882#comment-16950882 ] zhoukang commented on YARN-9537: ping [~tangzhankun] could you help review this feature? > Add

[jira] [Updated] (YARN-9605) Add ZkConfiguredFailoverProxyProvider for RM HA

2019-10-14 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9605: --- Attachment: YARN-9605.002.patch > Add ZkConfiguredFailoverProxyProvider for RM HA >

[jira] [Updated] (YARN-9899) [Phase 2] Migration tool that help to generate CS config based on FS config

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9899: - Description: YARN-9699 laid down the groundworks of a converter from FS to CS config. During the

[jira] [Commented] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950860#comment-16950860 ] Hadoop QA commented on YARN-8453: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9899) [Phase 2] Migration tool that help to generate CS config based on FS config

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9899: - Description: YARN-9699 laid down the groundworks of a converter from FS to CS config. During the

[jira] [Commented] (YARN-9605) Add ZkConfiguredFailoverProxyProvider for RM HA

2019-10-14 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950901#comment-16950901 ] zhoukang commented on YARN-9605: [~tangzhankun]Fix the compile error.Sorry for this careless mistake >

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9899: - Summary: Migration tool that help to generate CS config based on FS config [Phase 2] (was:

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config [Phase 1]

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9699: - Summary: Migration tool that help to generate CS config based on FS config [Phase 1] (was:

[jira] [Updated] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8453: - Attachment: YARN-8453.branch-3.2.001.patch > Additional Unit tests to verify queue limit and

[jira] [Created] (YARN-9898) Dependency netty-all-4.1.27.Final doesn

2019-10-14 Thread liusheng (Jira)
liusheng created YARN-9898: -- Summary: Dependency netty-all-4.1.27.Final doesn Key: YARN-9898 URL: https://issues.apache.org/jira/browse/YARN-9898 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-10-14 Thread Gaurav Suman (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950769#comment-16950769 ] Gaurav Suman commented on YARN-6492: can we use this patch in hadoop 3.0? > Generate queue metrics

[jira] [Commented] (YARN-9881) Change Cluster_Scheduler_API's Item memory‘s datatype from int to long.

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950771#comment-16950771 ] Hadoop QA commented on YARN-9881: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9699) [Phase 1] Migration tool that help to generate CS config based on FS config

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950780#comment-16950780 ] Szilard Nemeth commented on YARN-9699: -- Will commit this EOD (CEST) if no ojections. > [Phase 1]

[jira] [Updated] (YARN-9898) Dependency netty-all-4.1.27.Final doesn't support ARM platform

2019-10-14 Thread liusheng (Jira)
[ https://issues.apache.org/jira/browse/YARN-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liusheng updated YARN-9898: --- Description: Hadoop dependent the Netty package, but the *netty-all-4.1.27.Final* of io.netty maven repo,

[jira] [Updated] (YARN-9898) Dependency netty-all-4.1.27.Final doesn't support ARM platform

2019-10-14 Thread liusheng (Jira)
[ https://issues.apache.org/jira/browse/YARN-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liusheng updated YARN-9898: --- Description: Hadoop dependent the Netty package, but the *netty-all-4.1.27.Final* of io.netty maven repo,

[jira] [Commented] (YARN-9689) Router does not support kerberos proxy when in secure mode

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950965#comment-16950965 ] Hadoop QA commented on YARN-9689: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9900) Revert Invalid Config and Refresh Support in SchedulerConfig Format

2019-10-14 Thread Prabhu Joseph (Jira)
Prabhu Joseph created YARN-9900: --- Summary: Revert Invalid Config and Refresh Support in SchedulerConfig Format Key: YARN-9900 URL: https://issues.apache.org/jira/browse/YARN-9900 Project: Hadoop YARN

[jira] [Updated] (YARN-9900) Revert Invalid Config and Refresh Support in SchedulerConfig Format

2019-10-14 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9900: Attachment: YARN-9900-001.patch > Revert Invalid Config and Refresh Support in SchedulerConfig

[jira] [Commented] (YARN-9836) General usability improvements in showSimulationTrace.html

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950966#comment-16950966 ] Hadoop QA commented on YARN-9836: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9537) Add configuration to disable AM preemption

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950991#comment-16950991 ] Hadoop QA commented on YARN-9537: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-10-14 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9290: Attachment: YARN-9290-007.patch > Invalid SchedulingRequest not rejected in Scheduler >

[jira] [Commented] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-10-14 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951005#comment-16951005 ] Prabhu Joseph commented on YARN-9290: - Thanks [~pbacsko] for reviewing. Apologies for late response,

[jira] [Updated] (YARN-9886) Queue mapping based on userid passed through application tag

2019-10-14 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kinga Marton updated YARN-9886: --- Attachment: YARN-9886-WIP.patch > Queue mapping based on userid passed through application tag >

[jira] [Assigned] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2019-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-2127: Assignee: Eric Payne (was: Eric Payne) > Move YarnUncaughtExceptionHandler into Hadoop common >

[jira] [Updated] (YARN-9875) FSSchedulerConfigurationStore fails to update with hdfs path

2019-10-14 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9875: Description: FSSchedulerConfigurationStore fails to update with hdfs path - "java.io.IOException:

[jira] [Commented] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951010#comment-16951010 ] Hadoop QA commented on YARN-2127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9875) FSSchedulerConfigurationStore fails to update with hdfs path

2019-10-14 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9875: Description: FSSchedulerConfigurationStore fails to update with hdfs path - "java.io.IOException:

[jira] [Commented] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951018#comment-16951018 ] Peter Bacsko commented on YARN-9290: Thanks [~Prabhu Joseph], last patch LGTM. So +1 (non-binding)

[jira] [Commented] (YARN-9884) Make container-executor mount logic modular

2019-10-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951032#comment-16951032 ] Jim Brennan commented on YARN-9884: --- Thanks for the updates [~ebadger]! I am +1 (non-binding) on patch

[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko edited comment on YARN-9899 at 10/14/19 2:40 PM: -- [~snemeth] my

[jira] [Commented] (YARN-9900) Revert Invalid Config and Refresh Support in SchedulerConfig Format

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951046#comment-16951046 ] Hadoop QA commented on YARN-9900: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9605) Add ZkConfiguredFailoverProxyProvider for RM HA

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951047#comment-16951047 ] Hadoop QA commented on YARN-9605: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951001#comment-16951001 ] Eric Payne commented on YARN-6492: -- [~gaurav.suman], my understanding is that branch-3.0 has been

[jira] [Commented] (YARN-9874) Remove unnecessary LevelDb write call in LeveldbConfigurationStore#confirmMutation

2019-10-14 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951007#comment-16951007 ] Prabhu Joseph commented on YARN-9874: - [~giovanni.fumarola] Can you review the [^YARN-9874-002.patch]

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko commented on YARN-9899: [~snemeth] my proposal is: # Modify

[jira] [Commented] (YARN-9886) Queue mapping based on userid passed through application tag

2019-10-14 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951012#comment-16951012 ] Kinga Marton commented on YARN-9886: I have uploaded a WIP patch where I have checked if in the

[jira] [Commented] (YARN-9875) FSSchedulerConfigurationStore fails to update with hdfs path

2019-10-14 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951017#comment-16951017 ] Prabhu Joseph commented on YARN-9875: - [~eyang] Can you review this Jira when you get time. This fixes

[jira] [Updated] (YARN-9900) Revert Invalid Config and Refresh Support in SchedulerConfig Format

2019-10-14 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9900: Attachment: YARN-9900-002.patch > Revert Invalid Config and Refresh Support in SchedulerConfig

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config [Phase 1]

2019-10-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951068#comment-16951068 ] Szilard Nemeth commented on YARN-9699: -- Hi [~pbacsko]! Thanks for the patch, committed to trunk!

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config [Phase 1]

2019-10-14 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951075#comment-16951075 ] Hudson commented on YARN-9699: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17530 (See

[jira] [Commented] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951106#comment-16951106 ] Hadoop QA commented on YARN-9290: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9886) Queue mapping based on userid passed through application tag

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951110#comment-16951110 ] Hadoop QA commented on YARN-9886: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9900) Revert Invalid Config and Refresh Support in SchedulerConfig Format

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951190#comment-16951190 ] Hadoop QA commented on YARN-9900: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951242#comment-16951242 ] Hadoop QA commented on YARN-6901: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2019-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951254#comment-16951254 ] Hadoop QA commented on YARN-8509: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-10-14 Thread John Andrunas (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Andrunas updated YARN-9894: Reporter: Eric Payne (was: epayne) > CapacitySchedulerPerf test for measuring hundreds of apps in

[jira] [Assigned] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-10-14 Thread John Andrunas (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Andrunas reassigned YARN-9894: --- Assignee: Eric Payne (was: epayne) > CapacitySchedulerPerf test for measuring hundreds of

[jira] [Commented] (YARN-9773) Add QueueMetrics for Custom Resources

2019-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951142#comment-16951142 ] Eric Payne commented on YARN-9773: -- [~maniraj...@gmail.com], Sorry for the long delay. Thanks for the

[jira] [Assigned] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2019-10-14 Thread John Andrunas (Jira)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Andrunas reassigned YARN-2127: --- Assignee: Eric Payne (was: epayne) > Move YarnUncaughtExceptionHandler into Hadoop common >