[jira] [Commented] (YARN-8667) Cleanup symlinks when container restarted by NM to solve issue "find: File system loop detected;" for tar ball artifacts.

2019-06-04 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855539#comment-16855539 ] zhoukang commented on YARN-8667: This will cause error below: {code:java} echo "Setting up job resources"

[jira] [Created] (YARN-9605) Add ZkConfiguredFailoverProxyProvider for RM HA

2019-06-05 Thread zhoukang (JIRA)
zhoukang created YARN-9605: -- Summary: Add ZkConfiguredFailoverProxyProvider for RM HA Key: YARN-9605 URL: https://issues.apache.org/jira/browse/YARN-9605 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9537) Add configuration to disable AM preemption

2019-06-05 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9537: --- Description: In this issue, i will add a configuration to support disable AM preemption. (was: In our

[jira] [Commented] (YARN-9537) Add configuration to disable AM preemption

2019-06-05 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857293#comment-16857293 ] zhoukang commented on YARN-9537: Thanks [~yufeigu] I have changed the title, we want to add configuration

[jira] [Updated] (YARN-9537) Add configuration to disable AM preemption

2019-06-05 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9537: --- Summary: Add configuration to disable AM preemption (was: Add configuration to support AM preemption) > Add

[jira] [Commented] (YARN-9612) Support using ip to register NodeID

2019-06-10 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860561#comment-16860561 ] zhoukang commented on YARN-9612: Thanks [~tangzhankun] I think use service name will make maintenance more

[jira] [Commented] (YARN-9537) Add configuration to disable AM preemption

2019-06-20 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868546#comment-16868546 ] zhoukang commented on YARN-9537: In our production cluster, we have some problems when AM was preempted,

[jira] [Updated] (YARN-9537) Add configuration to disable AM preemption

2019-06-10 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9537: --- Attachment: (was: YARN-9537.001.patch) > Add configuration to disable AM preemption >

[jira] [Updated] (YARN-9537) Add configuration to disable AM preemption

2019-06-10 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9537: --- Attachment: YARN-9537.001.patch > Add configuration to disable AM preemption >

[jira] [Created] (YARN-9612) Support using ip to register NodeID

2019-06-10 Thread zhoukang (JIRA)
zhoukang created YARN-9612: -- Summary: Support using ip to register NodeID Key: YARN-9612 URL: https://issues.apache.org/jira/browse/YARN-9612 Project: Hadoop YARN Issue Type: Improvement

[jira] [Created] (YARN-9537) Add configuration to support AM preemption

2019-05-09 Thread zhoukang (JIRA)
zhoukang created YARN-9537: -- Summary: Add configuration to support AM preemption Key: YARN-9537 URL: https://issues.apache.org/jira/browse/YARN-9537 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-9748) Allow capacity-scheduler configuration on HDFS

2019-08-14 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9748: --- Affects Version/s: 3.1.2 Component/s: capacityscheduler capacity scheduler >

[jira] [Created] (YARN-9748) Allow capacity-scheduler configuration on HDFS

2019-08-14 Thread zhoukang (JIRA)
zhoukang created YARN-9748: -- Summary: Allow capacity-scheduler configuration on HDFS Key: YARN-9748 URL: https://issues.apache.org/jira/browse/YARN-9748 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: heap1.png stack.png > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: heap0.png > appsTableData in AppsBlock may cause OOM > >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: 选区_001 (1).png > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: (was: 选区_003.png) > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: (was: 选区_001 (1).png) > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: 选区_003.png 选区_004.png > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: (was: 选区_004.png) > appsTableData in AppsBlock may cause OOM >

[jira] [Created] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
zhoukang created YARN-9739: -- Summary: appsTableData in AppsBlock may cause OOM Key: YARN-9739 URL: https://issues.apache.org/jira/browse/YARN-9739 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-9748) Allow capacity-scheduler configuration on HDFS

2019-08-14 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907757#comment-16907757 ] zhoukang commented on YARN-9748: Sure [~Prabhu Joseph] We have implemented an inner version in out

[jira] [Updated] (YARN-9748) Allow capacity-scheduler configuration on HDFS

2019-08-15 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9748: --- Description: Improvement: Support auto reload from hdfs > Allow capacity-scheduler configuration on HDFS >

[jira] [Commented] (YARN-9548) [Umbrella] Make YARN work well in elastic cloud environments

2019-08-20 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911071#comment-16911071 ] zhoukang commented on YARN-9548: Great! We will also work on this at xiaomi > [Umbrella] Make YARN work

[jira] [Created] (YARN-9693) When AMRMProxyService is enabled RMCommunicator will register with failure

2019-07-23 Thread zhoukang (JIRA)
zhoukang created YARN-9693: -- Summary: When AMRMProxyService is enabled RMCommunicator will register with failure Key: YARN-9693 URL: https://issues.apache.org/jira/browse/YARN-9693 Project: Hadoop YARN

[jira] [Updated] (YARN-9693) When AMRMProxyService is enabled RMCommunicator will register with failure

2019-07-23 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9693: --- Description: When we enable amrm proxy service, the mr job will be failed. We config NM with configuration

[jira] [Updated] (YARN-9693) When AMRMProxyService is enabled RMCommunicator will register with failure

2019-07-23 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9693: --- Description: When we enable amrm proxy service, the RMCommunicator will register with failure below:

[jira] [Commented] (YARN-6539) Create SecureLogin inside Router

2019-07-19 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888751#comment-16888751 ] zhoukang commented on YARN-6539: Any progress of this task? I have encountered the same issue when testing

[jira] [Commented] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-26 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893728#comment-16893728 ] zhoukang commented on YARN-7621: Good job. We also encountered the same problem and have made some

[jira] [Updated] (YARN-9709) When we expanding queue list the scheduler page will not show any applications

2019-07-26 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9709: --- Attachment: (was: list2.png) > When we expanding queue list the scheduler page will not show any

[jira] [Updated] (YARN-9709) When we expanding queue list the scheduler page will not show any applications

2019-07-26 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9709: --- Description: When we expanding queue list the scheduler page will not show any applications.But it works

[jira] [Updated] (YARN-9709) When we expanding queue list the scheduler page will not show any applications

2019-07-26 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9709: --- Attachment: list3.png > When we expanding queue list the scheduler page will not show any applications >

[jira] [Created] (YARN-9709) When we expanding queue list the scheduler page will not show any applications

2019-07-26 Thread zhoukang (JIRA)
zhoukang created YARN-9709: -- Summary: When we expanding queue list the scheduler page will not show any applications Key: YARN-9709 URL: https://issues.apache.org/jira/browse/YARN-9709 Project: Hadoop YARN

[jira] [Commented] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2019-07-26 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893744#comment-16893744 ] zhoukang commented on YARN-9698: How about the idea that support ACL proxy user in CapacityScheduler.

[jira] [Comment Edited] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2019-07-26 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893744#comment-16893744 ] zhoukang edited comment on YARN-9698 at 7/26/19 11:37 AM: -- How about the idea

[jira] [Created] (YARN-9689) Router does not support kerberos proxy when in secure mode

2019-07-22 Thread zhoukang (JIRA)
zhoukang created YARN-9689: -- Summary: Router does not support kerberos proxy when in secure mode Key: YARN-9689 URL: https://issues.apache.org/jira/browse/YARN-9689 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-9689) Router does not support kerberos proxy when in secure mode

2019-07-22 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890069#comment-16890069 ] zhoukang commented on YARN-9689: [~botong] Could help evaluate this?Thanks! > Router does not support

[jira] [Commented] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895039#comment-16895039 ] zhoukang commented on YARN-7621: I have not learned how to review hadoop pr.(i will learn later) But i

[jira] [Comment Edited] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2019-07-28 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894910#comment-16894910 ] zhoukang edited comment on YARN-9698 at 7/29/19 3:51 AM: - Just a new feature

[jira] [Assigned] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang reassigned YARN-7621: -- Assignee: (was: zhoukang) > Support submitting apps with queue path for CapacityScheduler >

[jira] [Assigned] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang reassigned YARN-7621: -- Assignee: zhoukang (was: Tao Yang) > Support submitting apps with queue path for CapacityScheduler >

[jira] [Commented] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895027#comment-16895027 ] zhoukang commented on YARN-7621: Sure i will [~cheersyang] > Support submitting apps with queue path for

[jira] [Commented] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2019-07-28 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894910#comment-16894910 ] zhoukang commented on YARN-9698: Just a new feature [~wangda] > [Umbrella] Tools to help migration from

[jira] [Comment Edited] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895048#comment-16895048 ] zhoukang edited comment on YARN-7621 at 7/29/19 8:27 AM: - NIT: Since in our

[jira] [Commented] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895048#comment-16895048 ] zhoukang commented on YARN-7621: NIT: Since in our cluster there will exist 'root.a.a1' and 'root.b.a1'.

[jira] [Commented] (YARN-9605) Add ZkConfiguredFailoverProxyProvider for RM HA

2019-09-08 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925103#comment-16925103 ] zhoukang commented on YARN-9605: [~Prabhu Joseph][~tangzhankun]Could help review this patch plz?Thanks a

[jira] [Commented] (YARN-9748) Allow capacity-scheduler configuration on HDFS

2019-09-08 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925099#comment-16925099 ] zhoukang commented on YARN-9748: Sorry for late reply [~Prabhu Joseph]I think the title is miseading.

[jira] [Updated] (YARN-9748) Allow capacity-scheduler configuration on HDFS and support reload from hdfs

2019-09-08 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9748: --- Summary: Allow capacity-scheduler configuration on HDFS and support reload from hdfs (was: Allow

[jira] [Updated] (YARN-9748) Allow capacity-scheduler configuration on HDFS and support reload from HDFS

2019-09-08 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9748: --- Summary: Allow capacity-scheduler configuration on HDFS and support reload from HDFS (was: Allow

[jira] [Commented] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-09-08 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925100#comment-16925100 ] zhoukang commented on YARN-9739: Any suggestion for this [~tangzhankun]Our current implementation is just

[jira] [Commented] (YARN-9537) Add configuration to disable AM preemption

2019-09-08 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925101#comment-16925101 ] zhoukang commented on YARN-9537: Yes, i will. [~yufeigu]thanks a lot! > Add configuration to disable AM

[jira] [Commented] (YARN-9612) Support using ip to register NodeID

2019-09-08 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925102#comment-16925102 ] zhoukang commented on YARN-9612: IIUC. The solution is that add service name for each pod?

[jira] [Assigned] (YARN-9748) Allow capacity-scheduler configuration on HDFS and support reload from HDFS

2019-09-17 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang reassigned YARN-9748: -- Assignee: zhoukang (was: Prabhu Joseph) > Allow capacity-scheduler configuration on HDFS and support