[jira] [Commented] (YARN-5951) Changes to allow CapacityScheduler to use configuration store

2017-08-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110501#comment-16110501 ] Jiandan Yang commented on YARN-5951: - [~jhung] [~leftnoteasy] I found this patch has two problems: 1.

[jira] [Commented] (YARN-5951) Changes to allow CapacityScheduler to use configuration store

2017-08-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1611#comment-1611 ] Jiandan Yang commented on YARN-5951: - [~jhung] Sorry, my mistake, it's

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Description: In our cluster, when found NodeManager frequently FullGC when decommissioning

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Description: In our cluster, when found NodeManager frequently FullGC when decommissioning

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Description: In our cluster, when found NodeManager frequently FullGC when decommissioning

[jira] [Commented] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156350#comment-16156350 ] Jiandan Yang commented on YARN-7168: - Sorry, I should create this issue in Hadoop HDFS, can anyone

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Attachment: mat.jpg > The size of dataQueue and ackQueue in DataStreamer has no limit when writer >

[jira] [Created] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7168: --- Summary: The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted Key: YARN-7168 URL: https://issues.apache.org/jira/browse/YARN-7168

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Description: In our cluster, when found NodeManager frequently FullGC when decommissioning

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Description: YARN-5947 add LeveldbConfigurationStore using Leveldb as backing store, but it does

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.001.patch > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Created] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-14 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7497: --- Summary: Add HDFSSchedulerConfigurationStore for RM HA Key: YARN-7497 URL: https://issues.apache.org/jira/browse/YARN-7497 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.005.patch > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270525#comment-16270525 ] Jiandan Yang commented on YARN-7497: - [~gphillips] I have moved those two static constant into

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270497#comment-16270497 ] Jiandan Yang commented on YARN-7497: - [~jhung] Please help me to review and give me some comment about

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.006.patch fix TestYarnConfigurationFields fail > Add

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-16 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.004.patch fix findbug error > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.003.patch fix UT and whitespace error > Add HDFSSchedulerConfigurationStore

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.002.patch upload v2 patch > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Commented] (YARN-5636) Support reserving resources on certain nodes for certain applications

2017-12-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287229#comment-16287229 ] Jiandan Yang commented on YARN-5636: - [~Tao Jie] I think you solution is good. You can provide a patch

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475703#comment-16475703 ] Jiandan Yang commented on YARN-7715: - [~miklos.szeg...@cloudera.com] How to inform AM if update cgroup

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-16 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476961#comment-16476961 ] Jiandan Yang commented on YARN-7715: - Thanks [~miklos.szeg...@cloudera.com] Updating execution type

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Description: Currently NodeManager uses “cpu.cfs_period_us”, “cpu.cfs_quota_us” and “cpu.shares”

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for

[jira] [Commented] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480529#comment-16480529 ] Jiandan Yang commented on YARN-8320: - upload design doc v1. Please feel free to let me know your

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Summary: Add support CPU isolation for latency-sensitive (LS) service (was: Add support CPU

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for

[jira] [Created] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-8320: --- Summary: Add support CPU isolation for latency-sensitive (LS) tasks Key: YARN-8320 URL: https://issues.apache.org/jira/browse/YARN-8320 Project: Hadoop YARN

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU

[jira] [Commented] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482336#comment-16482336 ] Jiandan Yang commented on YARN-8320: - upload v1 patch to initiate disscussion > Add support CPU

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: YARN-8320.001.patch > Add support CPU isolation for latency-sensitive (LS) service >

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: YARN-8320.001.patch) > Add support CPU isolation for latency-sensitive (LS)

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for

[jira] [Updated] (YARN-8320) Support CPU isolation for latency-sensitive (LS) service

2018-05-23 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v2.pdf > Support CPU isolation for

[jira] [Commented] (YARN-8320) Support CPU isolation for latency-sensitive (LS) service

2018-05-23 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487066#comment-16487066 ] Jiandan Yang commented on YARN-8320: - [~cheersyang] and I discuss design offline together. Add more

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476776#comment-16476776 ] Jiandan Yang commented on YARN-7715: - Hi, [~miklos.szeg...@cloudera.com] Thanks for your reply. I

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-20 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-20 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU

[jira] [Comment Edited] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

2018-01-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312473#comment-16312473 ] Jiandan Yang edited comment on YARN-6673 at 1/5/18 4:49 AM: -

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

2018-01-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312473#comment-16312473 ] Jiandan Yang commented on YARN-6673: - [~miklos.szeg...@cloudera.com] How about setting Cpu share for

[jira] [Commented] (YARN-7693) ContainersMonitor support configurable

2018-01-05 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313097#comment-16313097 ] Jiandan Yang commented on YARN-7693: - [~miklos.szeg...@cloudera.com] Opportunistic Containers may

[jira] [Updated] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: {code} 18/02/02 20:54:28 INFO rmcontainer.RMContainerImpl:

[jira] [Created] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7880: --- Summary: FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls Key: YARN-7880 URL: https://issues.apache.org/jira/browse/YARN-7880 Project:

[jira] [Updated] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: {code} 18/02/02 20:54:28 INFO rmcontainer.RMContainerImpl:

[jira] [Updated] (YARN-7880) CapacityScheduler$ResourceCommitterService throws NPE when running sls

2018-02-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Summary: CapacityScheduler$ResourceCommitterService throws NPE when running sls (was:

[jira] [Updated] (YARN-7880) CapacityScheduler$ResourceCommitterService throws NPE when running sls

2018-02-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: sls test case: node count = 9000, job count=10k,task num of job = 500, task run time =

[jira] [Updated] (YARN-7880) CapacityScheduler$ResourceCommitterService throws NPE when running sls

2018-02-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Affects Version/s: 3.0.0 > CapacityScheduler$ResourceCommitterService throws NPE when running sls >

[jira] [Updated] (YARN-7880) CapacityScheduler$ResourceCommitterService throws NPE when running sls

2018-02-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Component/s: yarn > CapacityScheduler$ResourceCommitterService throws NPE when running sls >

[jira] [Updated] (YARN-7880) CapacityScheduler$ResourceCommitterService throws NPE when running sls

2018-02-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: sls test case: node count = 9000, job count=10k,task num of job = 500, task run time

[jira] [Updated] (YARN-7880) CapacityScheduler$ResourceCommitterService throws NPE when running sls

2018-02-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: sls test case: node count = 9000, job count=10k,task num of job = 500, task run time =

[jira] [Updated] (YARN-7880) CapacityScheduler$ResourceCommitterService throws NPE when running sls

2018-02-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: sls test case: node count = 9000, job count=10k,task num of job = 500, task run time =

[jira] [Commented] (YARN-7880) CapacityScheduler$ResourceCommitterService throws NPE when running sls

2018-02-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351990#comment-16351990 ] Jiandan Yang commented on YARN-7880: - duplicated with YARN-7591 >

[jira] [Resolved] (YARN-7880) CapacityScheduler$ResourceCommitterService throws NPE when running sls

2018-02-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang resolved YARN-7880. - Resolution: Duplicate Assignee: Jiandan Yang Fix Version/s: 3.0.0 >

[jira] [Created] (YARN-7929) SLS supports setting container execution

2018-02-13 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7929: --- Summary: SLS supports setting container execution Key: YARN-7929 URL: https://issues.apache.org/jira/browse/YARN-7929 Project: Hadoop YARN Issue Type: New

[jira] [Updated] (YARN-7929) SLS supports setting container execution

2018-02-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7929: Issue Type: Sub-task (was: New Feature) Parent: YARN-5065 > SLS supports setting container

[jira] [Updated] (YARN-7929) SLS supports setting container execution

2018-02-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7929: Attachment: YARN-7929.001.patch > SLS supports setting container execution >

[jira] [Comment Edited] (YARN-7929) SLS supports setting container execution

2018-02-23 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374021#comment-16374021 ] Jiandan Yang edited comment on YARN-7929 at 2/24/18 1:50 AM: -- Hi [~youchen],

[jira] [Comment Edited] (YARN-7929) SLS supports setting container execution

2018-02-22 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374021#comment-16374021 ] Jiandan Yang edited comment on YARN-7929 at 2/23/18 7:09 AM: -- Hi [~yochen],

[jira] [Commented] (YARN-7929) SLS supports setting container execution

2018-02-22 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374021#comment-16374021 ] Jiandan Yang commented on YARN-7929: - Hi [~yochen], thanks for your attention. I did encounter the

[jira] [Updated] (YARN-7929) SLS supports setting container execution

2018-02-23 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7929: Attachment: YARN-7929.002.patch > SLS supports setting container execution >

[jira] [Created] (YARN-7970) Compatibility issue: throw RpcNoSuchMethodException when run mapreduce job

2018-02-26 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7970: --- Summary: Compatibility issue: throw RpcNoSuchMethodException when run mapreduce job Key: YARN-7970 URL: https://issues.apache.org/jira/browse/YARN-7970 Project: Hadoop

[jira] [Updated] (YARN-7970) Compatibility issue: throw RpcNoSuchMethodException when run mapreduce job

2018-02-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7970: Description: Running teragen failed in the version of hadoop-3.1, and hdfs server is 2.8. The reason

[jira] [Updated] (YARN-7970) Compatibility issue: throw RpcNoSuchMethodException when run mapreduce job

2018-02-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7970: Description: Running teragen failed in the version of hadoop-3.1, and hdfs server is 2.8. The reason

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Attachment: YARN-7693.001.patch > ContainersMonitor support configurable >

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Attachment: YARN-7693.002.patch fix TestYarnConfigurationFields error > ContainersMonitor support

[jira] [Commented] (YARN-7693) ContainersMonitor support configurable

2018-01-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309129#comment-16309129 ] Jiandan Yang commented on YARN-7693: - [~miklos.szeg...@cloudera.com] Thanks for your attention. This

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Description: Currently ContainersMonitor has only one default implementation ContainersMonitorImpl,

[jira] [Created] (YARN-7693) ContainersMonitor support configurable

2018-01-01 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7693: --- Summary: ContainersMonitor support configurable Key: YARN-7693 URL: https://issues.apache.org/jira/browse/YARN-7693 Project: Hadoop YARN Issue Type: New

[jira] [Updated] (YARN-7929) SLS supports setting container execution

2018-02-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7929: Attachment: YARN-7929.004.patch > SLS supports setting container execution >

[jira] [Commented] (YARN-7929) SLS supports setting container execution

2018-02-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378110#comment-16378110 ] Jiandan Yang commented on YARN-7929: - fix checkstyle issues and upload YARN-7929.004.patch > SLS

[jira] [Commented] (YARN-7929) SLS supports setting container execution

2018-02-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378179#comment-16378179 ] Jiandan Yang commented on YARN-7929: - fix checkstyle HiddenField and upload 005.patch > SLS supports

[jira] [Updated] (YARN-7929) SLS supports setting container execution

2018-02-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7929: Attachment: YARN-7929.005.patch > SLS supports setting container execution >

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Description: ResourceManager logs about exception is: {code:java} 2018-08-09 00:52:30,746 WARN [IPC

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580881#comment-16580881 ] Jiandan Yang commented on YARN-8664: - [~cheersyang] Jenkins is probably not OK. Would you please fix

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.2.002.patch > ApplicationMasterProtocolPBServiceImpl#allocate

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580626#comment-16580626 ] Jiandan Yang commented on YARN-8664: - Jenkins report ERROR: Docker failed to build image, which is

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580688#comment-16580688 ] Jiandan Yang commented on YARN-8664: - Thank [~cheersyang] for quick response. There is no problem in

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.001.pathch > ApplicationMasterProtocolPBServiceImpl#allocate throw

[jira] [Created] (YARN-8645) Yarn NM fail to start when remount cpu control group

2018-08-09 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-8645: --- Summary: Yarn NM fail to start when remount cpu control group Key: YARN-8645 URL: https://issues.apache.org/jira/browse/YARN-8645 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-8664: --- Summary: ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting Key: YARN-8664 URL: https://issues.apache.org/jira/browse/YARN-8664 Project: Hadoop

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.2.001.patch > ApplicationMasterProtocolPBServiceImpl#allocate

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579884#comment-16579884 ] Jiandan Yang commented on YARN-8664: - replace rmNode.getTotalCapability() with

[jira] [Updated] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8717: Attachment: YARN-8717.001.patch > set memory.limit_in_bytes when NodeManager starting >

[jira] [Commented] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594858#comment-16594858 ] Jiandan Yang commented on YARN-8717: - Hi [~cheersyang] Thanks for watching. We found NM was killed by

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.002.pathch > ApplicationMasterProtocolPBServiceImpl#allocate throw

[jira] [Updated] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-27 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8717: Description: CGroupsCpuResourceHandlerImpl sets cpu quota at hirarchy of hadoop-yarn to restrict

[jira] [Created] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-26 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-8717: --- Summary: set memory.limit_in_bytes when NodeManager starting Key: YARN-8717 URL: https://issues.apache.org/jira/browse/YARN-8717 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8717: Description: CGroupsCpuResourceHandlerImpl sets cpu quota at hirarchy of hadoop-yarn to restrict

[jira] [Updated] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8717: Environment: (was: CGroupsCpuResourceHandlerImpl sets cpu quota at hirarchy of hadoop-yarn to

[jira] [Comment Edited] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594858#comment-16594858 ] Jiandan Yang edited comment on YARN-8717 at 9/7/18 3:05 AM: - Hi [~cheersyang]

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: (was: YARN-8664-branch-2.8.001.pathch) >

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.004.patch > ApplicationMasterProtocolPBServiceImpl#allocate throw

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: (was: YARN-8664-branch-2.8.2.002.patch) >

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: (was: YARN-8664-branch-2.8.2.001.patch) >

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: (was: YARN-8664-branch-2.8.002.pathch) >

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Priority: Minor (was: Blocker) > ContainersMonitor support configurable >

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Priority: Blocker (was: Minor) > ContainersMonitor support configurable >

  1   2   3   >