[jira] [Created] (YARN-9947) lazy-init-appLogAggregatorImpl-when-log-aggregation

2019-11-01 Thread Hu Ziqian (Jira)
Hu Ziqian created YARN-9947: --- Summary: lazy-init-appLogAggregatorImpl-when-log-aggregation Key: YARN-9947 URL: https://issues.apache.org/jira/browse/YARN-9947 Project: Hadoop YARN Issue Type: Impro

[jira] [Updated] (YARN-9947) lazy init appLogAggregatorImpl when log aggregation

2019-11-01 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9947: Summary: lazy init appLogAggregatorImpl when log aggregation (was: lazy-init-appLogAggregatorImpl-when-log-

[jira] [Created] (YARN-9948) Remove attempts that are beyond max-attempt limit from RMAppImpl

2019-11-01 Thread Hu Ziqian (Jira)
Hu Ziqian created YARN-9948: --- Summary: Remove attempts that are beyond max-attempt limit from RMAppImpl Key: YARN-9948 URL: https://issues.apache.org/jira/browse/YARN-9948 Project: Hadoop YARN Iss

[jira] [Assigned] (YARN-9947) lazy init appLogAggregatorImpl when log aggregation

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian reassigned YARN-9947: --- Assignee: Hu Ziqian > lazy init appLogAggregatorImpl when log aggregation > -

[jira] [Updated] (YARN-9947) lazy init appLogAggregatorImpl when log aggregation

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9947: Description: In current version, app log aggregator will check > lazy init appLogAggregatorImpl when log agg

[jira] [Updated] (YARN-9947) lazy init appLogAggregatorImpl when log aggregation

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9947: Description: This issue introduce an method to lazy init    In current version, app log aggregator will ch

[jira] [Updated] (YARN-9947) lazy init appLogAggregatorImpl when log aggregation

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9947: Description: This issue introduce an method to lazy init appLogAggregatorImpl, which let it access hdfs as

[jira] [Updated] (YARN-9947) lazy init appLogAggregatorImpl when log aggregation

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9947: Description: This issue introduce an method to lazy init appLogAggregatorImpl, which let it access hdfs as

[jira] [Updated] (YARN-9947) lazy init appLogAggregatorImpl when log aggregation

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9947: Attachment: YARN-9947.001.patch > lazy init appLogAggregatorImpl when log aggregation >

[jira] [Updated] (YARN-9948) Remove attempts that are beyond max-attempt limit from RMAppImpl

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9948: Description: RM will store app attempt in both state store and RMAppImpl. YARN-3480 removes attempts that a

[jira] [Updated] (YARN-9948) Remove attempts that are beyond max-attempt limit from RMAppImpl

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9948: Attachment: YARN-9948.001.patch > Remove attempts that are beyond max-attempt limit from RMAppImpl > ---

[jira] [Commented] (YARN-9948) Remove attempts that are beyond max-attempt limit from RMAppImpl

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966447#comment-16966447 ] Hu Ziqian commented on YARN-9948: - [~taoyang], could you help me to review this issue? >

[jira] [Commented] (YARN-9947) lazy init appLogAggregatorImpl when log aggregation

2019-11-03 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966448#comment-16966448 ] Hu Ziqian commented on YARN-9947: - [~taoyang], [~leftnoteasy] could you help me to review

[jira] [Commented] (YARN-9948) Remove attempts that are beyond max-attempt limit from RMAppImpl

2019-11-05 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967341#comment-16967341 ] Hu Ziqian commented on YARN-9948: - [~hex108],  [~jianhe] ,  this issue is based on YARN-34

[jira] [Commented] (YARN-9948) Remove attempts that are beyond max-attempt limit from RMAppImpl

2019-11-08 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970038#comment-16970038 ] Hu Ziqian commented on YARN-9948: - Hi [~hex108], in our cluster, one attempt will use more

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

2019-11-21 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979115#comment-16979115 ] Hu Ziqian commented on YARN-4766: - hi [~haibochen], should you tell me what's problem this

[jira] [Created] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2018-12-28 Thread Hu Ziqian (JIRA)
Hu Ziqian created YARN-9163: --- Summary: Deadlock when use yarn rmadmin -refreshQueues Key: YARN-9163 URL: https://issues.apache.org/jira/browse/YARN-9163 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2018-12-29 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian reassigned YARN-9163: --- Assignee: Hu Ziqian Affects Version/s: 3.1.1 Description: We have a cluster wi

[jira] [Updated] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2018-12-29 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9163: Attachment: YARN-9163.001.patch > Deadlock when use yarn rmadmin -refreshQueues > --

[jira] [Updated] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2018-12-29 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9163: Description: We have a cluster with 4000+ node and 10w+ app per-day in our production environment. When we

[jira] [Updated] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-06 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9163: Attachment: rm.jstack.ziqian.log > Deadlock when use yarn rmadmin -refreshQueues > -

[jira] [Updated] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-06 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9163: Attachment: (was: rm.jstack.ziqian.log) > Deadlock when use yarn rmadmin -refreshQueues > --

[jira] [Updated] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-06 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-9163: Attachment: rm.jstack.ziqian.log > Deadlock when use yarn rmadmin -refreshQueues > -

[jira] [Commented] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-06 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735426#comment-16735426 ] Hu Ziqian commented on YARN-9163: - [~Tao Yang], Sorry, not found any new evidence yet. >

[jira] [Commented] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-06 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735424#comment-16735424 ] Hu Ziqian commented on YARN-9163: - [~cheersyang], actually we used a internal version of 

[jira] [Commented] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-06 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735423#comment-16735423 ] Hu Ziqian commented on YARN-9163: - [~leftnoteasy],here‘s the jstack. [^rm.jstack.ziqian.lo

[jira] [Commented] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2019-02-25 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16777559#comment-16777559 ] Hu Ziqian commented on YARN-8479: - Hi [~leftnoteasy],[~daemon] "As a result of our test t

[jira] [Created] (YARN-8232) RMContainer lost Queue name when recovered by RM

2018-04-27 Thread Hu Ziqian (JIRA)
Hu Ziqian created YARN-8232: --- Summary: RMContainer lost Queue name when recovered by RM Key: YARN-8232 URL: https://issues.apache.org/jira/browse/YARN-8232 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-8232) RMContainer lost Queue name when recovered by RM

2018-04-28 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8232: Description: RMContainer has a member variable queuename to store which queue the container belongs to. Pree

[jira] [Updated] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-04-28 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8232: Flags: Patch Attachment: YARN_8232.patch Description: RMContainer has a member variable queuen

[jira] [Updated] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-04-28 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8232: Description: RMContainer has a member variable queuename to store which queue the container belongs to. When

[jira] [Created] (YARN-8234) Improve timeline server v1's preformance

2018-04-28 Thread Hu Ziqian (JIRA)
Hu Ziqian created YARN-8234: --- Summary: Improve timeline server v1's preformance Key: YARN-8234 URL: https://issues.apache.org/jira/browse/YARN-8234 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-04-28 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Flags: (was: Patch) Attachment: YARN_8234.patch Description: When system metrics publisher i

[jira] [Updated] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-04-29 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8232: Attachment: (was: YARN_8232.patch) > RMContainer lost queue name when RM HA happens > ---

[jira] [Updated] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-04-29 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8232: Attachment: YARN-8232-branch-2.8.3.001.patch YARN-8232.001.patch > RMContainer lost queue nam

[jira] [Commented] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-04-30 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16458367#comment-16458367 ] Hu Ziqian commented on YARN-8232: - [~leftnoteasy], thanks for your comment. I resubmit 2 v

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-04-30 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Attachment: YARN-8234-branch-2.8.3.001.patch > Improve RM system metrics publisher's performance by pushing e

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-04-30 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Attachment: (was: YARN_8234.patch) > Improve RM system metrics publisher's performance by pushing events

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-04-30 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16458375#comment-16458375 ] Hu Ziqian commented on YARN-8234: - [~rohithsharma], we are using ATS1 > Improve RM system

[jira] [Updated] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-05-01 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8232: Attachment: YARN-8232.002.patch > RMContainer lost queue name when RM HA happens > --

[jira] [Commented] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-05-01 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459656#comment-16459656 ] Hu Ziqian commented on YARN-8232: - hi [~leftnoteasy], I've add a new patch with an unit tes

[jira] [Comment Edited] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-05-01 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459656#comment-16459656 ] Hu Ziqian edited comment on YARN-8232 at 5/1/18 12:29 PM: -- hi [~le

[jira] [Updated] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-05-01 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8232: Attachment: YARN-8232.003.patch > RMContainer lost queue name when RM HA happens > --

[jira] [Commented] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-05-01 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460447#comment-16460447 ] Hu Ziqian commented on YARN-8232: - YARN-8232.003.patch fix the checkstyle. > RMContainer l

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-05-06 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16465394#comment-16465394 ] Hu Ziqian commented on YARN-8234: - [~leftnoteasy], I'll check  the Jenkins report later. >

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-05-12 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Attachment: YARN-8234-branch-2.8.3.002.patch > Improve RM system metrics publisher's performance by pushing e

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-05-13 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Attachment: YARN-8234-branch-2.8.3.003.patch > Improve RM system metrics publisher's performance by pushing e

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-05-16 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478467#comment-16478467 ] Hu Ziqian commented on YARN-8234: - Hi  [~leftnoteasy],  hadoop.yarn.server.resourcemanager

[jira] [Commented] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-05-17 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16480217#comment-16480217 ] Hu Ziqian commented on YARN-8232: - Thanks [~leftnoteasy] for reviewing it > RMContainer lo

[jira] [Created] (YARN-8382) cgroup file leak in NM

2018-05-30 Thread Hu Ziqian (JIRA)
Hu Ziqian created YARN-8382: --- Summary: cgroup file leak in NM Key: YARN-8382 URL: https://issues.apache.org/jira/browse/YARN-8382 Project: Hadoop YARN Issue Type: Bug Components: nodemana

[jira] [Updated] (YARN-8382) cgroup file leak in NM

2018-05-30 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8382: Description: As Jiandan said in YARN-6525, NM may delete  Cgroup container file timeout with logs like org

[jira] [Updated] (YARN-8382) cgroup file leak in NM

2018-05-30 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8382: Description: As Jiandan said in YARN-6525, NM may delete  Cgroup container file timeout with logs like org

[jira] [Updated] (YARN-8382) cgroup file leak in NM

2018-05-30 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8382: Attachment: YARN-8382-branch-2.8.3.001.patch YARN-8382.001.patch > cgroup file leak in NM >

[jira] [Updated] (YARN-8382) cgroup file leak in NM

2018-05-30 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8382: Description: As Jiandan said in YARN-6525, NM may delete  Cgroup container file timeout with logs like belo

[jira] [Commented] (YARN-8382) cgroup file leak in NM

2018-05-30 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16496049#comment-16496049 ] Hu Ziqian commented on YARN-8382: - Hi [~leftnoteasy], can you help me reviewing this patch

[jira] [Updated] (YARN-8382) cgroup file leak in NM

2018-05-31 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8382: Description: As Jiandan said in YARN-6525, NM may delete  Cgroup container file timeout with logs like belo

[jira] [Updated] (YARN-8382) cgroup file leak in NM

2018-06-02 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8382: Attachment: YARN-8382.002.patch YARN-8382-branch-2.8.3.002.patch > cgroup file leak in NM >

[jira] [Commented] (YARN-8382) cgroup file leak in NM

2018-06-03 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499324#comment-16499324 ] Hu Ziqian commented on YARN-8382: - [~miklos.szeg...@cloudera.com], I added a new patch whi

[jira] [Commented] (YARN-8382) cgroup file leak in NM

2018-06-04 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501301#comment-16501301 ] Hu Ziqian commented on YARN-8382: - [~miklos.szeg...@cloudera.com], thank you for reviewing

[jira] [Updated] (YARN-8382) cgroup file leak in NM

2018-06-04 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8382: Description: As Jiandan said in YARN-6562, NM may delete  Cgroup container file timeout with logs like belo

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-06-17 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Attachment: YARN-8234.001.patch > Improve RM system metrics publisher's performance by pushing events to >

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-06-17 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Attachment: YARN-8234.002.patch > Improve RM system metrics publisher's performance by pushing events to >

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-06-17 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Attachment: YARN-8234.003.patch > Improve RM system metrics publisher's performance by pushing events to >

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-06-18 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516585#comment-16516585 ] Hu Ziqian commented on YARN-8234: - Hi  [~leftnoteasy],i‘ve added another patch YARN-8234.0

[jira] [Created] (YARN-8743) capacity scheduler doesn't set node label to reserved container

2018-09-04 Thread Hu Ziqian (JIRA)
Hu Ziqian created YARN-8743: --- Summary: capacity scheduler doesn't set node label to reserved container Key: YARN-8743 URL: https://issues.apache.org/jira/browse/YARN-8743 Project: Hadoop YARN Issu

[jira] [Assigned] (YARN-8743) capacity scheduler doesn't set node label to reserved container

2018-09-04 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian reassigned YARN-8743: --- Assignee: Hu Ziqian > capacity scheduler doesn't set node label to reserved container > -

[jira] [Updated] (YARN-8743) capacity scheduler doesn't set node label to reserved container

2018-09-04 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8743: Description: capacity scheduler doesn't set node label when new a reserved container's RMContainerImpl. Whe

[jira] [Updated] (YARN-8743) capacity scheduler doesn't set node label to reserved container

2018-09-04 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8743: Attachment: YARN-8743.001.patch > capacity scheduler doesn't set node label to reserved container >

[jira] [Commented] (YARN-8743) capacity scheduler doesn't set node label to reserved container

2018-09-05 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604016#comment-16604016 ] Hu Ziqian commented on YARN-8743: - I check the failed UT is timeout of org.apache.hadoop.

[jira] [Updated] (YARN-8743) capacity scheduler doesn't set node label to reserved container

2018-09-05 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8743: Attachment: YARN-8743.002.patch > capacity scheduler doesn't set node label to reserved container >

[jira] [Commented] (YARN-8743) capacity scheduler doesn't set node label to reserved container

2018-09-05 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604018#comment-16604018 ] Hu Ziqian commented on YARN-8743: - fix checkstyle in 002.patch > capacity scheduler doesn

[jira] [Created] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Hu Ziqian (JIRA)
Hu Ziqian created YARN-8764: --- Summary: Comparison method violates its general contract in Async Schedule Key: YARN-8764 URL: https://issues.apache.org/jira/browse/YARN-8764 Project: Hadoop YARN Is

[jira] [Updated] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8764: Description: We use node label and async schedule in our cluster, and found our rm throw many {{IllegalArgu

[jira] [Updated] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8764: Attachment: YARN-8764.001.patch > Comparison method violates its general contract in Async Schedule > --

[jira] [Updated] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8764: Attachment: (was: YARN-8764.001.patch) > Comparison method violates its general contract in Async Schedu

[jira] [Updated] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8764: Attachment: YARN-8764-branch-2.8.4.001.patch > Comparison method violates its general contract in Async Sche

[jira] [Updated] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8764: Description: We use node label and async schedule in our cluster, and found our rm throw many {{IllegalArgu

[jira] [Commented] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610566#comment-16610566 ] Hu Ziqian commented on YARN-8764: - hi [~wangda], i find this error in our cluster which ba

[jira] [Commented] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611515#comment-16611515 ] Hu Ziqian commented on YARN-8764: - Hi [~Tao Yang], did your problem only happen when you c

[jira] [Assigned] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian reassigned YARN-8764: --- Assignee: Hu Ziqian > Comparison method violates its general contract in Async Schedule > ---

[jira] [Updated] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-12 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8764: Affects Version/s: (was: 2.8.0) 2.8.4 > Comparison method violates its general co

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-09-12 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Attachment: YARN-8234.004.patch > Improve RM system metrics publisher's performance by pushing events to >

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-09-12 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Ziqian updated YARN-8234: Attachment: YARN-8234-branch-2.8.3.004.patch > Improve RM system metrics publisher's performance by pushing

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-09-12 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613077#comment-16613077 ] Hu Ziqian commented on YARN-8234: - [~rohithsharma], sorry for replying too late. I add pa