[jira] [Comment Edited] (YARN-8631) YARN RM fails to add the application to the delegation token renewer on recovery

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312904#comment-17312904 ] Qi Zhu edited comment on YARN-8631 at 4/1/21, 6:31 AM: --- cc [~snemeth

[jira] [Comment Edited] (YARN-8631) YARN RM fails to add the application to the delegation token renewer on recovery

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312904#comment-17312904 ] Qi Zhu edited comment on YARN-8631 at 4/1/21, 6:31 AM: --- [~snemeth] [

[jira] [Commented] (YARN-8631) YARN RM fails to add the application to the delegation token renewer on recovery

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312904#comment-17312904 ] Qi Zhu commented on YARN-8631: -- [~snemeth] [~umittal] [~gandras] [~shenyinjie] [~SanjayDivgi]

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312525#comment-17312525 ] Qi Zhu commented on YARN-9618: -- Thanks [~pbacsko] for very good suggestions. Updated in late

[jira] [Updated] (YARN-9618) NodeListManager event improvement

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9618: - Attachment: YARN-9618.007.patch > NodeListManager event improvement > - > >

[jira] [Commented] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312509#comment-17312509 ] Qi Zhu commented on YARN-10720: --- Thanks [~pbacsko] for patient review. It make sense to me

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: YARN-10720.006.patch > YARN WebAppProxyServlet should support connection timeout to prevent proxy

[jira] [Commented] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312368#comment-17312368 ] Qi Zhu commented on YARN-10720: --- Removed the unused import in latest patch.  > YARN WebApp

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: YARN-10720.005.patch > YARN WebAppProxyServlet should support connection timeout to prevent proxy

[jira] [Commented] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312265#comment-17312265 ] Qi Zhu commented on YARN-10720: --- Thanks a lot [~pbacsko] for valid suggestions. :D I have

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: YARN-10720.004.patch > YARN WebAppProxyServlet should support connection timeout to prevent proxy

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312219#comment-17312219 ] Qi Zhu commented on YARN-10503: --- [~pbacsko] [~gandras] [~ebadger]  If you any other advice

[jira] [Commented] (YARN-10657) We should make max application per queue to support node label.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312217#comment-17312217 ] Qi Zhu commented on YARN-10657: --- Fixed checkstyle in latest patch. :D > We should make max

[jira] [Updated] (YARN-10657) We should make max application per queue to support node label.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10657: -- Attachment: YARN-10657.002.patch > We should make max application per queue to support node label. > --

[jira] [Comment Edited] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312209#comment-17312209 ] Qi Zhu edited comment on YARN-10720 at 3/31/21, 9:09 AM: - Hi [~pb

[jira] [Comment Edited] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312209#comment-17312209 ] Qi Zhu edited comment on YARN-10720 at 3/31/21, 9:09 AM: - Hi [~pb

[jira] [Commented] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312209#comment-17312209 ] Qi Zhu commented on YARN-10720: --- Hi [~pbacsko] [~gandras]  Could you help review this? It

[jira] [Commented] (YARN-10718) Fix CapacityScheduler#initScheduler log error.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312202#comment-17312202 ] Qi Zhu commented on YARN-10718: --- Thanks [~pbacsko] for review. > Fix CapacityScheduler#ini

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312145#comment-17312145 ] Qi Zhu commented on YARN-9618: -- Thanks a lot [~gandras] for your confirm. :D Waiting [~ebadg

[jira] [Commented] (YARN-10722) Improvement to DelegationTokenRenewer in RM

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312096#comment-17312096 ] Qi Zhu commented on YARN-10722: --- Thanks [~fengnanli] for this jira. Could you show more de

[jira] [Commented] (YARN-10723) Change CS nodes page in UI to support custom resource.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312092#comment-17312092 ] Qi Zhu commented on YARN-10723: --- Fixed checkstyle in latest patch. :D > Change CS nodes pa

[jira] [Updated] (YARN-10723) Change CS nodes page in UI to support custom resource.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10723: -- Attachment: YARN-10723.003.patch > Change CS nodes page in UI to support custom resource. > ---

[jira] [Commented] (YARN-10723) Change CS nodes page in UI to support custom resource.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311988#comment-17311988 ] Qi Zhu commented on YARN-10723: --- [~pbacsko] [~ebadger]  [~gandras]   Fix the new custom re

[jira] [Updated] (YARN-10723) Change CS nodes page in UI to support custom resource.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10723: -- Attachment: YARN-10723.002.patch > Change CS nodes page in UI to support custom resource. > ---

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311627#comment-17311627 ] Qi Zhu commented on YARN-9618: -- [~ebadger] The code now is no new stress should be tested, t

[jira] [Commented] (YARN-10723) Change CS nodes page in UI to support custom resource.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311624#comment-17311624 ] Qi Zhu commented on YARN-10723: ---  cc  [~pbacsko] [~ebadger]  [~gandras]   Updated a patch

[jira] [Updated] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10693: -- Attachment: YARN-10693.003.patch > Add document for YARN-10623 auto refresh queue conf in cs. > ---

[jira] [Commented] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311340#comment-17311340 ] Qi Zhu commented on YARN-10693: --- Fixed the white space in latest patch. > Add document for

[jira] [Updated] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10693: -- Attachment: YARN-10693.002.patch > Add document for YARN-10623 auto refresh queue conf in cs. > ---

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311321#comment-17311321 ] Qi Zhu commented on YARN-10702: --- Thanks [~Jim_Brennan] for update. The update LGTM, and i

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Summary: YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang. (was: YARN We

[jira] [Commented] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311275#comment-17311275 ] Qi Zhu commented on YARN-10693: --- cc  [~pbacsko]  [~gandras]  [~bteke] Updated a patch for

[jira] [Updated] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10693: -- Attachment: (was: YARN-10693.001.patch) > Add document for YARN-10623 auto refresh queue conf in cs. >

[jira] [Updated] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10693: -- Attachment: YARN-10693.001.patch > Add document for YARN-10623 auto refresh queue conf in cs. > ---

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hung.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Summary: YARN WebAppProxyServlet should support connection timeout to prevent proxy server hung. (was: YARN We

[jira] [Created] (YARN-10723) Change CS nodes page in UI to support custom resource.

2021-03-30 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10723: - Summary: Change CS nodes page in UI to support custom resource. Key: YARN-10723 URL: https://issues.apache.org/jira/browse/YARN-10723 Project: Hadoop YARN Issue Type: Sub-

[jira] [Comment Edited] (YARN-10718) Fix CapacityScheduler#initScheduler log error.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309983#comment-17309983 ] Qi Zhu edited comment on YARN-10718 at 3/30/21, 5:42 AM: -  [~pbac

[jira] [Comment Edited] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310481#comment-17310481 ] Qi Zhu edited comment on YARN-10720 at 3/30/21, 5:41 AM: - cc  [~p

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: YARN-10720.003.patch > YARN WebAppProxyServlet should support connection timeout to prevent too man

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: YARN-10720.002.patch > YARN WebAppProxyServlet should support connection timeout to prevent too man

[jira] [Commented] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310481#comment-17310481 ] Qi Zhu commented on YARN-10720: --- cc  [~pbacsko] [~ebadger] [~Jim_Brennan]  [~ztang]  [~epay

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: image-2021-03-29-14-05-32-708.png > YARN WebAppProxyServlet should support connection timeout to pr

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: (was: image-2021-03-29-13-42-47-672.png) > YARN WebAppProxyServlet should support connection ti

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: (was: image-2021-03-29-13-44-05-579.png) > YARN WebAppProxyServlet should support connection ti

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: image-2021-03-29-14-04-33-776.png > YARN WebAppProxyServlet should support connection timeout to pr

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Priority: Critical (was: Major) > YARN WebAppProxyServlet should support connection timeout to prevent too man

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: image-2021-03-29-13-44-05-579.png > YARN WebAppProxyServlet should support connection timeout to pr

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: image-2021-03-29-13-42-47-672.png > YARN WebAppProxyServlet should support connection timeout to pr

[jira] [Created] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10720: - Summary: YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections. Key: YARN-10720 URL: https://issues.apache.org/jira/browse/YARN-10720 P

[jira] [Commented] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310209#comment-17310209 ] Qi Zhu commented on YARN-10707: --- The test is not related. > Support custom resources in Re

[jira] [Updated] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Attachment: YARN-10707.006.patch > Support custom resources in ResourceUtilization, and update Node GPU > Util

[jira] [Commented] (YARN-10718) Fix CapacityScheduler#initScheduler log error.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309983#comment-17309983 ] Qi Zhu commented on YARN-10718: ---  [~pbacsko] [~gandras]  [~ebadger]  Fixed an obvious log e

[jira] [Created] (YARN-10718) Fix CapacityScheduler#initScheduler log error.

2021-03-27 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10718: - Summary: Fix CapacityScheduler#initScheduler log error. Key: YARN-10718 URL: https://issues.apache.org/jira/browse/YARN-10718 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Attachment: YARN-10707.005.patch > Support custom resources in ResourceUtilization, and update Node GPU > Util

[jira] [Commented] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309955#comment-17309955 ] Qi Zhu commented on YARN-10707: --- Fixed checkstyle and test error in latest patch. > Suppor

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309897#comment-17309897 ] Qi Zhu commented on YARN-10503: --- Fixed the mistake in latest patch. > Support queue capaci

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.009.patch > Support queue capacity in terms of absolute resources with custom > resourc

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309840#comment-17309840 ] Qi Zhu edited comment on YARN-10503 at 3/27/21, 2:10 AM: - Thanks

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.008.patch > Support queue capacity in terms of absolute resources with custom > resourc

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309840#comment-17309840 ] Qi Zhu commented on YARN-10503: --- Thanks [~ebadger] for good suggestion, i have updated in l

[jira] [Commented] (YARN-10171) Add support for increment-allocation of custom resource types

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309516#comment-17309516 ] Qi Zhu commented on YARN-10171: --- Since no one help realize it for a long time, I will take

[jira] [Assigned] (YARN-10171) Add support for increment-allocation of custom resource types

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10171: - Assignee: Qi Zhu > Add support for increment-allocation of custom resource types > -

[jira] [Commented] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309324#comment-17309324 ] Qi Zhu commented on YARN-10707: --- Updated a patch to support custom resource utilization. :D

[jira] [Updated] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Attachment: YARN-10707.004.patch > Support custom resources in ResourceUtilization, and update Node GPU > Util

[jira] [Updated] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Summary: Support custom resources in ResourceUtilization, and update Node GPU Utilization to use. (was: Suppor

[jira] [Commented] (YARN-10715) Remove hardcoded resource values (e.g. GPU/FPGA) in code.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309224#comment-17309224 ] Qi Zhu commented on YARN-10715: --- [~ebadger] [~epayne] [~pbacsko] [~gandras] Just as comme

[jira] [Updated] (YARN-10715) Remove hardcoded resource values (e.g. GPU/FPGA) in code.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10715: -- Attachment: (was: YARN-10715.001.patch) > Remove hardcoded resource values (e.g. GPU/FPGA) in code. > -

[jira] [Updated] (YARN-10715) Remove hardcoded resource values (e.g. GPU/FPGA) in code.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10715: -- Attachment: YARN-10715.001.patch > Remove hardcoded resource values (e.g. GPU/FPGA) in code. >

[jira] [Commented] (YARN-10657) We should make max application per queue to support node label.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309193#comment-17309193 ] Qi Zhu commented on YARN-10657: --- cc [~pbacsko]  [~epayne] [~gandras] [~bteke]   Updated a

[jira] [Commented] (YARN-10519) Refactor QueueMetricsForCustomResources class to move to yarn-common package

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309130#comment-17309130 ] Qi Zhu commented on YARN-10519: --- [~minni31] [~bibinchundatt] Could you help back-port to b

[jira] [Comment Edited] (YARN-10713) ClusterMetrics should support custom resource capacity related metrics.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309106#comment-17309106 ] Qi Zhu edited comment on YARN-10713 at 3/26/21, 2:46 AM: - Thanks

[jira] [Commented] (YARN-10713) ClusterMetrics should support custom resource capacity related metrics.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309106#comment-17309106 ] Qi Zhu commented on YARN-10713: --- Thanks a lot [~ebadger] for review and confirm. I will ba

[jira] [Comment Edited] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309084#comment-17309084 ] Qi Zhu edited comment on YARN-10517 at 3/26/21, 2:33 AM: - Thanks

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309099#comment-17309099 ] Qi Zhu commented on YARN-10503: --- Thanks a lot [~ebadger] for review. It's a very good sugg

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.007.patch > Support queue capacity in terms of absolute resources with custom > resourc

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309084#comment-17309084 ] Qi Zhu commented on YARN-10517: --- Thanks [~epayne] for reply. Actually i not see it in the

[jira] [Comment Edited] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309084#comment-17309084 ] Qi Zhu edited comment on YARN-10517 at 3/26/21, 2:12 AM: - Thanks

[jira] [Updated] (YARN-10657) We should make max application per queue to support node label.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10657: -- Description: https://issues.apache.org/jira/browse/YARN-10641?focusedCommentId=17291708&page=com.atlassian.jira

[jira] [Commented] (YARN-10711) Make CSQueueMetrics configured related field to support nodelabel.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308625#comment-17308625 ] Qi Zhu commented on YARN-10711: --- cc [~pbacsko] [~gandras] [~ebadger] [~Jim_Brennan] [~epayn

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308472#comment-17308472 ] Qi Zhu commented on YARN-10503: --- Fixed checksyle in latest patch.  > Support queue capacit

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.006.patch > Support queue capacity in terms of absolute resources with custom > resourc

[jira] [Commented] (YARN-10571) Refactor dynamic queue handling logic

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308393#comment-17308393 ] Qi Zhu commented on YARN-10571: --- Thanks [~gandras] for update, LGTM +1 (Non-binding). > Re

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308392#comment-17308392 ] Qi Zhu commented on YARN-10517: --- Thanks a lot [~epayne] for review. :D > QueueMetrics has

[jira] [Commented] (YARN-10713) ClusterMetrics should support custom resource capacity related metrics.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308334#comment-17308334 ] Qi Zhu commented on YARN-10713: --- cc [~ebadger] Fixed checkstyle in latest patch. Could yo

[jira] [Updated] (YARN-10713) ClusterMetrics should support custom resource capacity related metrics.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10713: -- Attachment: YARN-10713.002.patch > ClusterMetrics should support custom resource capacity related metrics. > --

[jira] [Created] (YARN-10715) Remove hardcoded resource values (e.g. GPU/FPGA) in code.

2021-03-24 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10715: - Summary: Remove hardcoded resource values (e.g. GPU/FPGA) in code. Key: YARN-10715 URL: https://issues.apache.org/jira/browse/YARN-10715 Project: Hadoop YARN Issue Type: S

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308330#comment-17308330 ] Qi Zhu commented on YARN-10503: --- Thanks [~ebadger] for confirm. I have updated a patch to

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.005.patch > Support queue capacity in terms of absolute resources with custom > resourc

[jira] [Commented] (YARN-10713) ClusterMetrics should support custom resource capacity related metrics.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307966#comment-17307966 ] Qi Zhu commented on YARN-10713: --- [~pbacsko]   [~ebadger]  [~gandras]   [~Jim_Brennan] I ha

[jira] [Created] (YARN-10713) ClusterMetrics should support custom resource capacity related metrics.

2021-03-24 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10713: - Summary: ClusterMetrics should support custom resource capacity related metrics. Key: YARN-10713 URL: https://issues.apache.org/jira/browse/YARN-10713 Project: Hadoop YARN

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307845#comment-17307845 ] Qi Zhu commented on YARN-9618: -- The test failed not related this.  > NodeListManager event i

<    1   2   3   4   5   6   7   8   9   10   >