[jira] [Created] (YARN-11588) Fix uncleaned threads in YARN Federation interceptor threadpool
Jeffrey Chang created YARN-11588: Summary: Fix uncleaned threads in YARN Federation interceptor threadpool Key: YARN-11588 URL: https://issues.apache.org/jira/browse/YARN-11588 Project: Hadoop YARN Issue Type: Bug Reporter: Jeffrey Chang In YARN Federation a new interceptor is generated for each new user that calls YARN Router. This also generates a threadpool which is used to call YARN RM. However, when the call is finished the threadpool threads never exits, causing the interceptor object for the user to never be cleaned up. This causes an issue when the number of users is large in the YARN cluster, as the number of idle, uncleaned thread can reach # of users calling router times number of active core threads in thread pool. This causes performance issues in router due to too many idle threads. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Created] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability
Jeffrey Chang created YARN-11649: Summary: YARN Federation getNewApplication returns different maxresourcecapability Key: YARN-11649 URL: https://issues.apache.org/jira/browse/YARN-11649 Project: Hadoop YARN Issue Type: Bug Reporter: Jeffrey Chang Assignee: Jeffrey Chang When getNewApplication is called against YARN Router with Federation on, its possible we get different maxResourceCapabilities on different calls. This is because getNewApplication is called against a random cluster on each call, which may return different maxResourceCapability based on the cluster that the call is executed on. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability
[ https://issues.apache.org/jira/browse/YARN-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey Chang updated YARN-11649: - Description: When getNewApplication is called against YARN Router with Federation on, its possible we get different maxResourceCapabilities in its response on different calls. This is because getNewApplication is called against a random cluster on each call, which may return different maxResourceCapability based on the cluster that the call is executed on. (was: When getNewApplication is called against YARN Router with Federation on, its possible we get different maxResourceCapabilities on different calls. This is because getNewApplication is called against a random cluster on each call, which may return different maxResourceCapability based on the cluster that the call is executed on.) > YARN Federation getNewApplication returns different maxresourcecapability > - > > Key: YARN-11649 > URL: https://issues.apache.org/jira/browse/YARN-11649 > Project: Hadoop YARN > Issue Type: Bug >Reporter: Jeffrey Chang >Assignee: Jeffrey Chang >Priority: Minor > Labels: pull-request-available > > When getNewApplication is called against YARN Router with Federation on, its > possible we get different maxResourceCapabilities in its response on > different calls. This is because getNewApplication is called against a random > cluster on each call, which may return different maxResourceCapability based > on the cluster that the call is executed on. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability
[ https://issues.apache.org/jira/browse/YARN-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey Chang updated YARN-11649: - Description: When getNewApplication is called against YARN Router with Federation on, its possible we get different maxResourceCapabilities in its response on different calls. This is because getNewApplication is called against a random cluster on each call, which may return different maxResourceCapability based on the cluster that the call is executed on. ie in response in HTTP [https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_New_Application_API] (was: When getNewApplication is called against YARN Router with Federation on, its possible we get different maxResourceCapabilities in its response on different calls. This is because getNewApplication is called against a random cluster on each call, which may return different maxResourceCapability based on the cluster that the call is executed on.) > YARN Federation getNewApplication returns different maxresourcecapability > - > > Key: YARN-11649 > URL: https://issues.apache.org/jira/browse/YARN-11649 > Project: Hadoop YARN > Issue Type: Bug >Reporter: Jeffrey Chang >Assignee: Jeffrey Chang >Priority: Minor > Labels: pull-request-available > > When getNewApplication is called against YARN Router with Federation on, its > possible we get different maxResourceCapabilities in its response on > different calls. This is because getNewApplication is called against a random > cluster on each call, which may return different maxResourceCapability based > on the cluster that the call is executed on. ie in response in HTTP > [https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_New_Application_API] > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
