[
https://issues.apache.org/jira/browse/SAMZA-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jake Maes resolved SAMZA-1447.
------------------------------
Resolution: Fixed
PR merged and closed
> YarnCliJobStatusProvider cannot handle a high QPS to the JobsResource REST
> endpoint
> -----------------------------------------------------------------------------------
>
> Key: SAMZA-1447
> URL: https://issues.apache.org/jira/browse/SAMZA-1447
> Project: Samza
> Issue Type: Bug
> Reporter: Abhishek Shivanna
> Assignee: Abhishek Shivanna
> Priority: Major
>
> YarnCliJobStatusProvider shells out to a new process (running
> org.apache.hadoop.yarn.client.cli.ApplicationCLI) to fetch metadata about
> applications in the cluster.
> This leads to the host running out of memory when the number of requests
> being made to the JobsResource endpoint is high.
> The fix should be to use the Resource Manager REST endpoint instead which
> provides the same data without the new process per call overhead.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
