prateekm opened a new pull request #1257: SAMZA-2443: Upgrade Jetty version to prevent AM file descriptor leak URL: https://github.com/apache/samza/pull/1257 Symptom: AM Process runs out of file descriptors and gets stuck during deployment of jobs with a large number of containers. Containers are unable to start since they can’t fetch the JobModel and configs from the AM endpoint. Cause: This seems to be a Jetty bug that’s fixed in the latest versions. For more details, see: https://docs.google.com/document/d/1RFf_3_lJHHdoZHQlikSDHcm55GYbp7ObA8qVUwr-6p0/edit# Changes: Bump Jetty version to 9.4.20.v20190813 Tests: Reproduced locally using the test harness in https://github.com/prateekm/samza/commit/6d7e01b5b9d0d38a7766357a870ba7daeadd828e. All unit and integration tests pass with the version bump. Verified that Samza jobs are able to deploy correctly on a YARN cluster with the version bump. API Changes: Jetty version upgraded from 9.2.7.v20150116 to 9.4.20.v20190813. Upgrade Instructions: None. Usage Instructions: None.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
