http://git-wip-us.apache.org/repos/asf/hadoop/blob/c86d9bd1/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html b/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html index acd0c56..29da383 100644 --- a/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html +++ b/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html @@ -1,5 +1,5 @@ <META http-equiv="Content-Type" content="text/html; charset=UTF-8"> -<title>Hadoop 2.6.0 Release Notes</title> +<title>Hadoop 2.6.1 Release Notes</title> <STYLE type="text/css"> H1 {font-family: sans-serif} H2 {font-family: sans-serif; margin-left: 7mm} @@ -7,29168 +7,632 @@ </STYLE> </head> <body> -<h1>Hadoop 2.6.0 Release Notes</h1> +<h1>Hadoop 2.6.1 Release Notes</h1> These release notes include new developer and user-facing incompatibilities, features, and major improvements. <a name="changes"/> -<h2>Changes since Hadoop 2.5.1</h2> +<h2>Changes since Hadoop 2.6.0</h2> <ul> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2853";>YARN-2853</a>. - Major bug reported by Jian He and fixed by Jian He <br> - <b>Killing app may hang while AM is unregistering</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2846";>YARN-2846</a>. - Blocker bug reported by Junping Du and fixed by Junping Du (nodemanager)<br> - <b>Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2843";>YARN-2843</a>. - Major sub-task reported by Sushmitha Sreenivasan and fixed by Wangda Tan (resourcemanager)<br> - <b>NodeLabels manager should trim all inputs for hosts and labels</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2841";>YARN-2841</a>. - Critical sub-task reported by Jian He and fixed by Jian He (resourcemanager)<br> - <b>RMProxy should retry EOFException </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2834";>YARN-2834</a>. - Blocker bug reported by Yesha Vora and fixed by Jian He <br> - <b>Resource manager crashed with Null Pointer Exception</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2830";>YARN-2830</a>. - Blocker bug reported by Jonathan Eagles and fixed by Jonathan Eagles <br> - <b>Add backwords compatible ContainerId.newInstance constructor for use within Tez Local Mode</b><br> - <blockquote>I just committed this. Thanks [~jeagles] for the patch and [~ozawa] for the reviews!</blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2827";>YARN-2827</a>. - Critical bug reported by Wangda Tan and fixed by Wangda Tan (client)<br> - <b>Fix bugs of yarn queue CLI</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2826";>YARN-2826</a>. - Critical bug reported by Sidharta Seethana and fixed by Wangda Tan <br> - <b>User-Group mappings not updated by RM when a user is removed from a group.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2825";>YARN-2825</a>. - Critical bug reported by Jian He and fixed by Jian He <br> - <b>Container leak on NM</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2824";>YARN-2824</a>. - Critical sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)<br> - <b>Capacity of labels should be zero by default</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2823";>YARN-2823</a>. - Critical bug reported by Gour Saha and fixed by Jian He (resourcemanager)<br> - <b>NullPointerException in RM HA enabled 3-node cluster</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2819";>YARN-2819</a>. - Critical bug reported by Gopal V and fixed by Zhijie Shen (timelineserver)<br> - <b>NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2818";>YARN-2818</a>. - Critical bug reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Remove the logic to inject entity owner as the primary filter</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2813";>YARN-2813</a>. - Major bug reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>NPE from MemoryTimelineStore.getDomains</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2812";>YARN-2812</a>. - Major test reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>TestApplicationHistoryServer is likely to fail on less powerful machine</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2810";>YARN-2810</a>. - Major test reported by Varun Vasudev and fixed by Varun Vasudev (resourcemanager)<br> - <b>TestRMProxyUsersConf fails on Windows VMs</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2805";>YARN-2805</a>. - Blocker bug reported by Arpit Gupta and fixed by Wangda Tan (resourcemanager)<br> - <b>RM2 in HA setup tries to login using the RM1's kerberos principal</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2804";>YARN-2804</a>. - Critical bug reported by Zhijie Shen and fixed by Zhijie Shen <br> - <b>Timeline server .out log have JAXB binding exceptions and warnings.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2803";>YARN-2803</a>. - Critical bug reported by Chris Nauroth and fixed by Craig Welch (nodemanager)<br> - <b>MR distributed cache not working correctly on Windows after NodeManager privileged account changes.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2798";>YARN-2798</a>. - Blocker bug reported by Arpit Gupta and fixed by Zhijie Shen (timelineserver)<br> - <b>YarnClient doesn't need to translate Kerberos name of timeline DT renewer</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2795";>YARN-2795</a>. - Major sub-task reported by Phil D'Amore and fixed by Wangda Tan (resourcemanager)<br> - <b>Resource Manager fails startup with HDFS label storage and secure cluster</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2794";>YARN-2794</a>. - Major bug reported by Jian He and fixed by Jian He <br> - <b>Fix log msgs about distributing system-credentials </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2790";>YARN-2790</a>. - Critical bug reported by Tassapol Athiapinya and fixed by Jian He (nodemanager)<br> - <b>NM can't aggregate logs past HDFS delegation token expiry.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2789";>YARN-2789</a>. - Critical task reported by Siddharth Seth and fixed by Wangda Tan <br> - <b>Re-instate the NodeReport.newInstance API modified in YARN-2698</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2788";>YARN-2788</a>. - Blocker bug reported by Gopal V and fixed by Xuan Gong (log-aggregation)<br> - <b>yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2785";>YARN-2785</a>. - Major test reported by Varun Vasudev and fixed by Varun Vasudev <br> - <b>TestContainerResourceUsage fails intermittently</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2779";>YARN-2779</a>. - Critical bug reported by Zhijie Shen and fixed by Zhijie Shen (resourcemanager , timelineserver)<br> - <b>SystemMetricsPublisher can use Kerberos directly instead of timeline DT</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2778";>YARN-2778</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (client)<br> - <b>YARN node CLI should display labels on returned node reports</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2770";>YARN-2770</a>. - Critical sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Timeline delegation tokens need to be automatically renewed by the RM</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2769";>YARN-2769</a>. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev (applications/distributed-shell)<br> - <b>Timeline server domain not set correctly when using shell_command on Windows</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2767";>YARN-2767</a>. - Major test reported by Varun Vasudev and fixed by Varun Vasudev (resourcemanager)<br> - <b>RM web services - add test case to ensure the http static user cannot kill or submit apps in secure mode</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2760";>YARN-2760</a>. - Trivial bug reported by Harsh J and fixed by Harsh J (documentation)<br> - <b>Completely remove word 'experimental' from FairScheduler docs</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2758";>YARN-2758</a>. - Major test reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Update TestApplicationHistoryClientService to use the new generic history store</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2755";>YARN-2755</a>. - Critical bug reported by Siqi Li and fixed by Siqi Li <br> - <b>NM fails to clean up usercache_DEL_<timestamp> dirs after YARN-661</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2753";>YARN-2753</a>. - Major sub-task reported by zhihai xu and fixed by zhihai xu <br> - <b>Fix potential issues and code clean up for *NodeLabelsManager</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2752";>YARN-2752</a>. - Critical bug reported by Xuan Gong and fixed by Xuan Gong <br> - <b>ContainerExecutor always append "nice -n" in command on branch-2</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2747";>YARN-2747</a>. - Major test reported by Xuan Gong and fixed by Xuan Gong <br> - <b>TestAggregatedLogFormat fails in trunk</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2744";>YARN-2744</a>. - Critical sub-task reported by Sumit Mohanty and fixed by Wangda Tan (capacityscheduler)<br> - <b>Under some scenario, it is possible to end up with capacity scheduler configuration that uses labels that no longer exist</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2743";>YARN-2743</a>. - Blocker bug reported by Arpit Gupta and fixed by Jian He (resourcemanager)<br> - <b>Yarn jobs via oozie fail with failed to renew token (secure) or digest mismatch (unsecure) errors when RM is being killed</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2741";>YARN-2741</a>. - Major bug reported by Craig Welch and fixed by Craig Welch (nodemanager)<br> - <b>Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanager is running on)</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2734";>YARN-2734</a>. - Major bug reported by Sumit Mohanty and fixed by Xuan Gong (log-aggregation)<br> - <b>If a sub-folder is encountered by log aggregator it results in invalid aggregated file</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2732";>YARN-2732</a>. - Major bug reported by Jian He and fixed by Jian He <br> - <b>Fix syntax error in SecureContainer.apt.vm</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2730";>YARN-2730</a>. - Critical bug reported by Siqi Li and fixed by Siqi Li <br> - <b>DefaultContainerExecutor runs only one localizer at a time</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2726";>YARN-2726</a>. - Minor sub-task reported by Phil D'Amore and fixed by Wangda Tan (capacityscheduler)<br> - <b>CapacityScheduler should explicitly log when an accessible label has no capacity</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2724";>YARN-2724</a>. - Major bug reported by Sumit Mohanty and fixed by Xuan Gong (log-aggregation)<br> - <b>If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2723";>YARN-2723</a>. - Major sub-task reported by Phil D'Amore and fixed by Naganarasimha G R (client)<br> - <b>rmadmin -replaceLabelsOnNode does not correctly parse port</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2721";>YARN-2721</a>. - Blocker bug reported by Jian He and fixed by Jian He <br> - <b>Race condition: ZKRMStateStore retry logic may throw NodeExist exception </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2720";>YARN-2720</a>. - Major bug reported by Craig Welch and fixed by Craig Welch (nodemanager)<br> - <b>Windows: Wildcard classpath variables not expanded against resources contained in archives</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2717";>YARN-2717</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (log-aggregation)<br> - <b>containerLogNotFound log shows multiple time for the same container</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2715";>YARN-2715</a>. - Blocker bug reported by Zhijie Shen and fixed by Zhijie Shen (resourcemanager)<br> - <b>Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2711";>YARN-2711</a>. - Major test reported by Varun Vasudev and fixed by Varun Vasudev <br> - <b>TestDefaultContainerExecutor#testContainerLaunchError fails on Windows</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2709";>YARN-2709</a>. - Major sub-task reported by Li Lu and fixed by Li Lu <br> - <b>Add retry for timeline client getDelegationToken method</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2707";>YARN-2707</a>. - Minor bug reported by Ted Yu and fixed by Gera Shegalov <br> - <b>Potential null dereference in FSDownload</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2705";>YARN-2705</a>. - Critical sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)<br> - <b>Changes of RM node label manager default configuration</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2704";>YARN-2704</a>. - Critical sub-task reported by Jian He and fixed by Jian He <br> - <b> Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2703";>YARN-2703</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)<br> - <b>Add logUploadedTime into LogValue for better display</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2701";>YARN-2701</a>. - Blocker bug reported by Xuan Gong and fixed by Xuan Gong <br> - <b>Potential race condition in startLocalizer when using LinuxContainerExecutor </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2700";>YARN-2700</a>. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (api , resourcemanager)<br> - <b>TestSecureRMRegistryOperations failing on windows: auth problems</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2699";>YARN-2699</a>. - Blocker sub-task reported by Wangda Tan and fixed by Wangda Tan (client)<br> - <b>Fix test timeout in TestResourceTrackerOnHA#testResourceTrackerOnHA</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2698";>YARN-2698</a>. - Critical sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)<br> - <b>Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2692";>YARN-2692</a>. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran <br> - <b>ktutil test hanging on some machines/ktutil versions</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2689";>YARN-2689</a>. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (api , resourcemanager)<br> - <b>TestSecureRMRegistryOperations failing on windows: secure ZK won't start</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2685";>YARN-2685</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)<br> - <b>Resource on each label not correct when multiple NMs in a same host and some has label some not</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2682";>YARN-2682</a>. - Minor bug reported by zhihai xu and fixed by zhihai xu (nodemanager)<br> - <b>WindowsSecureContainerExecutor should not depend on DefaultContainerExecutor#getFirstApplicationDir. </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2678";>YARN-2678</a>. - Major sub-task reported by Gour Saha and fixed by Steve Loughran (api , resourcemanager)<br> - <b>Improved Yarn Registry service record structure</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2677";>YARN-2677</a>. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (api , resourcemanager)<br> - <b>registry punycoding of usernames doesn't fix all usernames to be DNS-valid</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2676";>YARN-2676</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Timeline authentication filter should add support for proxy user</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2673";>YARN-2673</a>. - Major sub-task reported by Li Lu and fixed by Li Lu <br> - <b>Add retry for timeline client put APIs</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2671";>YARN-2671</a>. - Blocker bug reported by Zhijie Shen and fixed by Wangda Tan (resourcemanager)<br> - <b>ApplicationSubmissionContext change breaks the existing app submission</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2668";>YARN-2668</a>. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (client)<br> - <b>yarn-registry JAR won't link against ZK 3.4.5</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2667";>YARN-2667</a>. - Minor bug reported by Yi Liu and fixed by Yi Liu <br> - <b>Fix the release audit warning caused by hadoop-yarn-registry</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2662";>YARN-2662</a>. - Minor bug reported by Chris Nauroth and fixed by Chris Nauroth (test)<br> - <b>TestCgroupsLCEResourcesHandler leaks file descriptors.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2656";>YARN-2656</a>. - Major bug reported by Varun Vasudev and fixed by Zhijie Shen (resourcemanager)<br> - <b>RM web services authentication filter should add support for proxy user</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2652";>YARN-2652</a>. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (api)<br> - <b>add hadoop-yarn-registry package under hadoop-yarn</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2651";>YARN-2651</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)<br> - <b>Spin off the LogRollingInterval from LogAggregationContext</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2649";>YARN-2649</a>. - Major bug reported by Ming Ma and fixed by Ming Ma <br> - <b>Flaky test TestAMRMRPCNodeUpdates</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2647";>YARN-2647</a>. - Major sub-task reported by Wangda Tan and fixed by Sunil G (client)<br> - <b>Add yarn queue CLI to get queue infos</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2644";>YARN-2644</a>. - Major sub-task reported by Craig Welch and fixed by Craig Welch <br> - <b>Recalculate headroom more frequently to keep it accurate</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2635";>YARN-2635</a>. - Major bug reported by Wei Yan and fixed by Wei Yan <br> - <b>TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2632";>YARN-2632</a>. - Blocker sub-task reported by Junping Du and fixed by Junping Du (nodemanager)<br> - <b>Document NM Restart feature</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-4047";>YARN-4047</a>. + Major bug reported by Jason Lowe and fixed by Jason Lowe (resourcemanager)<br> + <b>ClientRMService getApplications has high scheduler lock contention</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2630";>YARN-2630</a>. +<li> <a href="https://issues.apache.org/jira/browse/YARN-3999";>YARN-3999</a>. Major bug reported by Jian He and fixed by Jian He <br> - <b>TestDistributedShell#testDSRestartWithPreviousRunningContainers fails</b><br> + <b>RM hangs on draining events</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2629";>YARN-2629</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Make distributed shell use the domain-based timeline ACLs</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3990";>YARN-3990</a>. + Critical bug reported by Rohith Sharma K S and fixed by Bibin A Chundatt (resourcemanager)<br> + <b>AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2628";>YARN-2628</a>. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev (capacityscheduler)<br> - <b>Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3978";>YARN-3978</a>. + Major improvement reported by Eric Payne and fixed by Eric Payne (timelineserver , yarn)<br> + <b>Configurably turn off the saving of container info in Generic AHS</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2627";>YARN-2627</a>. - Major improvement reported by Xuan Gong and fixed by Xuan Gong <br> - <b>Add logs when attemptFailuresValidityInterval is enabled</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3850";>YARN-3850</a>. + Blocker bug reported by Varun Saxena and fixed by Varun Saxena (log-aggregation , nodemanager)<br> + <b>NM fails to read files from full disks which can lead to container logs being lost and other issues</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2624";>YARN-2624</a>. - Blocker bug reported by Anubhav Dhoot and fixed by Anubhav Dhoot (nodemanager)<br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3832";>YARN-3832</a>. + Critical bug reported by Ranga Swamy and fixed by Brahma Reddy Battula (nodemanager)<br> <b>Resource Localization fails on a cluster due to existing cache directories</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2621";>YARN-2621</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Simplify the output when the user doesn't have the access for getDomain(s) </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2617";>YARN-2617</a>. - Major bug reported by Jun Gong and fixed by Jun Gong (nodemanager)<br> - <b>NM does not need to send finished container whose APP is not running to RM</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2615";>YARN-2615</a>. - Blocker sub-task reported by Junping Du and fixed by Junping Du <br> - <b>ClientToAMTokenIdentifier and DelegationTokenIdentifier should allow extended fields</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2611";>YARN-2611</a>. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (capacityscheduler , resourcemanager , scheduler)<br> - <b>Fix jenkins findbugs warning and test case failures for trunk merge patch</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2610";>YARN-2610</a>. - Major bug reported by Ray Chiang and fixed by Ray Chiang <br> - <b>Hamlet should close table tags</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2608";>YARN-2608</a>. - Major bug reported by Wei Yan and fixed by Wei Yan <br> - <b>FairScheduler: Potential deadlocks in loading alloc files and clock access</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2607";>YARN-2607</a>. - Major test reported by Ted Yu and fixed by Wangda Tan <br> - <b>TestDistributedShell fails in trunk</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2606";>YARN-2606</a>. - Major bug reported by Mit Desai and fixed by Mit Desai (timelineserver)<br> - <b>Application History Server tries to access hdfs before doing secure login</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2602";>YARN-2602</a>. - Major bug reported by Karam Singh and fixed by Zhijie Shen (timelineserver)<br> - <b>Generic History Service of TimelineServer sometimes not able to handle NPE</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2596";>YARN-2596</a>. - Major test reported by Junping Du and fixed by Karthik Kambatla <br> - <b>TestWorkPreservingRMRestart fails with FairScheduler</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2594";>YARN-2594</a>. - Blocker bug reported by Karam Singh and fixed by Wangda Tan (resourcemanager)<br> - <b>Potential deadlock in RM when querying ApplicationResourceUsageReport</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2591";>YARN-2591</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2588";>YARN-2588</a>. - Major bug reported by Rohith and fixed by Rohith (resourcemanager)<br> - <b>Standby RM does not transitionToActive if previous transitionToActive is failed with ZK exception.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2584";>YARN-2584</a>. - Major test reported by Zhijie Shen and fixed by Jian He <br> - <b>TestContainerManagerSecurity fails on trunk</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2583";>YARN-2583</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)<br> - <b>Modify the LogDeletionService to support Log aggregation for LRS</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2582";>YARN-2582</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)<br> - <b>Log related CLI and Web UI changes for Aggregated Logs in LRS</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2581";>YARN-2581</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)<br> - <b>NMs need to find a way to get LogAggregationContext</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2579";>YARN-2579</a>. - Blocker bug reported by Rohith and fixed by Rohith (resourcemanager)<br> - <b>Deadlock when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2577";>YARN-2577</a>. - Trivial improvement reported by Miklos Christine and fixed by Miklos Christine (documentation , fairscheduler)<br> - <b>Clarify ACL delimiter and how to configure ACL groups only</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2576";>YARN-2576</a>. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (capacityscheduler , resourcemanager , scheduler)<br> - <b>Prepare yarn-1051 branch for merging with trunk</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2569";>YARN-2569</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)<br> - <b>API changes for handling logs of long-running services</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2568";>YARN-2568</a>. - Major bug reported by Jian He and fixed by Jian He <br> - <b>TestAMRMClientOnRMRestart test fails</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2566";>YARN-2566</a>. - Critical sub-task reported by zhihai xu and fixed by zhihai xu (nodemanager)<br> - <b>DefaultContainerExecutor should pick a working directory randomly</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2565";>YARN-2565</a>. - Major bug reported by Karam Singh and fixed by Zhijie Shen (resourcemanager , timelineserver)<br> - <b>RM shouldn't use the old RMApplicationHistoryWriter unless explicitly setting FileSystemApplicationHistoryStore</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2563";>YARN-2563</a>. - Blocker bug reported by Arpit Gupta and fixed by Zhijie Shen (timelineserver)<br> - <b>On secure clusters call to timeline server fails with authentication errors when running a job via oozie</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2562";>YARN-2562</a>. - Critical bug reported by Vinod Kumar Vavilapalli and fixed by Tsuyoshi OZAWA <br> - <b>ContainerId@toString() is unreadable for epoch >0 after YARN-2182</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2561";>YARN-2561</a>. - Blocker sub-task reported by Tassapol Athiapinya and fixed by Junping Du <br> - <b>MR job client cannot reconnect to AM after NM restart.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2559";>YARN-2559</a>. - Major bug reported by Karam Singh and fixed by Zhijie Shen (resourcemanager , timelineserver)<br> - <b>ResourceManager sometime become un-responsive due to NPE in SystemMetricsPublisher</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2558";>YARN-2558</a>. - Blocker sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA <br> - <b>Updating ContainerTokenIdentifier#read/write to use ContainerId#getContainerId</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2557";>YARN-2557</a>. - Major bug reported by Xuan Gong and fixed by Xuan Gong (applications/distributed-shell)<br> - <b>Add a parameter "attempt_Failures_Validity_Interval" in DistributedShell </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2549";>YARN-2549</a>. - Minor test reported by Chris Nauroth and fixed by Chris Nauroth (nodemanager , test)<br> - <b>TestContainerLaunch fails due to classpath problem with hamcrest classes.</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2547";>YARN-2547</a>. - Major sub-task reported by Jonathan Eagles and fixed by Mit Desai (timelineserver)<br> - <b>Cross Origin Filter throws UnsupportedOperationException upon destroy</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2546";>YARN-2546</a>. - Major bug reported by Doug Haigh and fixed by Varun Vasudev (api)<br> - <b>REST API for application creation/submission is using strings for numeric & boolean values</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2544";>YARN-2544</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)<br> - <b>Common server side PB changes (not include user API PB changes)</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2542";>YARN-2542</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen <br> - <b>"yarn application -status <appId>" throws NPE when retrieving the app from the timelineserver</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2541";>YARN-2541</a>. - Major bug reported by Jian He and fixed by Jian He <br> - <b>Fix ResourceManagerRest.apt.vm syntax error</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2540";>YARN-2540</a>. - Major bug reported by Ashwin Shankar and fixed by Ashwin Shankar (scheduler)<br> - <b>FairScheduler: Queue filters not working on scheduler page in RM UI</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2539";>YARN-2539</a>. - Minor improvement reported by Wei Yan and fixed by Wei Yan <br> - <b>FairScheduler: Set the default value for maxAMShare to 0.5</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3733";>YARN-3733</a>. + Blocker bug reported by Bibin A Chundatt and fixed by Rohith Sharma K S (resourcemanager)<br> + <b>Fix DominantRC#compare() does not work as expected if cluster resource is empty</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2538";>YARN-2538</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)<br> - <b>Add logs when RM send new AMRMToken to ApplicationMaster</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3725";>YARN-3725</a>. + Blocker bug reported by Zhijie Shen and fixed by Zhijie Shen (resourcemanager , timelineserver)<br> + <b>App submission via REST API is broken in secure mode due to Timeline DT service address is empty</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2534";>YARN-2534</a>. - Major bug reported by zhihai xu and fixed by zhihai xu (scheduler)<br> - <b>FairScheduler: Potential integer overflow calculating totalMaxShare</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3700";>YARN-3700</a>. + Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager , webapp , yarn)<br> + <b>ATS Web Performance issue at load time when large number of jobs</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2531";>YARN-2531</a>. - Major improvement reported by Varun Vasudev and fixed by Varun Vasudev <br> - <b>CGroups - Admins should be allowed to enforce strict cpu limits</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3585";>YARN-3585</a>. + Critical bug reported by Peng Zhang and fixed by Rohith Sharma K S <br> + <b>NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2529";>YARN-2529</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Generic history service RPC interface doesn't work when service authorization is enabled</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3526";>YARN-3526</a>. + Major bug reported by Weiwei Yang and fixed by Weiwei Yang (resourcemanager , webapp)<br> + <b>ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2528";>YARN-2528</a>. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (timelineserver)<br> - <b>Cross Origin Filter Http response split vulnerability protection rejects valid origins</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3493";>YARN-3493</a>. + Critical bug reported by Sumana Sathish and fixed by Jian He (yarn)<br> + <b>RM fails to come up with error "Failed to load/recover state" when mem settings are changed</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2527";>YARN-2527</a>. - Major bug reported by Benoy Antony and fixed by Benoy Antony (resourcemanager)<br> - <b>NPE in ApplicationACLsManager</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3487";>YARN-3487</a>. + Critical sub-task reported by Jason Lowe and fixed by Jason Lowe (capacityscheduler)<br> + <b>CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2526";>YARN-2526</a>. - Critical bug reported by Wei Yan and fixed by Wei Yan (scheduler-load-simulator)<br> - <b>SLS can deadlock when all the threads are taken by AMSimulators</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3464";>YARN-3464</a>. + Critical bug reported by zhihai xu and fixed by zhihai xu (nodemanager)<br> + <b>Race condition in LocalizerRunner kills localizer before localizing all resources</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2523";>YARN-2523</a>. - Major bug reported by Nishan Shetty and fixed by Rohith (resourcemanager , webapp)<br> - <b>ResourceManager UI showing negative value for "Decommissioned Nodes" field</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2519";>YARN-2519</a>. - Major test reported by Xiaoyu Yao and fixed by Xiaoyu Yao (webapp)<br> - <b>Credential Provider related unit tests failed on Windows</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2515";>YARN-2515</a>. - Major sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (resourcemanager)<br> - <b>Update ConverterUtils#toContainerId to parse epoch</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2512";>YARN-2512</a>. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (timelineserver)<br> - <b>Allow for origin pattern matching in cross origin filter</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2511";>YARN-2511</a>. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (timelineserver)<br> - <b>Allow All Origins by default when Cross Origin Filter is enabled</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2509";>YARN-2509</a>. - Major sub-task reported by Jonathan Eagles and fixed by Mit Desai (timelineserver)<br> - <b>Enable Cross Origin Filter for timeline server only and not all Yarn servers</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2508";>YARN-2508</a>. - Major sub-task reported by Jonathan Eagles and fixed by Mit Desai (timelineserver)<br> - <b>Cross Origin configuration parameters prefix are not honored</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2507";>YARN-2507</a>. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (documentation , timelineserver)<br> - <b>Document Cross Origin Filter Configuration for ATS</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2505";>YARN-2505</a>. - Major sub-task reported by Wangda Tan and fixed by Craig Welch (resourcemanager)<br> - <b>Support get/add/remove/change labels in RM REST API</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2504";>YARN-2504</a>. - Critical sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)<br> - <b>Support get/add/remove/change labels in RM admin CLI </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2503";>YARN-2503</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)<br> - <b>Changes in RM Web UI to better show labels to end users</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2502";>YARN-2502</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)<br> - <b>Changes in distributed shell to support specify labels</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2501";>YARN-2501</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)<br> - <b>Changes in AMRMClient to support labels</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2500";>YARN-2500</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)<br> - <b>Miscellaneous changes in ResourceManager to support labels</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2496";>YARN-2496</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)<br> - <b>Changes for capacity scheduler to support allocate resource respect labels</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2494";>YARN-2494</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)<br> - <b>Node label manager API and storage implementations</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2493";>YARN-2493</a>. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (api)<br> - <b>API changes for users</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2484";>YARN-2484</a>. - Trivial bug reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA <br> - <b>FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2475";>YARN-2475</a>. - Major sub-task reported by Carlo Curino and fixed by Carlo Curino (resourcemanager)<br> - <b>ReservationSystem: replan upon capacity reduction</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2468";>YARN-2468</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (log-aggregation , nodemanager , resourcemanager)<br> - <b>Log handling for LRS</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2462";>YARN-2462</a>. - Major bug reported by Jason Lowe and fixed by Eric Payne <br> - <b>TestNodeManagerResync#testBlockNewContainerRequestsOnStartAndResync should have a test timeout</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2460";>YARN-2460</a>. - Minor bug reported by Ray Chiang and fixed by Ray Chiang <br> - <b>Remove obsolete entries from yarn-default.xml</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2459";>YARN-2459</a>. - Major bug reported by Mayank Bansal and fixed by Mayank Bansal (resourcemanager)<br> - <b>RM crashes if App gets rejected for any reason and HA is enabled</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2456";>YARN-2456</a>. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)<br> - <b>Possible livelock in CapacityScheduler when RM is recovering apps</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2453";>YARN-2453</a>. - Major bug reported by zhihai xu and fixed by zhihai xu <br> - <b>TestProportionalCapacityPreemptionPolicy fails with FairScheduler</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2452";>YARN-2452</a>. - Major bug reported by zhihai xu and fixed by zhihai xu <br> - <b>TestRMApplicationHistoryWriter fails with FairScheduler</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2450";>YARN-2450</a>. - Trivial bug reported by Ray Chiang and fixed by Ray Chiang <br> - <b>Fix typos in log messages</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2449";>YARN-2449</a>. - Critical bug reported by Karam Singh and fixed by Varun Vasudev (timelineserver)<br> - <b>Timelineserver returns invalid Delegation token in secure kerberos enabled cluster when hadoop.http.filter.initializers are not set</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2448";>YARN-2448</a>. - Major improvement reported by Varun Vasudev and fixed by Varun Vasudev <br> - <b>RM should expose the resource types considered during scheduling when AMs register</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2447";>YARN-2447</a>. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev <br> - <b>RM web services app submission doesn't pass secrets correctly</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2446";>YARN-2446</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Using TimelineNamespace to shield the entities of a user</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2440";>YARN-2440</a>. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev <br> - <b>Cgroups should allow YARN containers to be limited to allocated cores</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2434";>YARN-2434</a>. - Major sub-task reported by Jian He and fixed by Jian He <br> - <b>RM should not recover containers from previously failed attempt when AM restart is not enabled</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2431";>YARN-2431</a>. - Major sub-task reported by Jason Lowe and fixed by Jason Lowe (nodemanager)<br> - <b>NM restart: cgroup is not removed for reacquired containers</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2424";>YARN-2424</a>. - Blocker bug reported by Allen Wittenauer and fixed by Allen Wittenauer (nodemanager)<br> - <b>LCE should support non-cgroups, non-secure mode</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2411";>YARN-2411</a>. - Major improvement reported by Ram Venkatesh and fixed by Ram Venkatesh (capacityscheduler)<br> - <b>[Capacity Scheduler] support simple user and group mappings to queues</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2409";>YARN-2409</a>. - Critical bug reported by Nishan Shetty and fixed by Rohith (resourcemanager)<br> - <b>Active to StandBy transition does not stop rmDispatcher that causes 1 AsyncDispatcher thread leak. </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2406";>YARN-2406</a>. - Major sub-task reported by Jian He and fixed by Tsuyoshi OZAWA <br> - <b>Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2405";>YARN-2405</a>. - Major bug reported by Maysam Yabandeh and fixed by Tsuyoshi OZAWA <br> - <b>NPE in FairSchedulerAppsBlock</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2400";>YARN-2400</a>. - Major bug reported by Jian He and fixed by Jian He <br> - <b>TestAMRestart fails intermittently</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2399";>YARN-2399</a>. - Major improvement reported by Karthik Kambatla and fixed by Karthik Kambatla (fairscheduler)<br> - <b>FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2397";>YARN-2397</a>. - Critical bug reported by Varun Vasudev and fixed by Varun Vasudev <br> - <b>RM and TS web interfaces sometimes return request is a replay error in secure mode</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2395";>YARN-2395</a>. - Major new feature reported by Ashwin Shankar and fixed by Wei Yan (fairscheduler)<br> - <b>FairScheduler: Preemption timeout should be configurable per queue</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2394";>YARN-2394</a>. - Major new feature reported by Ashwin Shankar and fixed by Wei Yan (fairscheduler)<br> - <b>FairScheduler: Configure fairSharePreemptionThreshold per queue</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2393";>YARN-2393</a>. - Major new feature reported by Ashwin Shankar and fixed by Wei Yan (fairscheduler)<br> - <b>FairScheduler: Add the notion of steady fair share</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2389";>YARN-2389</a>. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (capacityscheduler , fairscheduler)<br> - <b>Adding support for drainig a queue, ie killing all apps in the queue</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2388";>YARN-2388</a>. - Major test reported by Zhijie Shen and fixed by Zhijie Shen <br> - <b>TestTimelineWebServices fails on trunk after HADOOP-10791</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2387";>YARN-2387</a>. - Blocker bug reported by Mit Desai and fixed by Mit Desai <br> - <b>Resource Manager crashes with NPE due to lack of synchronization</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2378";>YARN-2378</a>. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (capacityscheduler)<br> - <b>Adding support for moving apps between queues in Capacity Scheduler</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2377";>YARN-2377</a>. - Major improvement reported by Gera Shegalov and fixed by Gera Shegalov (nodemanager)<br> - <b>Localization exception stack traces are not passed as diagnostic info</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2374";>YARN-2374</a>. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev <br> - <b>YARN trunk build failing TestDistributedShell.testDSShell</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2373";>YARN-2373</a>. - Major bug reported by Larry McCay and fixed by Larry McCay <br> - <b>WebAppUtils Should Use configuration.getPassword for Accessing SSL Passwords</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3393";>YARN-3393</a>. + Critical bug reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> + <b>Getting application(s) goes wrong when app finishes before starting the attempt</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2372";>YARN-2372</a>. - Minor improvement reported by Fengdong Yu and fixed by Fengdong Yu (documentation)<br> - <b>There are Chinese Characters in the FairScheduler's document</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3369";>YARN-3369</a>. + Blocker bug reported by Giovanni Matteo Fumarola and fixed by Brahma Reddy Battula (resourcemanager)<br> + <b>Missing NullPointer check in AppSchedulingInfo causes RM to die </b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2370";>YARN-2370</a>. - Trivial bug reported by Wenwu Peng and fixed by Wenwu Peng (resourcemanager)<br> - <b>Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3287";>YARN-3287</a>. + Major bug reported by Jonathan Eagles and fixed by Daryn Sharp <br> + <b>TimelineClient kerberos authentication failure uses wrong login context.</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2363";>YARN-2363</a>. - Major bug reported by Jason Lowe and fixed by Jason Lowe (resourcemanager)<br> - <b>Submitted applications occasionally lack a tracking URL</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3267";>YARN-3267</a>. + Major bug reported by Prakash Ramachandran and fixed by Chang Li <br> + <b>Timelineserver applies the ACL rules after applying the limit on the number of records</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2361";>YARN-2361</a>. - Trivial improvement reported by zhihai xu and fixed by zhihai xu (resourcemanager)<br> - <b>RMAppAttempt state machine entries for KILLED state has duplicate event entries</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3251";>YARN-3251</a>. + Blocker bug reported by Jason Lowe and fixed by Craig Welch <br> + <b>Fix CapacityScheduler deadlock when computing absolute max avail capacity (short term fix for 2.6.1)</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2360";>YARN-2360</a>. - Major new feature reported by Ashwin Shankar and fixed by Ashwin Shankar (fairscheduler)<br> - <b>Fair Scheduler: Display dynamic fair share for queues on the scheduler page</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3249";>YARN-3249</a>. + Minor improvement reported by Ryu Kobayashi and fixed by Ryu Kobayashi (resourcemanager)<br> + <b>Add a "kill application" button to Resource Manager's Web UI</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2359";>YARN-2359</a>. +<li> <a href="https://issues.apache.org/jira/browse/YARN-3242";>YARN-3242</a>. Critical bug reported by zhihai xu and fixed by zhihai xu (resourcemanager)<br> - <b>Application hangs when it fails to launch AM container </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2354";>YARN-2354</a>. - Major sub-task reported by Jian He and fixed by Li Lu <br> - <b>DistributedShell may allocate more containers than client specified after it restarts</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2352";>YARN-2352</a>. - Major improvement reported by Karthik Kambatla and fixed by Karthik Kambatla (scheduler)<br> - <b>FairScheduler: Collect metrics on duration of critical methods that affect performance</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2347";>YARN-2347</a>. - Major sub-task reported by Junping Du and fixed by Junping Du <br> - <b>Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2343";>YARN-2343</a>. - Trivial improvement reported by Li Lu and fixed by Li Lu <br> - <b>Improve error message on token expire exception</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2337";>YARN-2337</a>. - Trivial improvement reported by zhihai xu and fixed by zhihai xu (resourcemanager)<br> - <b>ResourceManager sets ClientRMService in RMContext multiple times</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2323";>YARN-2323</a>. - Minor improvement reported by Hong Zhiguo and fixed by Hong Zhiguo (fairscheduler)<br> - <b>FairShareComparator creates too many Resource objects</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2321";>YARN-2321</a>. - Major bug reported by Leitao Guo and fixed by Leitao Guo (nodemanager)<br> - <b>NodeManager web UI can incorrectly report Pmem enforcement</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2317";>YARN-2317</a>. - Major sub-task reported by Li Lu and fixed by Li Lu (documentation)<br> - <b>Update documentation about how to write YARN applications</b><br> + <b>Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2314";>YARN-2314</a>. - Critical bug reported by Jason Lowe and fixed by Jason Lowe (client)<br> - <b>ContainerManagementProtocolProxy can create thousands of threads for a large cluster</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2313";>YARN-2313</a>. - Major bug reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (fairscheduler)<br> - <b>Livelock can occur in FairScheduler when there are lots of running apps</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2312";>YARN-2312</a>. - Major sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (resourcemanager)<br> - <b>Marking ContainerId#getId as deprecated</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2308";>YARN-2308</a>. - Critical bug reported by Wangda Tan and fixed by chang li (resourcemanager , scheduler)<br> - <b>NPE happened when RM restart after CapacityScheduler queue configuration changed </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2302";>YARN-2302</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Refactor TimelineWebServices</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2298";>YARN-2298</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (client)<br> - <b>Move TimelineClient to yarn-common project</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2295";>YARN-2295</a>. - Major sub-task reported by Li Lu and fixed by Li Lu <br> - <b>Refactor YARN distributed shell with existing public stable API</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2288";>YARN-2288</a>. - Major sub-task reported by Junping Du and fixed by Junping Du (timelineserver)<br> - <b>Data persistent in timelinestore should be versioned</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2279";>YARN-2279</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)<br> - <b>Add UTs to cover timeline server authentication</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2277";>YARN-2277</a>. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (timelineserver)<br> - <b>Add Cross-Origin support to the ATS REST API</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2274";>YARN-2274</a>. - Trivial improvement reported by Karthik Kambatla and fixed by Karthik Kambatla (fairscheduler)<br> - <b>FairScheduler: Add debug information about cluster capacity, availability and reservations</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2273";>YARN-2273</a>. - Major bug reported by Andy Skelton and fixed by Wei Yan (fairscheduler , resourcemanager)<br> - <b>NPE in ContinuousScheduling thread when we lose a node</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2269";>YARN-2269</a>. - Major bug reported by Yesha Vora and fixed by Craig Welch <br> - <b>External links need to be removed from YARN UI</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2264";>YARN-2264</a>. - Major bug reported by Siddharth Seth and fixed by Li Lu <br> - <b>Race in DrainDispatcher can cause random test failures</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2260";>YARN-2260</a>. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)<br> - <b>Add containers to launchedContainers list in RMNode on container recovery</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2252";>YARN-2252</a>. - Major bug reported by Ratandeep Ratti and fixed by (scheduler)<br> - <b>Intermittent failure of TestFairScheduler.testContinuousScheduling</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2251";>YARN-2251</a>. - Major bug reported by Zhijie Shen and fixed by Zhijie Shen <br> - <b>Avoid negative elapsed time in JHS/MRAM web UI and services</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2249";>YARN-2249</a>. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)<br> - <b>AM release request may be lost on RM restart</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2248";>YARN-2248</a>. - Major sub-task reported by Janos Matyas and fixed by Janos Matyas (capacityscheduler)<br> - <b>Capacity Scheduler changes for moving apps between queues</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2244";>YARN-2244</a>. - Critical bug reported by Anubhav Dhoot and fixed by Anubhav Dhoot (fairscheduler)<br> - <b>FairScheduler missing handling of containers for unknown application attempts </b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2242";>YARN-2242</a>. - Major sub-task reported by Li Lu and fixed by Li Lu <br> - <b>Improve exception information on AM launch crashes</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2237";>YARN-2237</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)<br> - <b>MRAppMaster changes for AMRMToken roll-up</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2229";>YARN-2229</a>. - Major sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (resourcemanager)<br> - <b>ContainerId can overflow with RM restart</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2228";>YARN-2228</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen <br> - <b>TimelineServer should load pseudo authentication filter when authentication = simple</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2219";>YARN-2219</a>. - Major bug reported by Ashwin Shankar and fixed by Jian He (resourcemanager)<br> - <b>AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2214";>YARN-2214</a>. - Major improvement reported by Ashwin Shankar and fixed by Ashwin Shankar (scheduler)<br> - <b>FairScheduler: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3239";>YARN-3239</a>. + Major bug reported by Hitesh Shah and fixed by Jian He <br> + <b>WebAppProxy does not support a final tracking url which has query fragments and params </b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2212";>YARN-2212</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)<br> - <b>ApplicationMaster needs to find a way to update the AMRMToken periodically</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3238";>YARN-3238</a>. + Blocker bug reported by Jason Lowe and fixed by Jason Lowe <br> + <b>Connection timeouts to nodemanagers are retried at multiple levels</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2211";>YARN-2211</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)<br> - <b>RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens </b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3231";>YARN-3231</a>. + Critical bug reported by Siqi Li and fixed by Siqi Li <br> + <b>FairScheduler: Changing queueMaxRunningApps interferes with pending jobs</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2209";>YARN-2209</a>. +<li> <a href="https://issues.apache.org/jira/browse/YARN-3230";>YARN-3230</a>. Major improvement reported by Jian He and fixed by Jian He <br> - <b>Replace AM resync/shutdown command with corresponding exceptions</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2208";>YARN-2208</a>. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)<br> - <b>AMRMTokenManager need to have a way to roll over AMRMToken</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2207";>YARN-2207</a>. - Major task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)<br> - <b>Add ability to roll over AMRMToken</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2198";>YARN-2198</a>. - Major improvement reported by Remus Rusanu and fixed by Remus Rusanu <br> - <b>Remove the need to run NodeManager as privileged account for Windows Secure Container Executor</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2197";>YARN-2197</a>. - Minor improvement reported by Akira AJISAKA and fixed by Akira AJISAKA (documentation)<br> - <b>Add a link to YARN CHANGES.txt in the left side of doc</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2182";>YARN-2182</a>. - Major sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA <br> - <b>Update ContainerId#toString() to avoid conflicts before and after RM restart</b><br> + <b>Clarify application states on the web UI</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2181";>YARN-2181</a>. - Major bug reported by Wangda Tan and fixed by Wangda Tan (resourcemanager , webapp)<br> - <b>Add preemption info to RM Web UI and add logs when preemption occurs</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3227";>YARN-3227</a>. + Critical bug reported by Jonathan Eagles and fixed by Zhijie Shen <br> + <b>Timeline renew delegation token fails when RM user's TGT is expired</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2174";>YARN-2174</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen <br> - <b>Enabling HTTPs for the writer REST API of TimelineServer</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3222";>YARN-3222</a>. + Critical bug reported by Rohith Sharma K S and fixed by Rohith Sharma K S (resourcemanager)<br> + <b>RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2161";>YARN-2161</a>. - Major bug reported by Binglin Chang and fixed by Binglin Chang <br> - <b>Fix build on macosx: YARN parts</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3207";>YARN-3207</a>. + Major bug reported by Prakash Ramachandran and fixed by Zhijie Shen (timelineserver)<br> + <b>secondary filter matches entites which do not have the key being filtered for.</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2158";>YARN-2158</a>. - Minor test reported by Ted Yu and fixed by Varun Vasudev <br> - <b>TestRMWebServicesAppsModification sometimes fails in trunk</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2153";>YARN-2153</a>. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)<br> - <b>Ensure distributed shell work with RM work-preserving recovery</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2147";>YARN-2147</a>. - Minor bug reported by Jason Lowe and fixed by Chen He (resourcemanager)<br> - <b>client lacks delegation token exception details when application submit fails</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2138";>YARN-2138</a>. - Major bug reported by Jian He and fixed by Varun Saxena <br> - <b>Cleanup notifyDone* methods in RMStateStore</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2131";>YARN-2131</a>. - Major new feature reported by Karthik Kambatla and fixed by Robert Kanter (resourcemanager)<br> - <b>Add a way to format the RMStateStore</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2102";>YARN-2102</a>. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen <br> - <b>More generalized timeline ACLs</b><br> - <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2088";>YARN-2088</a>. - Major bug reported by Binglin Chang and fixed by Binglin Chang <br> - <b>Fix code bug in GetApplicationsRequestPBImpl#mergeLocalToBuilder</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3124";>YARN-3124</a>. + Major sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)<br> + <b>Capacity Scheduler LeafQueue/ParentQueue should use QueueCapacities to track capacities-by-label</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2080";>YARN-2080</a>. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (resourcemanager)<br> - <b>Admission Control: Integrate Reservation subsystem with ResourceManager</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3103";>YARN-3103</a>. + Blocker bug reported by Jason Lowe and fixed by Jason Lowe (client)<br> + <b>AMRMClientImpl does not update AMRM token properly</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2070";>YARN-2070</a>. - Minor sub-task reported by Zhijie Shen and fixed by Robert Kanter <br> - <b>DistributedShell publishes unfriendly user information to the timeline server</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3099";>YARN-3099</a>. + Major sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)<br> + <b>Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label.</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2045";>YARN-2045</a>. - Major sub-task reported by Junping Du and fixed by Junping Du (nodemanager)<br> - <b>Data persisted in NM should be versioned</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3098";>YARN-3098</a>. + Major sub-task reported by Wangda Tan and fixed by Wangda Tan (capacityscheduler)<br> + <b>Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2035";>YARN-2035</a>. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles <br> - <b>FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3094";>YARN-3094</a>. + Major bug reported by Jun Gong and fixed by Jun Gong (resourcemanager)<br> + <b>reset timer for liveness monitors after RM recovery</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2034";>YARN-2034</a>. - Minor bug reported by Jason Lowe and fixed by Chen He (nodemanager)<br> - <b>Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3092";>YARN-3092</a>. + Major sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)<br> + <b>Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2033";>YARN-2033</a>. - Major sub-task reported by Vinod Kumar Vavilapalli and fixed by Zhijie Shen <br> - <b>Merging generic-history into the Timeline Store</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3055";>YARN-3055</a>. + Blocker bug reported by Yi Liu and fixed by Daryn Sharp (security)<br> + <b>The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewer</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2026";>YARN-2026</a>. - Major bug reported by Ashwin Shankar and fixed by Ashwin Shankar (scheduler)<br> - <b>Fair scheduler: Consider only active queues for computing fairshare</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3024";>YARN-3024</a>. + Major bug reported by Chengbing Liu and fixed by Chengbing Liu (nodemanager)<br> + <b>LocalizerRunner should give DIE action when all resources are localized</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2013";>YARN-2013</a>. - Major sub-task reported by Zhijie Shen and fixed by Tsuyoshi OZAWA (nodemanager)<br> - <b>The diagnostics is always the ExitCodeException stack when the container crashes</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-3011";>YARN-3011</a>. + Major sub-task reported by Wang Hao and fixed by Varun Saxena (nodemanager)<br> + <b>NM dies because of the failure of resource localization</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2010";>YARN-2010</a>. - Blocker bug reported by bc Wong and fixed by Karthik Kambatla (resourcemanager)<br> - <b>Handle app-recovery failures gracefully</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2997";>YARN-2997</a>. + Major bug reported by Chengbing Liu and fixed by Chengbing Liu (nodemanager)<br> + <b>NM keeps sending already-sent completed containers to RM until containers are removed from context</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2008";>YARN-2008</a>. - Major sub-task reported by Chen He and fixed by Craig Welch <br> - <b>CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure </b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2992";>YARN-2992</a>. + Blocker bug reported by Karthik Kambatla and fixed by Karthik Kambatla (resourcemanager)<br> + <b>ZKRMStateStore crashes due to session expiry</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-2001";>YARN-2001</a>. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)<br> - <b>Threshold for RM to accept requests from AM after failover</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2978";>YARN-2978</a>. + Critical bug reported by Jason Tufo and fixed by Varun Saxena <br> + <b>ResourceManager crashes with NPE while getting queue info</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1994";>YARN-1994</a>. - Major improvement reported by Arpit Agarwal and fixed by Craig Welch (nodemanager , resourcemanager , webapp)<br> - <b>Expose YARN/MR endpoints on multiple interfaces</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2964";>YARN-2964</a>. + Blocker bug reported by Daryn Sharp and fixed by Jian He (resourcemanager)<br> + <b>RM prematurely cancels tokens for jobs that submit jobs (oozie)</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1972";>YARN-1972</a>. - Major sub-task reported by Remus Rusanu and fixed by Remus Rusanu (nodemanager)<br> - <b>Implement secure Windows Container Executor</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2952";>YARN-2952</a>. + Major bug reported by Jian He and fixed by Rohith Sharma K S <br> + <b>Incorrect version check in RMStateStore</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1964";>YARN-1964</a>. - Major new feature reported by Arun C Murthy and fixed by Abin Shahab <br> - <b>Create Docker analog of the LinuxContainerExecutor in YARN</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2922";>YARN-2922</a>. + Major bug reported by Jason Tufo and fixed by Rohith Sharma K S (capacityscheduler , resourcemanager , scheduler)<br> + <b>ConcurrentModificationException in CapacityScheduler's LeafQueue</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1959";>YARN-1959</a>. - Major bug reported by Sandy Ryza and fixed by Anubhav Dhoot <br> - <b>Fix headroom calculation in FairScheduler</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2920";>YARN-2920</a>. + Major sub-task reported by Wangda Tan and fixed by Wangda Tan <br> + <b>CapacityScheduler should be notified when labels on nodes changed</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1954";>YARN-1954</a>. - Major improvement reported by Zhijie Shen and fixed by Tsuyoshi OZAWA (client)<br> - <b>Add waitFor to AMRMClient(Async)</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2918";>YARN-2918</a>. + Major sub-task reported by Rohith Sharma K S and fixed by Wangda Tan (resourcemanager)<br> + <b>Don't fail RM if queue's configured labels are not existed in cluster-node-labels</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1922";>YARN-1922</a>. - Major bug reported by Billie Rinaldi and fixed by Billie Rinaldi (nodemanager)<br> - <b>Process group remains alive after container process is killed externally</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2917";>YARN-2917</a>. + Critical bug reported by Rohith Sharma K S and fixed by Rohith Sharma K S (resourcemanager)<br> + <b>Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1919";>YARN-1919</a>. - Minor bug reported by Devaraj K and fixed by Tsuyoshi OZAWA (resourcemanager)<br> - <b>Potential NPE in EmbeddedElectorService#stop</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2910";>YARN-2910</a>. + Major bug reported by Wilfred Spiegelenburg and fixed by Wilfred Spiegelenburg (fairscheduler)<br> + <b>FSLeafQueue can throw ConcurrentModificationException</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1918";>YARN-1918</a>. - Trivial improvement reported by Devaraj K and fixed by Anandha L Ranganathan <br> - <b>Typo in description and error message for 'yarn.resourcemanager.cluster-id'</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2906";>YARN-2906</a>. + Major bug reported by Jason Lowe and fixed by Jason Lowe (capacityscheduler)<br> + <b>CapacitySchedulerPage shows HTML tags for a queue's Active Users</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1915";>YARN-1915</a>. - Blocker sub-task reported by Hitesh Shah and fixed by Jason Lowe <br> - <b>ClientToAMTokenMasterKey should be provided to AM at launch time</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2905";>YARN-2905</a>. + Blocker bug reported by Jason Lowe and fixed by Varun Saxena <br> + <b>AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1879";>YARN-1879</a>. - Critical sub-task reported by Jian He and fixed by Tsuyoshi OZAWA (resourcemanager)<br> - <b>Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2900";>YARN-2900</a>. + Major sub-task reported by Jonathan Eagles and fixed by Mit Desai (timelineserver)<br> + <b>Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1857";>YARN-1857</a>. - Critical sub-task reported by Thomas Graves and fixed by Chen He (capacityscheduler)<br> - <b>CapacityScheduler headroom doesn't account for other AM's running</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2894";>YARN-2894</a>. + Major bug reported by Rohith Sharma K S and fixed by Rohith Sharma K S (resourcemanager)<br> + <b>When ACL's are enabled, if RM switches then application can not be viewed from web.</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1796";>YARN-1796</a>. - Minor bug reported by Aaron T. Myers and fixed by Aaron T. Myers (nodemanager)<br> - <b>container-executor shouldn't require o-r permissions</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2890";>YARN-2890</a>. + Major bug reported by Mit Desai and fixed by Mit Desai <br> + <b>MiniYarnCluster should turn on timeline service if configured to do so</b><br> <blockquote></blockquote></li> -<li> <a href="https://issues.apache.org/jira/browse/YARN-1779";>YARN-1779</a>. - Blocker sub-task reported by Karthik Kambatla and fixed by Jian He (resourcemanager)<br> - <b>Handle AMRMTokens across RM failover</b><br> +<li> <a href="https://issues.apache.org/jira/browse/YARN-2874";>YARN-2874</a>. + Blocker bug reported by Naganarasimha G R and fixed by Naganarasimha G R (resourcemanager)<br> + <b>Dead lock in "Delega
<TRUNCATED>
