For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/8/
[Oct 29, 2017 11:44:16 PM] (yufei) YARN-6747. TestFSAppStarvation.testPreemptionEnable fails [Oct 30, 2017 1:54:33 AM] (templedf) YARN-7374. Improve performance of DRF comparisons for resource types in [Oct 30, 2017 4:49:22 PM] (cdouglas) HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat [Oct 30, 2017 6:04:22 PM] (templedf) YARN-6927. Add support for individual resource types requests in [Oct 30, 2017 7:41:28 PM] (templedf) YARN-7336. Unsafe cast from long to int Resource.hashCode() method [Oct 30, 2017 10:16:51 PM] (junping_du) HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. [Oct 31, 2017 4:49:15 AM] (aajisaka) HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. [Oct 31, 2017 4:50:28 AM] (aajisaka) Revert "HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. [Oct 31, 2017 4:51:26 AM] (aajisaka) HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. [Oct 31, 2017 7:36:02 AM] (aajisaka) YARN-7407. Moving logging APIs over to slf4j in [Oct 31, 2017 8:09:45 AM] (aajisaka) YARN-7379. Moving logging APIs over to slf4j in hadoop-yarn-client. [Oct 31, 2017 2:30:13 PM] (jlowe) HADOOP-14919. BZip2 drops records when reading data in splits. [Oct 31, 2017 2:34:01 PM] (mackrorysd) HDFS-206. Support for head in FSShell. Contributed by Gabor Bota. [Oct 31, 2017 4:44:01 PM] (cdouglas) HDFS-7878. API - expose a unique file identifier. [Oct 31, 2017 5:21:42 PM] (inigoiri) HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo [Oct 31, 2017 5:23:00 PM] (arp) HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode [Oct 31, 2017 5:46:10 PM] (wang) Revert "HDFS-12499. dfs.namenode.shared.edits.dir property is currently [Oct 31, 2017 7:05:43 PM] (subru) YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via [Nov 1, 2017 4:58:14 AM] (lei) HDFS-12482. Provide a configuration to adjust the weight of EC recovery [Nov 1, 2017 5:44:16 AM] (jzhuge) HDFS-12714. Hadoop 3 missing fix for HDFS-5169. Contributed by Joe [Nov 1, 2017 6:37:08 AM] (yqlin) HDFS-12219. Javadoc for FSNamesystem#getMaxObjects is incorrect. [Nov 1, 2017 8:41:45 AM] (wwei) HDFS-12744. More logs when short-circuit read is failed and disabled. [Nov 1, 2017 8:26:37 PM] (inigoiri) YARN-7276 addendum to add timeline service depencies. Contributed by [Nov 1, 2017 9:48:16 PM] (junping_du) YARN-7400. Incorrect log preview displayed in jobhistory server ui. [Nov 1, 2017 10:39:56 PM] (eyang) YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed [Nov 2, 2017 12:00:32 AM] (jianhe) YARN-7396. NPE when accessing container logs due to null dirsHandler. [Nov 2, 2017 8:25:19 AM] (rohithsharmaks) addendum patch for YARN-7289. [Nov 2, 2017 8:43:08 AM] (aajisaka) MAPREDUCE-6983. Moving logging APIs over to slf4j in [Nov 2, 2017 9:12:04 AM] (sammi.chen) HADOOP-14997. Add hadoop-aliyun as dependency of hadoop-cloud-storage. [Nov 2, 2017 9:32:24 AM] (aajisaka) MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by [Nov 2, 2017 2:37:17 PM] (jlowe) YARN-7286. Add support for docker to have no capabilities. Contributed [Nov 2, 2017 4:51:28 PM] (wangda) YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil [Nov 2, 2017 5:37:33 PM] (epayne) YARN-7370: Preemption properties should be refreshable. Contrubted by [Nov 3, 2017 12:15:33 AM] (arun suresh) HADOOP-15013. Fix ResourceEstimator findbugs issues. (asuresh) [Nov 3, 2017 12:39:23 AM] (subru) YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs [Nov 3, 2017 1:55:29 AM] (sunilg) YARN-7410. Cleanup FixedValueResource to avoid dependency to [Nov 3, 2017 4:27:35 AM] (xiao) HDFS-12682. ECAdmin -listPolicies will always show [Nov 3, 2017 4:29:53 AM] (inigoiri) YARN-7434. Router getApps REST invocation fails with multiple RMs. [Nov 3, 2017 4:53:13 AM] (xiao) HDFS-12725. BlockPlacementPolicyRackFaultTolerant fails with very uneven [Nov 3, 2017 6:15:50 AM] (sunilg) YARN-7392. Render cluster information on new YARN web ui. Contributed by [Nov 3, 2017 7:05:45 PM] (xiao) HDFS-11467. Support ErasureCoding section in OIV XML/ReverseXML. [Nov 3, 2017 8:16:46 PM] (kihwal) HDFS-12771. Add genstamp and block size to metasave Corrupt blocks list. [Nov 3, 2017 9:30:57 PM] (cdouglas) HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus. [Nov 3, 2017 11:10:37 PM] (xyao) HADOOP-14987. Improve KMSClientProvider log around delegation token [Nov 4, 2017 3:34:40 AM] (xyao) HDFS-10528. Add logging to successful standby checkpointing. Contributed [Nov 4, 2017 4:01:56 AM] (liuml07) HADOOP-15015. TestConfigurationFieldsBase to use SLF4J for logging. [Nov 6, 2017 7:28:38 AM] (naganarasimha_gr) MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph. [Nov 6, 2017 5:09:10 PM] (bibinchundatt) Add containerId to Localizer failed logs. Contributed by Prabhu Joseph [Nov 6, 2017 9:28:31 PM] (jianhe) YARN-5461. Initial code ported from slider-core module. (jianhe) [Nov 6, 2017 9:28:32 PM] (jianhe) Rename org.apache.slider.core.build to org.apache.slider.core.buildutils [Nov 6, 2017 9:28:32 PM] (jianhe) Modify pom file for slider [Nov 6, 2017 9:28:32 PM] (jianhe) YARN-5513. Move Java only tests from slider develop to [Nov 6, 2017 9:28:32 PM] (jianhe) YARN-5538. Apply SLIDER-875 to yarn-native-services. Contributed by [Nov 6, 2017 9:28:32 PM] (jianhe) YARN-5505. Create an agent-less docker provider in the native-services [Nov 6, 2017 9:28:32 PM] (jianhe) YARN-5623. Apply SLIDER-1166 to yarn-native-services branch. Contributed [Nov 6, 2017 9:28:33 PM] (jianhe) YARN-5610. Initial code for native services REST API. Contributed by [Nov 6, 2017 9:28:33 PM] (jianhe) YARN-5675. Swagger definition for YARN service API. Contributed by Gour [Nov 6, 2017 9:28:33 PM] (jianhe) Addendum patch for YARN-5610. Contributed by Gour Saha [Nov 6, 2017 9:28:33 PM] (jianhe) YARN-5689. Update native services REST API to use agentless docker [Nov 6, 2017 9:28:33 PM] (jianhe) YARN-5729. Bug fixes for the service Rest API. Contributed by Gour Saha [Nov 6, 2017 9:28:33 PM] (jianhe) YARN-5735. Make the service REST API use the app timeout feature [Nov 6, 2017 9:28:33 PM] (jianhe) YARN-5701. Fix issues in yarn native services apps-of-apps. Contributed [Nov 6, 2017 9:28:34 PM] (jianhe) YARN-5778. Add .keep file for yarn native services AM web app. [Nov 6, 2017 9:28:34 PM] (jianhe) YARN-5775. Convert enums in swagger definition to uppercase. Contributed [Nov 6, 2017 9:28:34 PM] (jianhe) YARN-5680. Add 2 new fields in Slider status output - image-name and [Nov 6, 2017 9:28:34 PM] (jianhe) YARN-5770. Performance improvement of native-services REST API service. [Nov 6, 2017 9:28:34 PM] (jianhe) YARN-5690. Integrate native services modules into maven build. [Nov 6, 2017 9:28:34 PM] (jianhe) YARN-5796. Convert enums values in service code to upper case and [Nov 6, 2017 9:28:35 PM] (jianhe) YARN-5813. Slider should not try to set a negative lifetime timeout [Nov 6, 2017 9:28:35 PM] (jianhe) YARN-5812. Exception during GET call - "Failed to retrieve application: [Nov 6, 2017 9:28:35 PM] (jianhe) YARN-5828. Native services client errors out when config formats are [Nov 6, 2017 9:28:35 PM] (jianhe) YARN-5808. Add gc log options to the yarn daemon script when starting [Nov 6, 2017 9:28:36 PM] (jianhe) YARN-5909. Remove agent related code in slider AM. Contributed by Jian [Nov 6, 2017 9:28:36 PM] (jianhe) YARN-5883 Avoid or eliminate expensive YARN get all applications call. [Nov 6, 2017 9:28:36 PM] (jianhe) YARN-5943. Write native services container stderr file to log directory. [Nov 6, 2017 9:28:37 PM] (jianhe) YARN-5941. Slider handles "per.component" for multiple components [Nov 6, 2017 9:28:37 PM] (jianhe) YARN-5769. Integrate update app lifetime using feature implemented in [Nov 6, 2017 9:28:37 PM] (jianhe) YARN-5944. Native services AM should remain up if RM is down. [Nov 6, 2017 9:28:37 PM] (jianhe) YARN-5958. Fix ASF license warnings for slider core module. Contributed [Nov 6, 2017 9:28:37 PM] (jianhe) YARN-5961. Generate native services protobuf classes during build. [Nov 6, 2017 9:28:37 PM] (jianhe) YARN-5975. Remove the agent - slider AM ssl related code. Contributed by [Nov 6, 2017 9:28:37 PM] (jianhe) YARN-5740. Add a new field in Slider status output - lifetime [Nov 6, 2017 9:28:38 PM] (jianhe) YARN-5996. Native services AM kills app on AMRMClientAsync onError call. [Nov 6, 2017 9:28:38 PM] (jianhe) YARN-5967. Fix slider core module findbugs warnings. Contributed by Jian [Nov 6, 2017 9:28:38 PM] (jianhe) YARN-5968. Fix slider core module javadocs. Contributed by Billie [Nov 6, 2017 9:28:38 PM] (jianhe) YARN-6010. Fix findbugs, site warnings in yarn-services-api module. [Nov 6, 2017 9:28:39 PM] (jianhe) YARN-6014. Followup fix for slider core module findbugs. Contributed by [Nov 6, 2017 9:28:39 PM] (jianhe) YARN-5218. Initial core change for DNS for YARN. Contributed by Jonathan [Nov 6, 2017 9:28:39 PM] (jianhe) YARN-4757. Add the ability to split reverse zone subnets. Contributed by [Nov 6, 2017 9:28:39 PM] (jianhe) YARN-5993. Allow native services quicklinks to be exported for each [Nov 6, 2017 9:28:40 PM] (jianhe) YARN-6115. Few additional paths in Slider client still uses get all [Nov 6, 2017 9:28:40 PM] (jianhe) YARN-6132. SliderClient bondToCluster should call findInstance with live [Nov 6, 2017 9:28:40 PM] (jianhe) Updated pom to point to 3.0.0-alpha3-SNAPSHOT [Nov 6, 2017 9:28:40 PM] (jianhe) YARN-6173. Add artifact info and privileged container details to the [Nov 6, 2017 9:28:40 PM] (jianhe) YARN-6186 Handle InvalidResourceRequestException in native services AM [Nov 6, 2017 9:28:40 PM] (jianhe) YARN-6185. Apply SLIDER-1199 to yarn native services for blacklisting [Nov 6, 2017 9:28:40 PM] (jianhe) YARN-6205. Default lifetime for native services app is invalid. [Nov 6, 2017 9:28:41 PM] (jianhe) YARN-6192. Move yarn-native-service API records into [Nov 6, 2017 9:28:41 PM] (jianhe) YARN-6255. Refactor yarn-native-services framework. Contributed by Jian [Nov 6, 2017 9:28:41 PM] (jianhe) YARN-6395. Integrate service app master to write data into ATSv2. [Nov 6, 2017 9:28:41 PM] (jianhe) YARN-6400. Remove some unneeded code after YARN-6255. Contributed by [Nov 6, 2017 9:28:41 PM] (jianhe) Rebase to latest trunk, fix conflicts and pom.xml [Nov 6, 2017 9:28:42 PM] (jianhe) YARN-6335. Port slider's groovy unit tests to yarn native services. [Nov 6, 2017 9:28:42 PM] (jianhe) YARN-6405. Improve configuring services through REST API. Contributed by [Nov 6, 2017 9:30:06 PM] (jianhe) YARN-6419. Support to launch new native-service from new YARN UI. [Nov 6, 2017 9:30:07 PM] (jianhe) YARN-6446. Revisit ATSv2 integration to ensure all required information [Nov 6, 2017 9:30:07 PM] (jianhe) YARN-6446. addendum patch. Contributed by Rohith Sharma K S. [Nov 6, 2017 9:30:07 PM] (jianhe) YARN-6398. Support to add native-service specific details in new YARN [Nov 6, 2017 9:30:07 PM] (jianhe) YARN-6545. Followup fix for YARN-6405. Contributed by Jian He [Nov 6, 2017 9:30:08 PM] (jianhe) YARN-6533. Race condition in writing service record to registry in yarn [Nov 6, 2017 9:30:08 PM] (jianhe) YARN-6588. Add native-service AM log4j properties in classpath. [Nov 6, 2017 9:30:08 PM] (jianhe) YARN-6544. Add Null check RegistryDNS service while parsing registry [Nov 6, 2017 9:30:08 PM] (jianhe) YARN-6160. Create an agent-less docker-less provider in the native [Nov 6, 2017 9:30:08 PM] (jianhe) YARN-6613. Update json validation for new native services providers. [Nov 6, 2017 9:30:09 PM] (jianhe) YARN-6617. Services API delete call first attempt usually fails. [Nov 6, 2017 9:30:09 PM] (jianhe) YARN-6722. Bumping up pom file hadoop version. Contributed by Panagiotis [Nov 6, 2017 9:30:09 PM] (jianhe) YARN-6716. Native services support for specifying component start order. [Nov 6, 2017 9:30:09 PM] (jianhe) YARN-6655. Validate yarn native services application submission side to [Nov 6, 2017 9:30:10 PM] (jianhe) YARN-6655. Fix compilation failure in TestServiceApiUtil due to changes [Nov 6, 2017 9:30:10 PM] (jianhe) YARN-6804. [yarn-native-services changes] Allow custom hostname for [Nov 6, 2017 9:30:10 PM] (jianhe) Update pom version to 3.0.0-beta1-SNAPSHOT [Nov 6, 2017 9:30:11 PM] (jianhe) YARN-6903. Yarn-native-service framework core rewrite. Contributed by [Nov 6, 2017 9:30:11 PM] (jianhe) YARN-7029. Add more UTs in yarn-native-services. Contributed by Jian He [Nov 6, 2017 9:30:12 PM] (jianhe) YARN-7050. Post cleanup after YARN-6903, removal of org.apache.slider [Nov 6, 2017 9:30:12 PM] (jianhe) YARN-5244. Documentation required for DNS Server implementation. [Nov 6, 2017 9:30:13 PM] (jianhe) YARN-7091. Rename application to service in yarn-native-services. [Nov 6, 2017 9:30:13 PM] (jianhe) YARN-7113. Clean up packaging and dependencies for yarn-native-services. [Nov 6, 2017 9:30:13 PM] (jianhe) YARN-7100. Added JsonIgnore annotation to Resource#getMemoryMB. [Nov 6, 2017 9:30:13 PM] (jianhe) Rebase onto latest trunk. minor conflicts [Nov 6, 2017 9:30:14 PM] (jianhe) YARN-7073. Yarn native services rest API documentation. Contributed by [Nov 6, 2017 9:30:14 PM] (jianhe) YARN-7126. Create introductory site documentation for YARN native [Nov 6, 2017 9:30:14 PM] (jianhe) Rebase onto trunk - fix some issues. Contributed by Rohith Sharma K S [Nov 6, 2017 9:30:15 PM] (jianhe) YARN-7161. Fix special chars in DNS documentation. Contributed by Gour [Nov 6, 2017 9:30:15 PM] (jianhe) YARN-7165. Miscellaneous fixes in yarn-native-services. Contributed by [Nov 6, 2017 9:30:15 PM] (jianhe) Rebased onto trunk - fix conflicts [Nov 6, 2017 9:30:16 PM] (jianhe) YARN-7186. Add examples in yarn-service. Contributed by Jian He [Nov 6, 2017 9:30:16 PM] (jianhe) YARN-7210. Some NPE fixes in Registry DNS. Contributed by Jian He [Nov 6, 2017 9:30:16 PM] (jianhe) YARN-7201. Added an apache httpd example YARN service. Contributed by [Nov 6, 2017 9:30:17 PM] (jianhe) YARN-7191. Improve yarn-service documentation. Contributed by Jian He [Nov 6, 2017 9:30:17 PM] (jianhe) YARN-6626. Embed REST API service into RM. Contributed by Eric Yang [Nov 6, 2017 9:30:17 PM] (jianhe) Revert "YARN-6626. Embed REST API service into RM. Contributed by Eric [Nov 6, 2017 9:30:17 PM] (jianhe) YARN-6626. Embed REST API service into RM. Contributed by Eric Yang [Nov 6, 2017 9:30:18 PM] (jianhe) YARN-6744. Recover component information on YARN native services AM [Nov 6, 2017 9:30:18 PM] (jianhe) YARN-7202. Add UT for api-server. Contributed by Eric Yang [Nov 6, 2017 9:30:18 PM] (jianhe) YARN-7198. Add jsvc support for RegistryDNS. Contributed by Billie [Nov 6, 2017 9:30:18 PM] (jianhe) Rebase to trunk [Nov 6, 2017 9:30:18 PM] (jianhe) YARN-7323. Data structure update in service REST API. Contributed by [Nov 6, 2017 9:30:19 PM] (jianhe) YARN-7326. Add recursion support and configure RegistryDNS to lookup [Nov 6, 2017 9:30:19 PM] (jianhe) YARN-7351. Fix high CPU usage issue in RegistryDNS. Contributed by Jian [Nov 6, 2017 9:30:19 PM] (jianhe) YARN-7393. RegistryDNS doesn't work in tcp channel. Contributed by Eric [Nov 6, 2017 9:30:19 PM] (jianhe) YARN-7384. Remove apiserver cmd and merge service cmd into application [Nov 6, 2017 9:30:20 PM] (jianhe) YARN-7331. Change in few metrics in new YARN UI related to [Nov 6, 2017 9:30:20 PM] (jianhe) YARN-6394. Support specifying YARN related params in the service REST [Nov 6, 2017 9:30:20 PM] (jianhe) YARN-7423. Improve service client loggings. Contributed by Jian He [Nov 6, 2017 9:30:20 PM] (jianhe) YARN-7371. Added allocateRequestId in NMContainerStatus for recovery. [Nov 6, 2017 11:45:37 PM] (haibochen) YARN-7360. TestRM.testNMTokenSentForNormalContainer() should be [Nov 7, 2017 5:38:24 AM] (wangda) YARN-7394. Merge code paths for Reservation/Plan queues and Auto Created [Nov 7, 2017 10:53:48 PM] (templedf) YARN-7401. Reduce lock contention in [Nov 8, 2017 12:39:04 AM] (wang) HADOOP-15018. Update JAVA_HOME in create-release for Xenial Dockerfile. [Nov 8, 2017 2:22:13 AM] (wwei) HDFS-7060. Avoid taking locks when sending heartbeats from the DataNode. [Nov 8, 2017 9:11:16 AM] (brahma) HDFS-12788. Reset the upload button when file upload fails. Contributed [Nov 8, 2017 10:21:43 AM] (aajisaka) MAPREDUCE-6997. Moving logging APIs over to slf4j in [Nov 8, 2017 10:28:08 AM] (aajisaka) MAPREDUCE-7001. Moving logging APIs over to slf4j in [Nov 8, 2017 4:00:53 PM] (arun suresh) YARN-7453. Fix issue where RM fails to switch to active after first [Nov 8, 2017 4:14:02 PM] (arun suresh) YARN-7343. Add a junit test for ContainerScheduler recovery. (Sampada [Nov 9, 2017 12:43:49 AM] (templedf) YARN-7166. Container REST endpoints should report resource types [Nov 9, 2017 1:31:14 AM] (templedf) YARN-7458. TestContainerManagerSecurity is still flakey (Contributed by [Nov 9, 2017 2:07:12 AM] (subru) HADOOP-15025. Ensure singleton for ResourceEstimatorService. (Rui Li via [Nov 9, 2017 6:14:46 AM] (aajisaka) HDFS-12732. Correct spellings of ramdomly to randomly in log. [Nov 9, 2017 3:31:19 PM] (bibinchundatt) YARN-7454. RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to [Nov 9, 2017 6:16:12 PM] (jzhuge) HADOOP-15012. Add readahead, dropbehind, and unbuffer to [Nov 9, 2017 6:16:12 PM] (jzhuge) HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed [Nov 9, 2017 6:49:50 PM] (haibochen) YARN-7388. TestAMRestart should be scheduler agnostic. [Nov 9, 2017 7:58:49 PM] (templedf) YARN-7143. FileNotFound handling in ResourceUtils is inconsistent [Nov 9, 2017 8:09:48 PM] (templedf) YARN-7413. Support resource type in SLS (Contributed by Yufei Gu via [Nov 9, 2017 8:12:52 PM] (rkanter) YARN-7386. Duplicate Strings in various places in Yarn memory [Nov 9, 2017 9:01:24 PM] (kkaranasos) YARN-7437. Rename PlacementSet and SchedulingPlacementSet. (Wangda Tan [Nov 9, 2017 9:47:43 PM] (mackrorysd) YARN-7465. start-yarn.sh fails to start ResourceManagers unless running [Nov 9, 2017 10:51:15 PM] (wangda) YARN-6909. Use LightWeightedResource when number of resource types more [Nov 9, 2017 11:15:51 PM] (arun suresh) Fixing Job History Server Configuration parsing. (Jason Lowe via [Nov 10, 2017 2:47:34 AM] (cliang) HDFS-12791. NameNode Fsck http Connection can timeout for directories [Nov 10, 2017 5:06:06 AM] (xiao) HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by [Nov 10, 2017 7:53:17 AM] (jitendra) HDFS-12797. Add Test for NFS mount of not supported filesystems like [Nov 11, 2017 12:28:12 AM] (arp) HADOOP-14929. Cleanup usage of decodecomponent and use [Nov 11, 2017 12:30:38 AM] (arp) HDFS-12498. Journal Syncer is not started in Federated + HA cluster. [Nov 11, 2017 1:41:29 AM] (cdouglas) HADOOP-8522. ResetableGzipOutputStream creates invalid gzip files when [Nov 11, 2017 5:06:27 AM] (bibinchundatt) YARN-7406. Moving logging APIs over to slf4j in hadoop-yarn-api. [Nov 11, 2017 11:22:31 AM] (sunilg) YARN-7452. Decommissioning node default value to be zero in new YARN UI. [Nov 12, 2017 5:53:39 PM] (subu) YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru). [Nov 13, 2017 2:11:49 PM] (sunilg) YARN-7445. Render Applications and Services page with filters in new [Nov 13, 2017 2:12:23 PM] (aajisaka) HADOOP-15031. Fix javadoc issues in Hadoop Common. Contributed by Mukul [Nov 13, 2017 5:40:45 PM] (eyang) HADOOP-15008. Fixed period unit calculation for Hadoop Metrics V2. [Nov 13, 2017 5:42:43 PM] (eyang) HADOOP-15008. Fixed period unit calculation for Hadoop Metrics V2. [Nov 13, 2017 6:59:58 PM] (eyang) YARN-7447. Fixed bug in create YARN services via RM. (Contributed by [Nov 13, 2017 7:03:30 PM] (templedf) YARN-7442. [YARN-7069] Limit format of resource type name (Contributed [Nov 13, 2017 7:05:07 PM] (templedf) YARN-7369. Improve the resource types docs [Nov 13, 2017 7:30:39 PM] (arp) HDFS-12705. WebHdfsFileSystem exceptions should retain the caused by [Nov 13, 2017 10:03:50 PM] (arun suresh) Addendum patch for Configuration fix. (Jason Lowe via asuresh) [Nov 13, 2017 10:37:36 PM] (arun suresh) HADOOP-15036. Update LICENSE.txt for HADOOP-14840. (asuresh) [Nov 13, 2017 11:27:37 PM] (junping_du) YARN-6078. Containers stuck in Localizing state. Contributed by Billie [Nov 13, 2017 11:37:39 PM] (jianhe) YARN-7466. ResourceRequest has a different default for [Nov 14, 2017 2:49:22 AM] (wang) HADOOP-15037. Add site release notes for OrgQueue and resource types. [Nov 14, 2017 2:57:56 AM] (jianhe) YARN-7488. Make ServiceClient.getAppId method public to return [Nov 14, 2017 9:58:37 AM] (kai.zheng) HADOOP-14993. AliyunOSS: Override listFiles and listLocatedStatus. [Nov 15, 2017 6:31:29 AM] (sunilg) YARN-7462. Render outstanding resource requests on application page of [Nov 15, 2017 8:32:53 AM] (sunilg) YARN-7464. Introduce filters in Nodes page of new YARN UI. Contributed [Nov 15, 2017 6:03:29 PM] (templedf) HADOOP-14876. Create downstream developer docs from the compatibility [Nov 15, 2017 6:03:29 PM] (templedf) YARN-6953. Clean up [Nov 15, 2017 6:03:29 PM] (templedf) YARN-7414. FairScheduler#getAppWeight() should be moved into [Nov 15, 2017 6:32:02 PM] (jlowe) YARN-7361. Improve the docker container runtime documentation. [Nov 16, 2017 12:44:06 AM] (xiao) HADOOP-15023. ValueQueue should also validate (int) (lowWatermark * [Nov 16, 2017 3:20:37 AM] (cdouglas) Revert "HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus." [Nov 16, 2017 8:14:21 AM] (sunilg) YARN-7492. Set up SASS for new YARN UI styling. Contributed by Vasudevan [Nov 16, 2017 8:19:53 AM] (wwei) HDFS-12814. Add blockId when warning slow mirror/disk in BlockReceiver. [Nov 16, 2017 3:58:06 PM] (billie) YARN-7486. Race condition in service AM that can cause NPE. Contributed [Nov 16, 2017 5:04:23 PM] (sunilg) YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if [Nov 16, 2017 6:48:24 PM] (haibochen) YARN-7390. All reservation related test cases failed when TestYarnClient [Nov 16, 2017 6:53:55 PM] (jianhe) YARN-7503. Configurable heap size / JVM opts in service AM. Contributed [Nov 16, 2017 7:11:19 PM] (rkanter) HADOOP-14982. Clients using FailoverOnNetworkExceptionRetry can go into [Nov 16, 2017 7:25:52 PM] (wangda) YARN-7419. CapacityScheduler: Allow auto leaf queue creation after queue [Nov 17, 2017 12:58:47 AM] (inigoiri) HDFS-12801. RBF: Set MountTableResolver as default file resolver. [Nov 17, 2017 6:34:47 AM] (vvasudev) YARN-7430. Enable user re-mapping for Docker containers by default. [Nov 17, 2017 5:28:12 PM] (eyang) YARN-7218. Decouple YARN Services REST API namespace from RM. [Nov 18, 2017 1:39:06 AM] (subru) YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru). [Nov 18, 2017 1:32:11 PM] (bibinchundatt) YARN-7525. Incorrect query parameters in cluster nodes REST API [Nov 18, 2017 1:55:29 PM] (bibinchundatt) YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. [Nov 19, 2017 8:39:37 PM] (aw) HADOOP-13514. Upgrade maven surefire plugin to 2.20.1 [Nov 20, 2017 3:37:04 PM] (billie) YARN-7529. TestYarnNativeServices#testRecoverComponentsAfterRMRestart() [Nov 20, 2017 6:28:12 PM] (manojpec) HDFS-12730. Verify open files captured in the snapshots across config [Nov 20, 2017 6:56:42 PM] (stevel) HADOOP-15024 Support user agent configuration and include that & Hadoop [Nov 20, 2017 7:48:15 PM] (wangda) YARN-7527. Over-allocate node resource in async-scheduling mode of [Nov 20, 2017 8:49:53 PM] (cliang) HDFS-12804. Use slf4j instead of log4j in FSEditLog. Contributed by [Nov 21, 2017 1:09:19 AM] (szetszwo) HDFS-12813. RequestHedgingProxyProvider can hide Exception thrown from [Nov 21, 2017 4:07:42 PM] (aajisaka) HADOOP-15046. Document Apache Hadoop does not support Java 9 in [Nov 21, 2017 5:09:16 PM] (haibochen) YARN-7531. ResourceRequest.equal does not check [Nov 21, 2017 6:33:34 PM] (yufei) YARN-7513. Remove the scheduler lock in FSAppAttempt.getWeight() [Nov 22, 2017 4:42:28 AM] (cdouglas) MAPREDUCE-7011. [Nov 22, 2017 3:28:12 PM] (stevel) HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints. [Nov 22, 2017 6:05:34 PM] (eyang) YARN-5534. Allow user provided Docker volume mount list. (Contributed [Nov 22, 2017 6:22:32 PM] (lei) HDFS-12847. Regenerate editsStored and editsStored.xml in HDFS tests. [Nov 22, 2017 7:01:55 PM] (kihwal) HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu [Nov 22, 2017 10:18:36 PM] (yufei) YARN-7524. Remove unused FairSchedulerEventLog. (Contributed by Wilfred [Nov 23, 2017 2:24:20 AM] (sunilg) YARN-7330. Add support to show GPU in UI including metrics. Contributed [Nov 23, 2017 3:18:30 AM] (arun suresh) YARN-6483. Add nodes transitioning to DECOMMISSIONING state to the list [Nov 23, 2017 5:01:28 PM] (xiao) HADOOP-15067. GC time percentage reported in JvmMetrics should be a [Nov 24, 2017 3:59:03 AM] (wangda) YARN-7509. AsyncScheduleThread and ResourceCommitterService are still [Nov 25, 2017 7:32:46 AM] (yufei) YARN-7290. Method canContainerBePreempted can return true when it [Nov 27, 2017 4:31:00 PM] (rohithsharmaks) MAPREDUCE-7014. Fix java doc errors in jdk1.8. Contributed by Steve [Nov 27, 2017 6:19:58 PM] (jianhe) YARN-6168. Restarted RM may not inform AM about all existing containers. [Nov 27, 2017 10:31:52 PM] (yufei) YARN-7363. ContainerLocalizer don't have a valid log4j config in case of [Nov 28, 2017 3:48:55 AM] (yqlin) HDFS-12858. Add router admin commands usage in HDFS commands reference [Nov 28, 2017 11:52:59 AM] (stevel) HADOOP-15042. Azure PageBlobInputStream.skip() can return negative value [Nov 28, 2017 1:07:11 PM] (sunilg) YARN-7499. Layout changes to Application details page in new YARN UI. [Nov 28, 2017 5:11:52 PM] (sunilg) YARN-7480. Render tooltips on columns where text is clipped in new YARN [Nov 28, 2017 5:15:44 PM] (jlowe) YARN-6647. RM can crash during transitionToStandby due to [Nov 28, 2017 6:27:03 PM] (surendralilhore) HDFS-12857. StoragePolicyAdmin should support schema based path. [Nov 29, 2017 1:14:23 AM] (shv) HDFS-12832. INode.getFullPathName may throw [Nov 29, 2017 4:54:49 PM] (weichiu) HADOOP-15054. upgrade hadoop dependency on commons-codec to 1.11. [Nov 29, 2017 5:43:03 PM] (weiy) HDFS-12835. Fix the javadoc errors in Router-based federation. [Nov 29, 2017 7:11:36 PM] (templedf) YARN-7541. Node updates don't update the maximum cluster capability for [Nov 29, 2017 9:11:14 PM] (kihwal) HDFS-11754. Make FsServerDefaults cache configurable. Contributed by [Nov 29, 2017 10:38:07 PM] (weiy) YARN-6851. Capacity Scheduler: document configs for controlling # [Nov 30, 2017 1:46:16 AM] (wangda) YARN-7573. Gpu Information page could be empty for nodes without GPU. [Nov 30, 2017 4:28:06 AM] (cdouglas) HDFS-12681. Make HdfsLocatedFileStatus a subtype of LocatedFileStatus [Nov 30, 2017 3:39:15 PM] (rkanter) HADOOP-13493. Compatibility Docs should clarify the policy for what [Nov 30, 2017 6:39:18 PM] (jlowe) YARN-7495. Improve robustness of the AggregatedLogDeletionService. [Nov 30, 2017 8:18:29 PM] (szetszwo) HDFS-12594. snapshotDiff fails if the report exceeds the RPC response [Nov 30, 2017 9:47:47 PM] (junping_du) YARN-7558. yarn logs command fails to get logs for running containers if [Nov 30, 2017 11:13:16 PM] (cdouglas) HDFS-12877. Add open(PathHandle) with default buffersize [Nov 30, 2017 11:57:22 PM] (wangda) YARN-6124. Make SchedulingEditPolicy can be enabled / disabled / updated [Dec 1, 2017 2:18:28 AM] (shv) HDFS-12638. Delete copy-on-truncate block along with the original block, [Dec 1, 2017 7:56:01 AM] (sunilg) YARN-7546. Layout changes in Queue UI to show queue details on right [Dec 1, 2017 8:06:28 AM] (sunilg) YARN-7487. Ensure volume to include GPU base libraries after created by [Dec 1, 2017 6:29:30 PM] (cdouglas) HDFS-11576. Block recovery will fail indefinitely if recovery time > [Dec 1, 2017 6:50:49 PM] (wangda) YARN-6507. Add support in NodeManager to isolate FPGA devices with [Dec 1, 2017 7:19:38 PM] (cdouglas) Revert "HDFS-11576. Block recovery will fail indefinitely if recovery [Dec 1, 2017 8:01:21 PM] (weichiu) HDFS-12836. startTxId could be greater than endTxId when tailing [Dec 1, 2017 8:04:25 PM] (jlowe) MAPREDUCE-5124. AM lacks flow control for task events. Contributed by [Dec 1, 2017 8:12:15 PM] (rkanter) MAPREDUCE-6994. Uploader tool for Distributed Cache Deploy code changes [Dec 1, 2017 8:18:13 PM] (rkanter) YARN-4813. TestRMWebServicesDelegationTokenAuthentication.testDoAs fails [Dec 1, 2017 9:37:36 PM] (jlowe) YARN-7589. TestPBImplRecords fails with NullPointerException. [Dec 1, 2017 9:47:01 PM] (jlowe) YARN-7455. quote_and_append_arg can overflow buffer. Contributed by Jim [Dec 2, 2017 6:12:26 AM] (cdouglas) HADOOP-14600. LocatedFileStatus constructor forces RawLocalFS to exec a [Dec 2, 2017 6:34:30 AM] (cdouglas) HDFS-11576. Block recovery will fail indefinitely if recovery time > [Dec 4, 2017 5:15:07 AM] (sunilg) YARN-7594. TestNMWebServices#testGetNMResourceInfo fails on trunk. [Dec 4, 2017 5:57:23 AM] (sunilg) YARN-6907. Node information page in the old web UI should report [Dec 4, 2017 6:22:01 AM] (arun suresh) YARN-7587. Skip dispatching opportunistic containers to nodes whose [Dec 4, 2017 6:40:11 PM] (xiao) HDFS-12396. Webhdfs file system should get delegation token from kms [Dec 4, 2017 8:11:00 PM] (eyang) YARN-6669. Implemented Kerberos security for YARN service framework. [Dec 4, 2017 9:14:55 PM] (rkanter) YARN-5594. Handle old RMDelegationToken format when recovering RM [Dec 4, 2017 10:39:43 PM] (mackrorysd) HADOOP-15058. create-release site build outputs dummy shaded jars due to [Dec 5, 2017 5:02:04 AM] (arp) HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts. [Dec 5, 2017 5:30:46 AM] (aajisaka) HADOOP-14985. Remove subversion related code from VersionInfoMojo.java. [Dec 5, 2017 12:58:31 PM] (sunilg) YARN-7586. Application Placement should be done before ACL checks in [Dec 5, 2017 2:11:07 PM] (sunilg) YARN-7092. Render application specific log under application tab in new [Dec 5, 2017 2:23:46 PM] (brahma) HDFS-11751. DFSZKFailoverController daemon exits with wrong status code. [Dec 5, 2017 3:05:41 PM] (stevel) HADOOP-15071 S3a troubleshooting docs to add a couple more failure [Dec 5, 2017 5:20:07 PM] (sunilg) YARN-7438. Additional changes to make SchedulingPlacementSet agnostic to [Dec 5, 2017 7:06:32 PM] (fabbri) HADOOP-14475 Metrics of S3A don't print out when enabled. Contributed by [Dec 5, 2017 9:09:49 PM] (wangda) YARN-7381. Enable the configuration: [Dec 6, 2017 2:40:33 AM] (aajisaka) HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat [Dec 6, 2017 4:01:36 AM] (zhengkai.zk) HADOOP-15039. Move SemaphoredDelegatingExecutor to hadoop-common. [Dec 6, 2017 4:21:52 AM] (wwei) YARN-7611. Node manager web UI should display container type in [Dec 6, 2017 4:48:16 AM] (xiao) HDFS-12872. EC Checksum broken when BlockAccessToken is enabled. [Dec 6, 2017 9:52:41 AM] (wwei) YARN-7610. Extend Distributed Shell to support launching job with [Dec 7, 2017 4:23:37 AM] (aajisaka) HDFS-12889. Addendum patch to add missing file. [Dec 7, 2017 7:21:25 AM] (aajisaka) MAPREDUCE-6998. Moving logging APIs over to slf4j in [Dec 7, 2017 7:27:08 AM] (aajisaka) MAPREDUCE-7000. Moving logging APIs over to slf4j in [Dec 7, 2017 9:29:40 AM] (wwei) YARN-7607. Remove the trailing duplicated timestamp in container [Dec 7, 2017 2:46:11 PM] (sammi.chen) HADOOP-15080. Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove [Dec 7, 2017 7:15:40 PM] (lei) HDFS-12840. Creating a file with non-default EC policy in a EC zone is [Dec 7, 2017 7:30:58 PM] (mackrorysd) HADOOP-15098. TestClusterTopology#testChooseRandom fails intermittently. [Dec 7, 2017 10:50:30 PM] (weichiu) HDFS-11915. Sync rbw dir on the first hsync() to avoid file lost on [Dec 8, 2017 2:56:54 AM] (wangda) YARN-6471. Support to add min/max resource configuration for a queue. [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7254. UI and metrics changes related to absolute resource [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7332. Compute effectiveCapacity per each resource vector. (Sunil G [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7411. Inter-Queue preemption's computeFixpointAllocation need to [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7482. Max applications calculation per queue has to be retrospected [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7483. CapacityScheduler test cases cleanup post YARN-5881. (Sunil G [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7538. Fix performance regression introduced by Capacity Scheduler [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7544. Use queue-path.capacity/maximum-capacity to specify absolute [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7564. Cleanup to fix checkstyle issues of YARN-5881 branch. [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7575. NPE in scheduler UI when max-capacity is not configured. [Dec 8, 2017 2:56:54 AM] (wangda) YARN-7533. Documentation for absolute resource support in Capacity [Dec 8, 2017 5:05:55 AM] (xiao) HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. [Dec 8, 2017 3:03:54 PM] (zhengkai.zk) HADOOP-15104. AliyunOSS: change the default value of max error retry. [Dec 8, 2017 4:00:21 PM] (vinodkv) HADOOP-15059. Undoing the switch of Credentials to PB format as default [Dec 8, 2017 7:46:30 PM] (manojpec) HDFS-12825. Fsck report shows config key name for min replication issues [Dec 8, 2017 11:07:56 PM] (wangda) YARN-7274. Ability to disable elasticity at leaf queue level. (Zian Chen [Dec 8, 2017 11:10:16 PM] (wangda) YARN-7473. Implement Framework and policy for capacity management of [Dec 8, 2017 11:10:47 PM] (wangda) YARN-7420. YARN UI changes to depict auto created queues. (Suma [Dec 8, 2017 11:11:28 PM] (wangda) YARN-7520. Queue Ordering policy changes for ordering auto created leaf [Dec 8, 2017 11:17:02 PM] (wangda) YARN-7591. NPE in async-scheduling mode of CapacityScheduler. (Tao Yang [Dec 8, 2017 11:18:22 PM] (wangda) YARN-7443. Add native FPGA module support to do isolation with cgroups. [Dec 8, 2017 11:39:18 PM] (subru) YARN-6704. Add support for work preserving NM restart when [Dec 11, 2017 2:31:46 AM] (wwei) YARN-7608. Incorrect sTarget column causing DataTable warning on RM [Dec 11, 2017 1:50:02 PM] (sunilg) YARN-7632. Effective min and max resource need to be set for auto [Dec 11, 2017 6:58:02 PM] (surendralilhore) HDFS-12833. Distcp : Update the usage of delete option for dependency [Dec 11, 2017 10:00:42 PM] (rkanter) MAPREDUCE-7018. Apply erasure coding properly to framework tarball and [Dec 11, 2017 11:14:57 PM] (inigoiri) HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin [Dec 12, 2017 12:43:03 AM] (weichiu) HDFS-12891. Do not invalidate blocks if toInvalidate is empty. [Dec 12, 2017 4:14:15 AM] (cdouglas) HDFS-12882. Support full open(PathHandle) contract in HDFS [Dec 12, 2017 9:38:18 AM] (sunilg) YARN-7635. TestRMWebServicesSchedulerActivities fails in trunk. [Dec 12, 2017 9:50:59 AM] (sunilg) Queue ACL validations should validate parent queue ACLs before [Dec 12, 2017 6:56:26 PM] (jlowe) YARN-7625. Expose NM node/containers resource utilization in JVM [Dec 12, 2017 9:35:56 PM] (jianhe) YARN-7565. Yarn service pre-maturely releases the container after AM [Dec 12, 2017 10:04:15 PM] (jlowe) YARN-7595. Container launching code suppresses close exceptions after [Dec 13, 2017 5:11:41 AM] (wwei) YARN-7647. NM print inappropriate error log when node-labels is enabled. [Dec 13, 2017 10:21:49 AM] (sunilg) YARN-7641. Allow searchable filter for Application page log viewer in [Dec 13, 2017 11:16:12 AM] (sunilg) YARN-7536. em-table improvement for better filtering in new YARN UI. [Dec 13, 2017 4:30:07 PM] (sunilg) YARN-7383. Node resource is not parsed correctly for resource names [Dec 13, 2017 5:19:58 PM] (sunilg) YARN-7643. Handle recovery of applications in case of auto-created leaf [Dec 13, 2017 9:05:32 PM] (wang) Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release. [Dec 13, 2017 10:56:14 PM] (cliang) HADOOP-14914. Change to a safely casting long to int. Contributed by [Dec 14, 2017 12:29:04 AM] (eyang) YARN-7540. Route YARN service CLI function through YARN Service API. [Dec 14, 2017 3:05:11 AM] (zhengkai.zk) Revert "HADOOP-15039. Move SemaphoredDelegatingExecutor to [Dec 14, 2017 3:14:52 AM] (zhengkai.zk) HADOOP-15039. Move SemaphoredDelegatingExecutor to hadoop-common. [Dec 14, 2017 8:00:53 AM] (yqlin) HDFS-12883. RBF: Document Router and State Store metrics. Contributed by [Dec 14, 2017 10:41:57 AM] (sunilg) YARN-7119. Support multiple resource types in rmadmin updateNodeResource [Dec 14, 2017 3:45:44 PM] (jlowe) HDFS-12881. Output streams closed with IOUtils suppressing write errors. [Dec 14, 2017 4:18:08 PM] (jlowe) HADOOP-15085. Output streams closed with IOUtils suppressing write [Dec 14, 2017 6:58:16 PM] (xyao) HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed by [Dec 14, 2017 8:58:47 PM] (kihwal) HDFS-12907. Allow read-only access to reserved raw for non-superusers. [Dec 14, 2017 10:03:55 PM] (subru) YARN-7630. Fix AMRMToken rollover handling in AMRMProxy. Contributed by [Dec 15, 2017 1:10:37 AM] (vinodkv) YARN-7565. Addendum to fix an incompatible change. Contributed by Wangda [Dec 15, 2017 3:22:51 AM] (xiao) HDFS-12910. Secure Datanode Starter should log the port when it fails to [Dec 15, 2017 3:58:52 AM] (wwei) YARN-7642. Add test case to verify context update after container [Dec 15, 2017 6:09:24 AM] (yqlin) HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun [Dec 15, 2017 7:30:57 AM] (sunilg) YARN-7638. Unit tests related to preemption for auto created leaf queues [Dec 15, 2017 4:20:28 PM] (rohithsharmaks) YARN-7190. Ensure only NM classpath in 2.x gets TSv2 related hbase jars, [Dec 15, 2017 5:37:15 PM] (sunilg) YARN-7633. Documentation for auto queue creation feature and related [Dec 15, 2017 6:04:43 PM] (lei) HDFS-12819. Setting/Unsetting EC policy shows warning if the directory [Dec 15, 2017 6:20:29 PM] (lei) HDFS-12927. Update erasure coding doc to address unsupported APIs. [Dec 15, 2017 9:45:37 PM] (cliang) HDFS-12917. Fix description errors in testErasureCodingConf.xml. [Dec 15, 2017 11:38:36 PM] (wangda) YARN-5418. When partial log aggregation is enabled, display the list of [Dec 15, 2017 11:40:56 PM] (wangda) YARN-7629. TestContainerLaunch# fails after YARN-7381. (Jason Lowe via [Dec 16, 2017 1:51:37 AM] (cdouglas) HDFS-10675. Datanode support to read from external stores. [Dec 16, 2017 1:51:37 AM] (cdouglas) HDFS-10706. [READ] Add tool generating FSImage from external store [Dec 16, 2017 1:51:37 AM] (cdouglas) HDFS-11190. [READ] Namenode support for data stored in external stores. [Dec 16, 2017 1:51:37 AM] (cdouglas) HDFS-11653. [READ] ProvidedReplica should return an InputStream that is [Dec 16, 2017 1:51:37 AM] (cdouglas) HDFS-11663. [READ] Fix NullPointerException in ProvidedBlocksBuilder [Dec 16, 2017 1:51:37 AM] (cdouglas) HDFS-11703. [READ] Tests for ProvidedStorageMap [Dec 16, 2017 1:51:38 AM] (cdouglas) HDFS-11791. [READ] Test for increasing replication of provided files. [Dec 16, 2017 1:51:38 AM] (cdouglas) HDFS-11792. [READ] Test cases for ProvidedVolumeDF and [Dec 16, 2017 1:51:38 AM] (cdouglas) HDFS-11673. [READ] Handle failures of Datanode with PROVIDED storage [Dec 16, 2017 1:51:38 AM] (cdouglas) HDFS-12091. [READ] Check that the replicas served from a [Dec 16, 2017 1:51:38 AM] (cdouglas) HDFS-12093. [READ] Share remoteFS between ProvidedReplica instances. [Dec 16, 2017 1:51:38 AM] (cdouglas) HDFS-12289. [READ] HDFS-12091 breaks the tests for provided block reads [Dec 16, 2017 1:51:38 AM] (cdouglas) HDFS-12584. [READ] Fix errors in image generation tool from latest [Dec 16, 2017 1:51:38 AM] (cdouglas) HDFS-12605. [READ] [Dec 16, 2017 1:51:38 AM] (cdouglas) HDFS-11902. [READ] Merge BlockFormatProvider and FileRegionProvider. [Dec 16, 2017 1:51:39 AM] (cdouglas) HDFS-12607. [READ] Even one dead datanode with PROVIDED storage results [Dec 16, 2017 1:51:39 AM] (cdouglas) HDFS-12671. [READ] Test NameNode restarts when PROVIDED is configured [Dec 16, 2017 1:51:39 AM] (cdouglas) HDFS-12789. [READ] Image generation tool does not close an opened stream [Dec 16, 2017 1:51:39 AM] (cdouglas) HDFS-12776. [READ] Increasing replication for PROVIDED files should [Dec 16, 2017 1:51:39 AM] (cdouglas) HDFS-12779. [READ] Allow cluster id to be specified to the Image [Dec 16, 2017 1:51:39 AM] (cdouglas) HDFS-12777. [READ] Reduce memory and CPU footprint for PROVIDED volumes. [Dec 16, 2017 1:51:39 AM] (cdouglas) HDFS-12775. [READ] Fix reporting of Provided volumes [Dec 16, 2017 1:51:39 AM] (cdouglas) HDFS-12778. [READ] Report multiple locations for PROVIDED blocks [Dec 16, 2017 1:51:40 AM] (cdouglas) HDFS-12809. [READ] Fix the randomized selection of locations in [Dec 16, 2017 1:51:40 AM] (cdouglas) HDFS-12685. [READ] FsVolumeImpl exception when scanning Provided storage [Dec 16, 2017 1:51:40 AM] (cdouglas) HDFS-12665. [AliasMap] Create a version of the AliasMap that runs in [Dec 16, 2017 1:51:40 AM] (cdouglas) HDFS-12591. [READ] Implement LevelDBFileRegionFormat. Contributed by [Dec 16, 2017 1:51:40 AM] (cdouglas) HDFS-12885. Add visibility/stability annotations. Contributed by Chris [Dec 16, 2017 1:51:40 AM] (cdouglas) HDFS-12713. [READ] Refactor FileRegion and BlockAliasMap to separate out [Dec 16, 2017 1:51:40 AM] (cdouglas) HDFS-12894. [READ] Skip setting block count of [Dec 16, 2017 1:51:41 AM] (cdouglas) HDFS-11640. [READ] Datanodes should use a unique identifier when reading [Dec 16, 2017 1:51:41 AM] (cdouglas) HDFS-12887. [READ] Allow Datanodes with Provided volumes to start when [Dec 16, 2017 1:51:41 AM] (cdouglas) HDFS-12903. [READ] Fix closing streams in ImageWriter [Dec 16, 2017 1:51:41 AM] (cdouglas) HDFS-12874. Documentation for provided storage. Contributed by Virajith [Dec 16, 2017 1:51:41 AM] (cdouglas) HDFS-12905. [READ] Handle decommissioning and under-maintenance [Dec 16, 2017 1:51:41 AM] (cdouglas) HDFS-12893. [READ] Support replication of Provided blocks with [Dec 16, 2017 1:51:41 AM] (cdouglas) HDFS-12912. [READ] Fix configuration and implementation of LevelDB-based [Dec 16, 2017 1:51:41 AM] (cdouglas) HDFS-12712. [9806] Code style cleanup [Dec 16, 2017 1:51:42 AM] (cdouglas) Revert "HDFS-12903. [READ] Fix closing streams in ImageWriter" [Dec 16, 2017 1:51:42 AM] (cdouglas) HDFS-12903. [READ] Fix closing streams in ImageWriter. Contributed by [Dec 16, 2017 6:53:10 PM] (cdouglas) HADOOP-15106. FileSystem::open(PathHandle) should throw a specific [Dec 18, 2017 2:07:16 AM] (wwei) YARN-7617. Add a flag in distributed shell to automatically PROMOTE [Dec 18, 2017 1:24:51 PM] (aajisaka) YARN-7664. Several javadoc errors. Contributed by Sean Mackrory. [Dec 18, 2017 7:36:22 PM] (shv) HDFS-12818. Support multiple storages in DataNodeCluster / [Dec 18, 2017 9:19:06 PM] (stevel) HADOOP-13974. S3Guard CLI to support list/purge of pending multipart [Dec 18, 2017 9:20:06 PM] (jlowe) YARN-7661. NodeManager metrics return wrong value after update node [Dec 18, 2017 9:25:47 PM] (cliang) HADOOP-15109. TestDFSIO -read -random doesn't work on file sized 4GB. [Dec 19, 2017 2:02:30 AM] (szetszwo) HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very [Dec 19, 2017 3:23:16 AM] (yqlin) HDFS-12930. Remove the extra space in HdfsImageViewer.md. Contributed by [Dec 19, 2017 6:39:01 AM] (junping_du) Add 2.8.3 release jdiff files. [Dec 19, 2017 7:31:34 AM] (yqlin) HDFS-12937. RBF: Add more unit tests for router admin commands. [Dec 19, 2017 2:57:25 PM] (sunilg) YARN-7620. Allow node partition filters on Queues page of new YARN UI. [Dec 19, 2017 4:59:24 PM] (varunsaxena) YARN-7662. [ATSv2] Define new set of configurations for reader and [Dec 19, 2017 9:45:04 PM] (eyang) YARN-7543. Add check for max cpu limit and missing file for YARN [Dec 19, 2017 11:42:27 PM] (eyang) YARN-7466. addendum patch for failing unit test. (Contributed by [Dec 20, 2017 12:14:45 AM] (eyang) YARN-7616. Map YARN application status to Service Status more [Dec 20, 2017 6:01:15 AM] (sunilg) YARN-7032. [ATSv2] NPE while starting hbase co-processor when HBase [Dec 20, 2017 4:55:46 PM] (weiy) HDFS-12932. Fix confusing LOG message for block replication. Contributed [Dec 20, 2017 4:58:28 PM] (rohithsharmaks) YARN-7674. Update Timeline Reader web app address in UI2. Contributed by [Dec 20, 2017 6:25:33 PM] (stevel) HADOOP-14965. S3a input stream "normal" fadvise mode to be adaptive [Dec 20, 2017 9:39:00 PM] (rkanter) YARN-7577. Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart [Dec 21, 2017 1:04:34 AM] (aajisaka) HDFS-12949. Fix findbugs warning in ImageWriter.java. [Dec 21, 2017 2:58:34 AM] (aajisaka) HADOOP-15133. [JDK9] Ignore com.sun.javadoc.* and com.sun.tools.* in [Dec 21, 2017 2:15:53 PM] (stevel) HADOOP-15113. NPE in S3A getFileStatus: null instrumentation on using [Dec 21, 2017 2:58:58 PM] (stevel) HADOOP-13282. S3 blob etags to be made visible in S3A [Dec 21, 2017 6:28:24 PM] (lei) HDFS-12938. TestErasureCodigCLI testAll failing consistently. [Dec 21, 2017 7:20:30 PM] (cliang) HDFS-12951. Incorrect javadoc in SaslDataTransferServer.java#receive. [Dec 21, 2017 11:47:15 PM] (manojpec) HDFS-12959. Fix TestOpenFilesWithSnapshot redundant configurations. [Dec 22, 2017 11:39:55 AM] (stevel) HADOOP-15086. NativeAzureFileSystem file rename is not atomic. [Dec 28, 2017 7:17:07 AM] (jitendra) HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by [Dec 28, 2017 7:54:08 PM] (xiao) HDFS-9023. When NN is not able to identify DN for replication, reason [Dec 29, 2017 6:20:42 AM] (arun suresh) YARN-7542. Fix issue that causes some Running Opportunistic Containers [Dec 29, 2017 8:21:57 PM] (lei) HDFS-12915. Fix findbugs warning in [Dec 29, 2017 8:49:37 PM] (szegedim) YARN-7580. ContainersMonitorImpl logged message lacks detail when [Dec 29, 2017 9:41:15 PM] (xiao) HADOOP-15149. CryptoOutputStream should implement StreamCapabilities. [Dec 29, 2017 11:34:08 PM] (wangda) YARN-7555. Support multiple resource types in YARN native services. [Dec 30, 2017 12:59:25 AM] (szegedim) HADOOP-15122. Lock down version of doxia-module-markdown plugin. [Dec 31, 2017 1:58:35 AM] (cdouglas) HADOOP-15117. open(PathHandle) contract test should be exhaustive for [Jan 2, 2018 6:50:13 PM] (arp) HADOOP-15152. Typo in javadoc of [Jan 2, 2018 8:54:40 PM] (arp) HDFS-12351. Explicitly describe the minimal number of DataNodes required [Jan 2, 2018 10:59:36 PM] (manojpec) HDFS-11847. Enhance dfsadmin listOpenFiles command to list files [Jan 2, 2018 11:05:27 PM] (manojpec) HDFS-12629. NameNode UI should report total blocks count by type - [Jan 3, 2018 12:36:51 AM] (szegedim) YARN-7687. ContainerLogAppender Improvements. Contributed by BELUGA [Jan 3, 2018 1:22:55 AM] (arp) HADOOP-15155. Error in javadoc of [Jan 3, 2018 1:34:29 AM] (arp) Revert "HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed [Jan 3, 2018 1:39:50 AM] (szegedim) YARN-7688. Miscellaneous Improvements To ProcfsBasedProcessTree. [Jan 3, 2018 1:59:10 AM] (szegedim) YARN-6894. RM Apps API returns only active apps when query parameter [Jan 3, 2018 2:03:04 AM] (szegedim) YARN-7585. NodeManager should go unhealthy when state store throws [Jan 3, 2018 6:03:00 AM] (arun suresh) YARN-7691. Add Unit Tests for ContainersLauncher. (Sampada Dehankar via [Jan 3, 2018 12:50:04 PM] (rohithsharmaks) YARN-7692. Skip validating priority acls while recovering applications. [Jan 3, 2018 5:01:38 PM] (jlowe) MAPREDUCE-7028. Concurrent task progress updates causing NPE in [Jan 3, 2018 5:41:26 PM] (haibochen) YARN-7602. NM should reference the singleton JvmMetrics instance. [Jan 3, 2018 10:32:47 PM] (arp) HADOOP-15093. Deprecation of yarn.resourcemanager.zk-address is [Jan 3, 2018 10:54:20 PM] (xyao) HDFS-12931. Handle InvalidEncryptionKeyException during [Jan 3, 2018 11:31:50 PM] (rkanter) YARN-7622. Allow fair-scheduler configuration on HDFS (gphillips via [Jan 4, 2018 2:48:44 AM] (yqlin) HDFS-12948. DiskBalancer report command top option should only take [Jan 4, 2018 3:37:21 PM] (mackrorysd) HDFS-12913. TestDNFencingWithReplication sometimes fails because of [Jan 4, 2018 4:15:52 PM] (jlowe) YARN-7678. Ability to enable logging of container memory stats. [Jan 4, 2018 6:32:00 PM] (arp) HDFS-12987. Document - Disabling the Lazy persist file scrubber.. [Jan 4, 2018 6:54:56 PM] (lei) HDFS-12860. StripedBlockUtil#getRangesInternalBlocks throws exception [Jan 5, 2018 9:12:17 AM] (sunilg) YARN-7619. Max AM Resource value in Capacity Scheduler UI has to be [Jan 5, 2018 5:11:38 PM] (inigoiri) HDFS-12988. RBF: Mount table entries not properly updated in the local [Jan 5, 2018 7:15:06 PM] (rkanter) YARN-7557. It should be possible to specify resource types in the fair [Jan 5, 2018 9:55:09 PM] (rkanter) YARN-7645. [Jan 5, 2018 11:12:04 PM] (wangda) YARN-7666. Introduce scheduler specific environment variable support in [Jan 6, 2018 2:25:00 AM] (jianhe) Revert "YARN-7540. Route YARN service CLI function through YARN Service [Jan 6, 2018 6:31:08 AM] (yqlin) HDFS-11848. Enhance dfsadmin listOpenFiles command to list files under a [Jan 8, 2018 5:09:31 AM] (rohithsharmaks) YARN-7699. queueUsagePercentage is coming as INF for getApp REST api [Jan 8, 2018 6:29:06 AM] (sunilg) YARN-7242. Support to specify values of different resource types in [Jan 8, 2018 9:20:17 PM] (billie) YARN-7704. Document improvement for registry dns. Contributed by Jian He [Jan 8, 2018 10:25:39 PM] (weiy) HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in [Jan 8, 2018 11:34:00 PM] (manojpec) HDFS-12985. NameNode crashes during restart after an OpenForWrite file [Jan 9, 2018 12:19:02 AM] (rchiang) YARN-4227. Ignore expired containers from removed nodes in [Jan 9, 2018 1:51:09 AM] (inigoiri) HDFS-12808. Add LOG.isDebugEnabled() guard for LOG.debug(...). [Jan 9, 2018 11:09:33 AM] (sunilg) YARN-7718. DistributedShell failed to specify resource other than [Jan 9, 2018 12:27:01 PM] (bibinchundatt) YARN-7508. NPE in FiCaSchedulerApp when debug log enabled in [Jan 9, 2018 3:52:59 PM] (jlowe) YARN-7663. RMAppImpl:Invalid event: START at KILLED. Contributed by [Jan 9, 2018 4:51:15 PM] (jlowe) YARN-6948. Invalid event: ATTEMPT_ADDED at FINAL_SAVING. Contributed by [Jan 9, 2018 4:56:59 PM] (haibochen) YARN-7716. metricsTimeStart and metricsTimeEnd should be all lower case [Jan 9, 2018 6:46:52 PM] (stevel) HADOOP-15161. s3a: Stream and common statistics missing from metrics [Jan 9, 2018 7:53:49 PM] (lei) HDFS-12994. TestReconstructStripedFile.testNNSendsErasureCodingTasks [Jan 10, 2018 12:45:35 AM] (haibochen) YARN-7665. Allow FS scheduler state dump to be turned on/off separately [Jan 10, 2018 12:59:39 AM] (szegedim) YARN-7689. TestRMContainerAllocator fails after YARN-6124. Contributed [Jan 10, 2018 2:53:25 AM] (inigoiri) HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by [Jan 10, 2018 5:59:11 AM] (yqlin) HDFS-12934. RBF: Federation supports global quota. Contributed by Yiqun [Jan 10, 2018 3:21:34 PM] (sunilg) YARN-7722. Rename variables in MockNM, MockRM for better clarity. [Jan 10, 2018 3:37:07 PM] (stevel) HADOOP-15163. Fix S3ACommitter documentation Contributed by Alessandro [Jan 10, 2018 6:52:26 PM] (szegedim) HADOOP-15060. [Jan 11, 2018 6:59:27 AM] (aajisaka) YARN-7735. Fix typo in YARN documentation. Contributed by Takanobu [Jan 11, 2018 10:47:50 AM] (stevel) HADOOP-15033. Use java.util.zip.CRC32C for Java 9 and above Contributed [Jan 11, 2018 5:40:09 PM] (szegedim) YARN-7590. Improve container-executor validation check. Contributed by [Jan 12, 2018 12:50:21 AM] (arp) HADOOP-15114. Add closeStreams(...) to IOUtils. Contributed by Ajay [Jan 12, 2018 10:11:19 AM] (sunilg) YARN-7727. Incorrect log levels in few logs with [Jan 12, 2018 4:04:00 PM] (arp) HDFS-12984. BlockPoolSlice can leak in a mini dfs cluster. Contributed [Jan 12, 2018 5:21:17 PM] (billie) YARN-7731. RegistryDNS should handle upstream DNS returning CNAME. [Jan 12, 2018 6:41:27 PM] (eyang) YARN-5366. Improve signal handling and delete delay for Docker on Yarn. [Jan 12, 2018 10:04:15 PM] (jianhe) YARN-7671. Improve Diagonstic message for stop yarn native service. [Jan 12, 2018 10:18:01 PM] (rkanter) MAPREDUCE-7030. Uploader tool should ignore symlinks to the same [Jan 12, 2018 11:33:46 PM] (billie) YARN-7724. yarn application status should support application name. [Jan 13, 2018 12:14:10 AM] (wangda) YARN-7468. Provide means for container network policy control. (Xuan [Jan 13, 2018 12:25:39 AM] (inigoiri) HDFS-12919. RBF: Support erasure coding methods in RouterRpcServer. [Jan 13, 2018 1:00:01 AM] (szegedim) YARN-7705. Create the container log directory with correct sticky bit in [Jan 13, 2018 5:16:43 AM] (yqlin) HDFS-12972. RBF: Display mount table quota info in Web UI and admin [Jan 13, 2018 3:19:30 PM] (arp) HDFS-13016. globStatus javadoc refers to glob pattern as "regular [Jan 15, 2018 6:38:03 AM] (aajisaka) MAPREDUCE-7034. Moving logging APIs over to slf4j the rest of all in [Jan 15, 2018 6:45:51 AM] (aajisaka) HADOOP-15172. Fix the javadoc warning in WriteOperationHelper.java [Jan 15, 2018 11:33:32 AM] (stevel) HADOOP-15079. ITestS3AFileOperationCost#testFakeDirectoryDeletion [Jan 16, 2018 2:28:29 AM] (rohithsharmaks) YARN-6736. Consider writing to both ats v1 & v2 from RM for smoother [Jan 16, 2018 10:51:02 AM] (brahma) HDFS-8693. refreshNamenodes does not support adding a new standby to a [Jan 16, 2018 6:15:22 PM] (yufei) HADOOP-15157. Zookeeper authentication related properties to support [Jan 16, 2018 6:16:42 PM] (rkanter) YARN-7479. TestContainerManagerSecurity.testContainerManager[Simple] [Jan 16, 2018 6:45:45 PM] (rkanter) MAPREDUCE-7032. Add the ability to specify a delayed replication count [Jan 16, 2018 10:46:55 PM] (yufei) YARN-6486. FairScheduler: Deprecate continuous scheduling. (Contributed [Jan 16, 2018 11:15:11 PM] (lei) HDFS-13004. TestLeaseRecoveryStriped.testLeaseRecovery is failing when [Jan 16, 2018 11:40:43 PM] (szegedim) YARN-7758. Add an additional check to the validity of container and [Jan 17, 2018 7:55:59 AM] (sammi.chen) HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve [Jan 17, 2018 8:05:24 AM] (fabbri) HADOOP-15141 Support IAM Assumed roles in S3A. Contributed by Steve [Jan 17, 2018 8:46:48 AM] (vinayakumarb) HDFS-9049. Make Datanode Netty reverse proxy port to be configurable. [Jan 17, 2018 2:14:11 PM] (jlowe) MAPREDUCE-7029. FileOutputCommitter is slow on filesystems lacking [Jan 17, 2018 10:11:14 PM] (szegedim) YARN-7717. Add configuration consistency for module.enabled and [Jan 18, 2018 4:15:57 AM] (aajisaka) HADOOP-15177. Update the release year to 2018. Contributed by Bharat [Jan 18, 2018 5:24:32 AM] (brahma) HADOOP-15150. in FsShell, UGI params should be overidden through env [Jan 18, 2018 12:35:57 PM] (stevel) Revert "HADOOP-13974. S3Guard CLI to support list/purge of pending [Jan 18, 2018 12:35:57 PM] (stevel) HADOOP-15123. KDiag tries to load krb5.conf from KRB5CCNAME instead of [Jan 18, 2018 1:13:58 PM] (stevel) HADOOP-13974. S3Guard CLI to support list/purge of pending multipart [Jan 18, 2018 1:24:41 PM] (sunilg) YARN-7750. [UI2] Render time related fields in all pages to the browser [Jan 18, 2018 1:35:26 PM] (sunilg) YARN-7738. CapacityScheduler: Support refresh maximum allocation for [Jan 18, 2018 8:11:19 PM] (billie) YARN-7740. Fix logging for destroy yarn service cli when app does not [Jan 19, 2018 1:43:47 AM] (szegedim) YARN-7139. FairScheduler: finished applications are always restored to [Jan 19, 2018 6:18:19 AM] (yqlin) HDFS-12973. RBF: Document global quota supporting in federation. [Jan 19, 2018 10:18:16 AM] (rohithsharmaks) YARN-7753. [UI2] Application logs has to be pulled from ATS 1.5 instead [Jan 19, 2018 2:48:45 PM] (stevel) HADOOP-14788. Credentials readTokenStorageFile to stop wrapping IOEs in [Jan 19, 2018 2:54:13 PM] (stevel) HADOOP-15114. Add closeStreams(...) to IOUtils (addendum). Contributed [Jan 19, 2018 5:47:40 PM] (inigoiri) HDFS-13028. RBF: Fix spurious TestRouterRpc#testProxyGetStats. [Jan 19, 2018 6:27:46 PM] (haibochen) YARN-5094. some YARN container events have timestamp of -1. [Jan 19, 2018 8:56:17 PM] (haibochen) MAPREDUCE-6984. MR AM to clean up temporary files from previous attempt [Jan 19, 2018 11:34:40 PM] (vrushali) YARN-7537 [Atsv2] load hbase configuration from filesystem rather than [Jan 20, 2018 12:15:55 AM] (vrushali) HADOOP-15166 CLI MiniCluster fails with ClassNotFoundException [Jan 20, 2018 12:40:58 AM] (lei) HDFS-13039. StripedBlockReader.createBlockReader leaks socket on [Jan 20, 2018 1:51:53 AM] (cliang) HDFS-13036. Reusing the volume storage ID obtained by replicaInfo. [Jan 20, 2018 1:57:54 AM] (rkanter) MAPREDUCE-6995. Uploader tool for Distributed Cache Deploy documentation [Jan 22, 2018 8:12:36 AM] (aajisaka) HADOOP-15181. Typo in SecureMode.md [Jan 22, 2018 6:30:01 PM] (yufei) YARN-7755. Clean up deprecation messages for allocation increments in FS [Jan 22, 2018 9:33:38 PM] (eyang) YARN-7729. Add support for setting Docker PID namespace mode. [Jan 22, 2018 11:54:44 PM] (hanishakoneru) HADOOP-15121. Encounter NullPointerException when using [Jan 23, 2018 12:02:32 AM] (hanishakoneru) HDFS-13023. Journal Sync does not work on a secure cluster. Contributed [Jan 23, 2018 5:09:11 PM] (stevel) HADOOP-15185. Update adls connector to use the current version of ADLS [Jan 23, 2018 6:53:27 PM] (jianhe) YARN-7766. Introduce a new config property for YARN Service dependency [Jan 23, 2018 10:03:53 PM] (jianhe) YARN-7782. Enable user re-mapping for Docker containers in [Jan 24, 2018 1:54:39 AM] (billie) YARN-7540 and YARN-7605. Convert yarn app cli to call yarn api services [Jan 24, 2018 2:43:36 AM] (yqlin) HDFS-12963. Error log level in ShortCircuitRegistry#removeShm. [Jan 24, 2018 3:15:44 AM] (inigoiri) HDFS-12772. RBF: Federation Router State State Store internal API. [Jan 24, 2018 5:07:05 AM] (szegedim) YARN-7796. Container-executor fails with segfault on certain OS [Jan 24, 2018 9:34:15 AM] (rohithsharmaks) Revert "YARN-7537 [Atsv2] load hbase configuration from filesystem [Jan 24, 2018 10:26:59 AM] (rohithsharmaks) YARN-7749. [UI2] GPU information tab in left hand side disappears when [Jan 24, 2018 11:26:13 AM] (sunilg) YARN-7806. Distributed Shell should use timeline async api's. [Jan 24, 2018 7:17:12 PM] (jianhe) YARN-7801. AmFilterInitializer should addFilter after fill all [Jan 24, 2018 8:44:07 PM] (jlowe) MAPREDUCE-7015. Possible race condition in JHS if the job is not loaded. [Jan 24, 2018 8:54:54 PM] (zhz) YARN-7737. prelaunch.err file not found exception on container failure. [Jan 24, 2018 9:50:47 PM] (billie) YARN-7777. Fix user name format in YARN Registry DNS name. Contributed [Jan 24, 2018 11:24:57 PM] (wangda) YARN-7628. [Documentation] Documenting the ability to disable elasticity [Jan 25, 2018 2:24:19 AM] (eyang) YARN-7810. Update TestDockerContainerRuntime to test with current user [Jan 25, 2018 6:30:42 AM] (aajisaka) HDFS-13063. Fix the incorrect spelling in HDFSHighAvailabilityWithQJM.md [Jan 25, 2018 7:51:26 AM] (yqlin) HDFS-13042. RBF: Heartbeat Router State. Contributed by Inigo Goiri. [Jan 25, 2018 9:02:54 AM] (sunilg) YARN-7728. Expose container preemptions related information in Capacity [Jan 25, 2018 7:36:40 PM] (weiy) HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and [Jan 25, 2018 9:06:01 PM] (yufei) YARN-7798. Refactor SLS Reservation Creation. Contributed by Young Chen. [Jan 25, 2018 11:47:19 PM] (jlowe) YARN-7102. NM heartbeat stuck when responseId overflows MAX_INT. [Jan 26, 2018 12:11:30 AM] (haibochen) MAPREDUCE-7041. MR should not try to clean up at first job attempt. [Jan 26, 2018 1:37:23 AM] (szegedim) YARN-7814. Remove automatic mounting of the cgroups root directory into [Jan 26, 2018 7:43:27 AM] (wangda) YARN-7817. Add Resource reference to RM's NodeInfo object so REST API [Jan 26, 2018 7:44:55 AM] (wangda) YARN-7760. [UI2] Clicking 'Master Node' or link next to 'AM Node Web UI' [Jan 26, 2018 7:46:06 AM] (wangda) YARN-7742. [UI2] Duplicated containers are rendered per attempt. [Jan 26, 2018 5:18:30 PM] (cdouglas) MapFile.fix creates a wrong index file in case of block-compressed data [Jan 26, 2018 5:32:23 PM] (billie) YARN-7797. Docker host network can not obtain IP address for [Jan 26, 2018 7:25:20 PM] (jlowe) YARN-2185. Use pipes when localizing archives. Contributed by Miklos [Jan 26, 2018 8:36:45 PM] (jlowe) MAPREDUCE-7022. Fast fail rogue jobs based on task scratch dir size. [Jan 26, 2018 9:09:13 PM] (arp) HDFS-13054. Handling PathIsNotEmptyDirectoryException in DFSClient [Jan 26, 2018 9:31:43 PM] (jlowe) MAPREDUCE-7020. Task timeout in uber mode can crash AM. Contributed by [Jan 27, 2018 12:27:31 AM] (haibochen) YARN-7064. Use cgroup to get container resource utilization. (Miklos [Jan 28, 2018 6:18:51 AM] (jianhe) YARN-7765. Fixed an issue that kerberos tgt not found when NM posting [Jan 29, 2018 6:12:05 AM] (xiao) HDFS-13065. TestErasureCodingMultipleRacks#testSkewedRack3 is failing. [Jan 29, 2018 6:19:49 AM] (xiao) HDFS-12974. Exception message is not printed when creating an encryption [Jan 29, 2018 3:00:57 PM] (aajisaka) YARN-7698. A misleading variable's name in [Jan 29, 2018 3:14:38 PM] (sunilg) YARN-7790. Improve Capacity Scheduler Async Scheduling to better handle [Jan 29, 2018 3:39:39 PM] (aajisaka) MAPREDUCE-7036. ASF License warning in hadoop-mapreduce-client [Jan 29, 2018 5:48:14 PM] (stevel) HADOOP-15186. Allow Azure Data Lake SDK dependency version to be set on [Jan 29, 2018 11:23:29 PM] (kihwal) HDFS-12574. Add CryptoInputStream to WebHdfsFileSystem read call. [Jan 30, 2018 4:12:08 AM] (yqlin) HDFS-13044. RBF: Add a safe mode for the Router. Contributed by Inigo [Jan 30, 2018 7:45:06 AM] (wangda) YARN-5148. [UI2] Add page to new YARN UI to view server side [Jan 30, 2018 10:28:11 AM] (sunilg) YARN-7723. Avoid using docker volume --format option to run against to [Jan 30, 2018 2:34:39 PM] (jlowe) Revert "YARN-2185. Use pipes when localizing archives. Contributed by [Jan 30, 2018 5:42:38 PM] (eyang) YARN-7811. Fixed a bug in user defined docker network settings. [Jan 30, 2018 11:25:03 PM] (wwei) HDFS-12528. Add an option to not disable short-circuit reads on [Jan 31, 2018 2:27:18 AM] (inigoiri) HDFS-13083. RBF: Fix doc error setting up client. Contributed by [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-6593. [API] Introduce Placement Constraint object. (Konstantinos [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-6594. [API] Introduce SchedulingRequest object. (Konstantinos [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-6595. [API] Add Placement Constraints at the application level. [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7448. [API] Add SchedulingRequest to the AllocateRequest. [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7522. Introduce AllocationTagsManager to associate allocation tags [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7670. Modifications to the ResourceScheduler API to support [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7669. API and interface modifications for placement constraint [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7653. Node group support for AllocationTagsManager. (Panagiotis [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-6596. Introduce Placement Constraint Manager module. (Konstantinos [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7612. Add Processor Framework for Rich Placement Constraints. [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7613. Implement Basic algorithm for constraint based placement. [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7682. Expose canSatisfyConstraints utility function to validate a [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7681. Double-check placement constraints in scheduling phase before [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7696. Add container tags to ContainerTokenIdentifier, api.Container [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-6619. AMRMClient Changes to use the PlacementConstraint and [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7709. Remove SELF from TargetExpression type. (Konstantinos [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-6599. Support anti-affinity constraint via AppPlacementAllocator. [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7745. Allow DistributedShell to take a placement specification for [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7774. Miscellaneous fixes to the PlacementProcessor. (asuresh) [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7763. Allow Constraints specified in the SchedulingRequest to [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7788. Factor out management of temp tags from [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7779. Display allocation tags in RM web UI and expose same through [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7783. Add validation step to ensure constraints are not violated [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7807. Assume intra-app anti-affinity as default for scheduling [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7795. Fix jenkins issues of YARN-6592 branch. (Sunil G via asuresh) [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7784. Fix Cluster metrics when placement processor is enabled. [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-6597. Add RMContainer recovery test to verify tag population in the [Jan 31, 2018 9:30:17 AM] (arun suresh) YARN-7780. Documentation for Placement Constraints. (Konstantinos [Jan 31, 2018 12:10:36 PM] (sunilg) YARN-7802. [UI2] Application regex search did not work properly with app [Jan 31, 2018 1:43:08 PM] (wangda) YARN-7828. Clicking on yarn service should take to component tab. (Sunil [Jan 31, 2018 1:44:42 PM] (wangda) YARN-7861. [UI2] Logs page shows duplicated containers with ATS. (Sunil [Jan 31, 2018 3:39:43 PM] (jlowe) YARN-2185. Use pipes when localizing archives. Contributed by Miklos [Jan 31, 2018 9:51:08 AM] (arun suresh) YARN-7822. Constraint satisfaction checker support for composite OR and [Jan 31, 2018 5:37:54 PM] (jlowe) YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim [Jan 31, 2018 6:47:02 PM] (xyao) HDFS-13061. SaslDataTransferClient#checkTrustAndSend should not trust a [Jan 31, 2018 7:05:17 PM] (hanishakoneru) HDFS-13092. Reduce verbosity for ThrottledAsyncChecker#schedule. [Jan 31, 2018 9:45:30 PM] (epayne) MAPREDUCE-7033: Map outputs implicitly rely on permissive umask for [Feb 1, 2018 1:51:40 AM] (eyang) YARN-7816. Allow same application name submitted by multiple users. [Feb 1, 2018 6:39:51 AM] (xyao) HDFS-13060. Adding a BlacklistBasedTrustedChannelResolver for [Feb 1, 2018 6:50:25 AM] (xiao) HDFS-12897. getErasureCodingPolicy should handle .snapshot dir better. [Feb 1, 2018 6:14:09 PM] (jlowe) Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed [Feb 1, 2018 6:37:14 PM] (inigoiri) HDFS-13043. RBF: Expose the state of the Routers in the federation. [Feb 1, 2018 6:45:34 PM] (xyao) HDFS-12997. Move logging to slf4j in BlockPoolSliceStorage and Storage. [Feb 1, 2018 8:28:17 PM] (hanishakoneru) HDFS-13062. Provide support for JN to use separate journal disk per [Feb 1, 2018 11:33:52 PM] (xiao) HADOOP-15197. Remove tomcat from the Hadoop-auth test bundle. ERROR: File 'out/email-report.txt' does not exist
--------------------------------------------------------------------- To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
