Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/ [Aug 20, 2018 6:50:29 AM] (brahma) HDFS-13790. RBF: Move ClientProtocol APIs to its own module. Contributed [Aug 20, 2018 8:07:58 AM] (msingh) HDDS-353. Multiple delete Blocks tests are failing consistently. [Aug 20, 2018 3:01:59 PM] (yqlin) HDFS-13750. RBF: Router ID in RouterRpcClient is always null. [Aug 20, 2018 3:14:40 PM] (jlowe) YARN-8242. YARN NM: OOM error while reading back the state store on [Aug 20, 2018 7:22:36 PM] (gifuma) YARN-8673. [AMRMProxy] More robust responseId resync after an YarnRM [Aug 20, 2018 9:33:16 PM] (gifuma) YARN-8581. [AMRMProxy] Add sub-cluster timeout in [Aug 21, 2018 1:36:24 AM] (stevel) HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable [Aug 21, 2018 4:03:19 AM] (vinayakumarb) HDFS-13772. Erasure coding: Unnecessary NameNode Logs displaying for [Aug 21, 2018 6:28:07 AM] (rohithsharmaks) YARN-8129. Improve error message for invalid value in fields attribute. [Aug 21, 2018 11:00:31 AM] (wwei) YARN-8683. Support to display pending scheduling requests in RM app [Aug 21, 2018 2:42:28 PM] (wwei) YARN-7494. Add muti-node lookup mechanism and pluggable nodes sorting [Aug 21, 2018 11:49:26 PM] (eyang) YARN-8298. Added express upgrade for YARN service. [Aug 22, 2018 3:43:40 AM] (yqlin) HDFS-13821. RBF: Add dfs.federation.router.mount-table.cache.enable so [Aug 22, 2018 5:04:15 PM] (hanishakoneru) HDDS-265. Move numPendingDeletionBlocks and deleteTransactionId from [Aug 22, 2018 5:54:10 PM] (xyao) HDDS-350. ContainerMapping#flushContainerInfo doesn't set containerId. [Aug 22, 2018 9:48:22 PM] (aengineer) HDDS-342. Add example byteman script to print out hadoop rpc traffic. [Aug 23, 2018 1:55:14 AM] (aengineer) HDDS-356. Support ColumnFamily based RockDBStore and TableStore. [Aug 23, 2018 4:35:43 AM] (sunilg) YARN-8015. Support all types of placement constraint support for [Aug 23, 2018 12:54:38 PM] (tasanuma) HADOOP-14314. The OpenSolaris taxonomy link is dead in [Aug 23, 2018 2:29:46 PM] (jlowe) YARN-8649. NPE in localizer hearbeat processing if a container is killed [Aug 23, 2018 6:30:28 PM] (xyao) HDDS-328. Support export and import of the KeyValueContainer. [Aug 24, 2018 2:44:57 AM] (surendralilhore) HDFS-13805. Journal Nodes should allow to format non-empty directories [Aug 24, 2018 11:56:30 AM] (elek) HDDS-317. Use new StorageSize API for reading [Aug 24, 2018 1:36:10 PM] (elek) HDDS-363. Faster datanode registration during the first startup. [Aug 24, 2018 6:23:17 PM] (yufei_gu) YARN-8632. Threads in SLS quit without logging exception. Contributed by [Aug 24, 2018 8:42:51 PM] (elek) HDDS-364. Update open container replica information in SCM during DN [Aug 25, 2018 1:27:30 AM] (shv) HDFS-13848. Refactor NameNode failover proxy providers. Contributed by -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite pathlen shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml Failed junit tests : hadoop.security.authentication.util.TestKerberosName hadoop.security.authentication.server.TestAltKerberosAuthenticationHandler hadoop.security.authentication.client.TestKerberosAuthenticator mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out/patch-mvninstall-root.txt [312K] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out/patch-compile-root.txt [56K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out/patch-compile-root.txt [56K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out/patch-compile-root.txt [56K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out//testptch/patchprocess/maven-patch-checkstyle-root.txt [] mvnsite: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out/patch-mvnsite-root.txt [40K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/37/artifact/out/diff-patch-shelldocs.txt [16K] whitespace:
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/35/ [Aug 6, 2018 4:37:59 PM] (eyang) YARN-8624. Updated verbiage around entry point support. [Aug 7, 2018 1:32:51 AM] (yqlin) HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao [Aug 7, 2018 9:33:14 AM] (msingh) HDDS-230. ContainerStateMachine should implement readStateMachineData [Aug 7, 2018 10:39:53 AM] (msingh) HDDS-301. ozone command shell does not contain subcommand to run ozoneFS [Aug 7, 2018 5:15:28 PM] (virajith) HDFS-13796. Allow verbosity of InMemoryLevelDBAliasMapServer to be [Aug 7, 2018 7:36:55 PM] (wangda) YARN-8629. Container cleanup fails while trying to delete Cgroups. (Suma [Aug 7, 2018 7:37:32 PM] (wangda) YARN-7089. Mark the log-aggregation-controller APIs as public. (Zian [Aug 7, 2018 8:01:13 PM] (wangda) YARN-8407. Container launch exception in AM log should be printed in [Aug 7, 2018 10:33:16 PM] (gifuma) YARN-8626. Create HomePolicyManager that sends all the requests to the [Aug 7, 2018 11:13:41 PM] (xiao) HDFS-13799. TestEditLogTailer#testTriggersLogRollsForAllStandbyNN fails [Aug 7, 2018 11:40:33 PM] (aengineer) HDDS-124. Validate all required configs needed for ozone-site.xml and [Aug 8, 2018 2:13:09 AM] (mackrorysd) HADOOP-15400. Improve S3Guard documentation on Authoritative Mode [Aug 8, 2018 2:23:17 AM] (vinayakumarb) HDFS-13786. EC: Display erasure coding policy for sub-directories is not [Aug 8, 2018 5:05:17 AM] (xiao) HDFS-13728. Disk Balancer should not fail if volume usage is greater [Aug 8, 2018 7:12:20 AM] (vinayakumarb) HDFS-13785. EC: 'removePolicy' is not working for built-in/system [Aug 8, 2018 11:50:23 AM] (ewan.higgs) HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption [Aug 8, 2018 2:13:29 PM] (sunilg) YARN-8633. Update DataTables version in yarn-common in line with JQuery [Aug 8, 2018 2:18:49 PM] (sunilg) Revert "YARN-8633. Update DataTables version in yarn-common in line with [Aug 8, 2018 3:31:55 PM] (elek) HDFS-13447. Fix Typos - Node Not Chosen. Contributed by Beluga Behr. [Aug 8, 2018 5:12:52 PM] (bibinchundatt) YARN-8601. Print ExecutionType in Container report CLI. Contributed by [Aug 8, 2018 5:40:20 PM] (xiao) HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. [Aug 8, 2018 8:02:12 PM] (wangda) Make 3.1.1 awared by other branches [Aug 8, 2018 8:05:24 PM] (wangda) Make 3.1.1 awared by other branches - adding missing files [Aug 8, 2018 10:08:55 PM] (rkanter) YARN-8568. Replace the deprecated zk-address property in the HA config [Aug 8, 2018 11:47:25 PM] (hanishakoneru) HDDS-267. Handle consistency issues during container update/close. [Aug 9, 2018 5:57:24 AM] (stevel) HADOOP-15583. Stabilize S3A Assumed Role support. Contributed by Steve [Aug 9, 2018 6:48:32 AM] (sunilg) YARN-8633. Update DataTables version in yarn-common in line with JQuery [Aug 9, 2018 9:06:03 AM] (elek) HDDS-219. Genearate version-info.properties for hadoop and ozone. [Aug 9, 2018 12:26:37 PM] (elek) HDDS-344. Remove multibyte characters from OzoneAcl. Contributed by [Aug 9, 2018 3:17:34 PM] (jlowe) YARN-8331. Race condition in NM container launched after done. [Aug 9, 2018 3:46:53 PM] (wwei) YARN-8559. Expose mutable-conf scheduler's configuration in RM [Aug 9, 2018 5:11:47 PM] (cliang) HDFS-13735. Make QJM HTTP URL connection timeout configurable. [Aug 9, 2018 6:04:02 PM] (wangda) YARN-8588. Logging improvements for better debuggability. (Suma [Aug 9, 2018 6:04:02 PM] (wangda) YARN-8136. Add version attribute to site doc examples and quickstart. [Aug 9, 2018 9:58:04 PM] (rkanter) YARN-4946. RM should not consider an application as COMPLETED when log [Aug 9, 2018 11:55:39 PM] (xyao) HDDS-245. Handle ContainerReports in the SCM. Contributed by Elek [Aug 10, 2018 12:32:02 AM] (wwei) YARN-8521. NPE in AllocationTagsManager when a container is removed more [Aug 10, 2018 6:37:45 AM] (wwei) YARN-8575. Avoid committing allocation proposal to unavailable nodes in [Aug 10, 2018 4:38:40 PM] (virajith) HDFS-13795. Fix potential NPE in InMemoryLevelDBAliasMapServer. [Aug 10, 2018 6:15:56 PM] (msingh) HDDS-339. Add block length and blockId in PutKeyResponse. Contributed by [Aug 10, 2018 6:43:22 PM] (hanishakoneru) HDDS-327. CloseContainer command handler should not throw exception if [Aug 10, 2018 8:32:03 PM] (skumpf) YARN-8520. Document best practice for user management. Contributed by [Aug 10, 2018 10:59:39 PM] (shv) Remove super user privilege requirement for NameNode.getServiceStatus. -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite pathlen shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace Specific tests: Failed junit tests : hadoop.security.authentication.util.TestKerberosName
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/34/ [Jul 30, 2018 2:53:44 AM] (sammi.chen) HADOOP-15607. AliyunOSS: fix duplicated partNumber issue in [Jul 30, 2018 9:18:04 AM] (sunilg) YARN-8591. [ATSv2] NPE while checking for entity acl in non-secure [Jul 30, 2018 10:20:04 AM] (brahma) HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to support minimum [Jul 30, 2018 1:15:58 PM] (msingh) HDDS-302. Fix javadoc and add implementation details in [Jul 30, 2018 3:48:42 PM] (nanda) HDDS-287. Add Close ContainerAction to Datanode#StateContext when the [Jul 30, 2018 5:25:07 PM] (cliang) HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc [Jul 30, 2018 5:55:19 PM] (bibinchundatt) YARN-8584. Several typos in Log Aggregation related classes. Contributed [Jul 30, 2018 10:00:29 PM] (szetszwo) HDDS-293. Reduce memory usage and object creation in KeyData. [Jul 31, 2018 12:44:18 AM] (jhung) YARN-7974. Allow updating application tracking url after registration. [Jul 31, 2018 11:57:51 AM] (nanda) HDDS-305. Datanode StateContext#addContainerActionIfAbsent will add [Jul 31, 2018 2:20:40 PM] (msingh) HDDS-279. DeleteBlocks command should not be sent for open containers. [Jul 31, 2018 4:36:34 PM] (inigoiri) YARN-8175. Add support for Node Labels in SLS. Contributed by Abhishek [Jul 31, 2018 6:32:40 PM] (haibochen) YARN-8605. TestDominantResourceFairnessPolicy.testModWhileSorting is [Jul 31, 2018 7:08:00 PM] (wangda) YARN-8418. App local logs could leaked if log aggregation fails to [Jul 31, 2018 10:01:02 PM] (eyang) YARN-8579. Recover NMToken of previous attempted component data. [Jul 31, 2018 11:26:09 PM] (bharat) HDDS-271. Create a block iterator to iterate blocks in a container. [Aug 1, 2018 1:44:49 AM] (fabbri) HDFS-13322 fuse dfs - uid persists when switching between ticket caches. [Aug 1, 2018 3:03:30 AM] (sunilg) YARN-8397. Potential thread leak in ActivitiesManager. Contributed by [Aug 1, 2018 3:33:00 AM] (msingh) HDDS-226. Client should update block length in OM while committing the [Aug 1, 2018 5:34:53 AM] (wangda) YARN-8522. Application fails with InvalidResourceRequestException. (Zian [Aug 1, 2018 6:47:18 AM] (sunilg) YARN-8606. Opportunistic scheduling does not work post RM failover. [Aug 1, 2018 8:57:54 AM] (sunilg) YARN-8595. [UI2] Container diagnostic information is missing from [Aug 1, 2018 3:51:40 PM] (billie) YARN-8403. Change the log level for fail to download resource from INFO [Aug 1, 2018 6:22:01 PM] (skumpf) YARN-8600. RegistryDNS hang when remote lookup does not reply. [Aug 1, 2018 7:32:01 PM] (arp) HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay [Aug 2, 2018 12:41:43 AM] (eyang) YARN-8610. Fixed initiate upgrade error message. [Aug 2, 2018 3:04:09 AM] (sunilg) YARN-8593. Add RM web service endpoint to get user information. [Aug 2, 2018 6:05:22 AM] (nanda) HDDS-310. VolumeSet shutdown hook fails on datanode restart. Contributed [Aug 2, 2018 7:11:06 AM] (sunilg) YARN-8594. [UI2] Display current logged in user. Contributed by Akhil [Aug 2, 2018 10:40:54 AM] (sunilg) YARN-8592. [UI2] rmip:port/ui2 endpoint shows a blank page in windows OS [Aug 2, 2018 12:04:17 PM] (msingh) HDDS-304. Process ContainerAction from datanode heartbeat in SCM. [Aug 2, 2018 1:32:25 PM] (nanda) HDDS-290. putKey is failing with KEY_ALLOCATION_ERROR. Contributed by [Aug 2, 2018 2:39:24 PM] (sunilg) YARN-8318. [UI2] IP address in component page shows N/A. Contributed by [Aug 2, 2018 3:43:48 PM] (jlowe) YARN-8263. DockerClient still touches hadoop.tmp.dir. Contributed by [Aug 2, 2018 4:59:21 PM] (sunilg) YARN-7159. Normalize unit of resource objects in RM to avoid unit [Aug 2, 2018 5:10:12 PM] (haibochen) YARN-7948. Enable fair scheduler to refresh maximum allocation for [Aug 2, 2018 11:48:21 PM] (xyao) HDDS-312. Add blockIterator to Container. Contributed by Bharat [Aug 3, 2018 9:23:04 AM] (nanda) HDDS-300. Create a config for volume choosing policy. Contributed by [Aug 3, 2018 10:00:39 AM] (rohithsharmaks) YARN-8603. [UI2] Latest run application should be listed first in the RM [Aug 3, 2018 10:00:39 AM] (rohithsharmaks) YARN-8608. [UI2] No information available per application appAttempt [Aug 3, 2018 1:42:34 PM] (sunilg) YARN-8620. [UI2] YARN Services UI new submission failures are not [Aug 3, 2018 1:58:16 PM] (sunilg) YARN-8615. [UI2] Resource Usage tab shows only memory related info. No [Aug 3, 2018 2:38:05 PM] (tasanuma) HDFS-11610. sun.net.spi.nameservice.NameService has moved to a new [Aug 3, 2018 11:06:00 PM] (stevel) HADOOP-15626. [Aug 4, 2018 12:20:49 AM] (skumpf) YARN-8287. Update documentation and yarn-default related to the Docker -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite pathlen shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/33/ [Jul 23, 2018 3:43:03 AM] (msingh) HDDS-181. CloseContainer should commit all pending open Keys on a [Jul 23, 2018 4:57:01 PM] (eyang) YARN-8360. Improve YARN service restart policy and node manager auto [Jul 23, 2018 5:28:33 PM] (xyao) HDDS-199. Implement ReplicationManager to handle underreplication of [Jul 23, 2018 6:07:24 PM] (haibochen) YARN-6966. NodeManager metrics may return wrong negative values when NM [Jul 23, 2018 6:18:25 PM] (haibochen) HADOOP-15586. Fix wrong log statement in AbstractService. (Szilard [Jul 24, 2018 12:12:04 AM] (eyang) YARN-8380. Support bind propagation options for mounts in docker [Jul 24, 2018 3:15:47 AM] (yqlin) HDFS-13583. RBF: Router admin clrQuota is not synchronized with [Jul 24, 2018 5:04:20 AM] (xyao) HDDS-258. Helper methods to generate NodeReport and ContainerReport for [Jul 24, 2018 6:39:15 AM] (nanda) HDDS-262. Send SCM healthy and failed volumes in the heartbeat. [Jul 24, 2018 7:39:17 AM] (bibinchundatt) YARN-8544. [DS] AM registration fails when hadoop authorization is [Jul 24, 2018 10:47:20 AM] (bibinchundatt) YARN-8548. AllocationRespose proto setNMToken initBuilder not done. [Jul 24, 2018 3:53:20 PM] (msingh) HDDS-272. TestBlockDeletingService is failing with [Jul 24, 2018 4:50:17 PM] (sunilg) YARN-7748. [Jul 24, 2018 5:17:03 PM] (xyao) HDDS-282. Consolidate logging in scm/container-service. Contributed by [Jul 24, 2018 5:56:59 PM] (bibinchundatt) YARN-8541. RM startup failure on recovery after user deletion. [Jul 24, 2018 7:46:59 PM] (haibochen) YARN-7133. Clean up lock-try order in fair scheduler. (Szilard Nemeth [Jul 24, 2018 9:32:30 PM] (gera) HADOOP-15612. Improve exception when tfile fails to load LzoCodec. [Jul 24, 2018 11:05:27 PM] (templedf) HDFS-13448. HDFS Block Placement - Ignore Locality for First Block [Jul 25, 2018 4:42:47 AM] (xiao) HDFS-13761. Add toString Method to AclFeature Class. Contributed by [Jul 25, 2018 4:45:43 AM] (xiao) HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. [Jul 25, 2018 8:45:54 AM] (msingh) HDDS-203. Add getCommittedBlockLength API in datanode. Contributed by [Jul 25, 2018 9:35:27 AM] (wwei) YARN-8546. Resource leak caused by a reserved container being released [Jul 25, 2018 12:43:49 PM] (nanda) HDDS-285. Create a generic Metadata Iterator. Contributed by Bharat [Jul 25, 2018 1:25:26 PM] (nanda) HDDS-266. Integrate checksum into .container file. Contributed by [Jul 25, 2018 1:29:05 PM] (bibinchundatt) YARN-8577. Fix the broken anchor in SLS site-doc. Contributed by Weiwei [Jul 25, 2018 2:57:03 PM] (nanda) HDDS-288. Fix bugs in OpenContainerBlockMap. Contributed by Tsz Wo [Jul 25, 2018 3:39:11 PM] (msingh) HADOOP-15395. DefaultImpersonationProvider fails to parse proxy user [Jul 25, 2018 4:22:04 PM] (ericp) YARN-4606. CapacityScheduler: applications could get starved because [Jul 25, 2018 6:04:18 PM] (weichiu) HDFS-11060. make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable. [Jul 25, 2018 10:49:30 PM] (eyang) YARN-8330. Improved publishing ALLOCATED events to ATS. [Jul 26, 2018 10:08:28 AM] (yqlin) HADOOP-15611. Log more details for FairCallQueue. Contributed by Ryan [Jul 26, 2018 1:30:23 PM] (nanda) HDDS-201. Add name for LeaseManager. Contributed by Sandeep Nemuri. [Jul 26, 2018 5:24:32 PM] (xiao) HDFS-13622. mkdir should print the parent directory in the error message [Jul 26, 2018 8:15:55 PM] (xyao) HDDS-277. PipelineStateMachine should handle closure of pipelines in [Jul 26, 2018 8:17:37 PM] (xyao) HDDS-291. Initialize hadoop metrics system in standalone hdds datanodes. [Jul 26, 2018 10:22:57 PM] (eyang) YARN-8545. Return allocated resource to RM for failed container. [Jul 26, 2018 10:35:36 PM] (eyang) HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds. [Jul 27, 2018 12:02:13 AM] (eyang) YARN-8429. Improve diagnostic message when artifact is not set properly. [Jul 27, 2018 1:11:56 PM] (aengineer) HDFS-13727. Log full stack trace if DiskBalancer exits with an unhandled [Jul 27, 2018 2:12:21 PM] (aengineer) HDDS-270. Move generic container util functions to ContianerUtils. [Jul 27, 2018 5:14:01 PM] (arp) HDFS-13765. Fix javadoc for FSDirMkdirOp#createParentDirectories. [Jul 27, 2018 6:30:19 PM] (billie) YARN-8571. Validate service principal format prior to launching yarn [Jul 27, 2018 9:32:34 PM] (rkanter) YARN-8566. Add diagnostic message for unschedulable containers (snemeth [Jul 27, 2018 9:35:03 PM] (rkanter) YARN-8517. getContainer and getContainers ResourceManager REST API [Jul 27, 2018 10:23:57 PM] (inigoiri) YARN-8596. Allow SQLFederationStateStore to submit the same app in the [Jul 27, 2018 11:33:58 PM] (eyang) YARN-8508. Release GPU resource for killed container. [Jul 28, 2018 12:23:29 AM] (mackrorysd) HADOOP-15636. Follow-up from HADOOP-14918; restoring test under new [Jul 28, 2018 3:22:39 PM]
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/32/ [May 30, 2018 9:04:19 PM] (hanishakoneru) HDDS-92. Use DBType during parsing datanode .container files. [May 30, 2018 9:04:19 PM] (hanishakoneru) HDDS-90: Create ContainerData, Container classes. Contributed by Bharat [May 31, 2018 5:29:25 PM] (arp) HDDS-116. Implement VolumeSet to manage disk volumes. Contributed by [Jun 4, 2018 10:28:19 PM] (bharat) Create Version File in Datanode. Contributed by Bharat Viswanadham. [Jun 6, 2018 8:59:20 PM] (bharat) HDDS-123:ContainerSet class to manage ContainerMap. Contributed by [Jun 6, 2018 11:21:21 PM] (hanishakoneru) HDDS-140. Add DU usage to VolumeInfo. [Jun 11, 2018 4:04:54 PM] (bharat) HDDS-133:Change format of .container files to Yaml. Contributed by [Jun 11, 2018 7:15:39 PM] (hanishakoneru) Revert "Create Version File in Datanode. Contributed by Bharat [Jun 11, 2018 8:14:03 PM] (bharat) HDDS-136:Rename dbPath,containerFilePath. Contributed by Bharat [Jun 14, 2018 8:28:41 PM] (hanishakoneru) HDDS-156. Implement HDDSVolume to manage volume state [Jun 15, 2018 3:54:54 AM] (bharat) HDDS-155:Implement KeyValueContainer and adopt new disk layout for the [Jun 15, 2018 9:35:33 PM] (bharat) HDDS-160:Refactor KeyManager, ChunkManager. Contributed by Bharat [Jun 28, 2018 5:13:30 PM] (hanishakoneru) HDDS-173. Refactor Dispatcher and implement Handler for new ContainerIO [Jun 28, 2018 9:07:52 PM] (bharat) HDDS-183:Integrate Volumeset, ContainerSet and HddsDispatcher. [Jun 29, 2018 12:10:10 AM] (bharat) HDDS-169:Add Volume IO Stats. Contributed by Bharat Viswanadham [Jul 3, 2018 4:50:25 PM] (hanishakoneru) HDDS-205. Add metrics to HddsDispatcher. Contributed by Bharat [Jul 3, 2018 4:53:41 PM] (hanishakoneru) HDDS-176. Add keyCount and container maximum size to ContainerData. [Jul 5, 2018 6:26:00 PM] (bharat) HDDS-229:Remove singleton for Handler. Contributed by Bharat Viswanadham [Jul 5, 2018 10:23:39 PM] (bharat) HDDS-182:CleanUp Reimplemented classes. Contributed by Hansiha Koneru [Jul 6, 2018 6:01:33 PM] (bharat) HDDS-204. Modify Integration tests for new ContainerIO classes. [Jul 6, 2018 10:02:40 PM] (bharat) HDDS-211. Add a create container Lock. Contributed by Bharat Viswanadham [Jul 6, 2018 11:26:40 PM] (bharat) HDDS-237. Add updateDeleteTransactionId. Contributed by Bharat [Jul 8, 2018 6:11:21 PM] (aengineer) HDDS-217. Move all SCMEvents to a package. Contributed by Anu Engineer. [Jul 8, 2018 6:27:54 PM] (aengineer) HDDS-235. Fix TestOzoneAuditLogger#verifyDefaultLogLevel. Contributed by [Jul 9, 2018 6:27:34 AM] (yqlin) HDFS-13674. Improve documentation on Metrics. Contributed by Chao Sun. [Jul 9, 2018 7:06:07 AM] (yqlin) HDFS-13710. RBF: setQuota and getQuotaUsage should check the [Jul 9, 2018 1:17:21 PM] (wang) HDFS-13719. Docs around dfs.image.transfer.timeout are misleading. [Jul 9, 2018 4:33:09 PM] (hanishakoneru) HDDS-213. Single lock to synchronize KeyValueContainer#update. [Jul 9, 2018 5:37:20 PM] (rkanter) Only mount non-empty directories for cgroups [Jul 9, 2018 6:30:08 PM] (wangda) YARN-8506. Make GetApplicationsRequestPBImpl thread safe. (wangda) [Jul 9, 2018 7:01:52 PM] (xiao) HADOOP-15591. KMSClientProvider should log KMS DT acquisition at INFO [Jul 9, 2018 7:06:50 PM] (xiao) HADOOP-15581. Set default jetty log level to INFO in KMS. Contributed by [Jul 9, 2018 7:10:12 PM] (aengineer) HDDS-224. Create metrics for Event Watcher. Contributed by Elek, Marton. [Jul 9, 2018 7:27:36 PM] (gifuma) YARN-7899. [AMRMProxy] Stateful FederationInterceptor for pending [Jul 9, 2018 7:43:38 PM] (aajisaka) HADOOP-15568. fix some typos in the .sh comments. Contributed by Steve [Jul 9, 2018 8:02:40 PM] (aengineer) HDDS-224. Create metrics for Event Watcher. Contributed b Elek, Marton. [Jul 9, 2018 8:03:57 PM] (aengineer) Revert "HDDS-224. Create metrics for Event Watcher." [Jul 9, 2018 8:04:44 PM] (aengineer) HDDS-240. Implement metrics for EventQueue. Contributed by Elek, Marton. [Jul 9, 2018 8:22:30 PM] (arp) HDDS-48. Fix branch after merging from trunk. [Jul 10, 2018 9:43:59 AM] (stevel) HADOOP-15384. distcp numListstatusThreads option doesn't get to -delete [Jul 10, 2018 2:41:47 PM] (sunilg) YARN-8473. Containers being launched as app tears down can leave [Jul 10, 2018 3:52:57 PM] (mackrorysd) HADOOP-15541. [s3a] Shouldn't try to drain stream before aborting [Jul 10, 2018 5:36:17 PM] (gifuma) YARN-8502. Use path strings consistently for webservice endpoints in [Jul 10, 2018 7:17:44 PM] (aw) HDFS-13722. HDFS Native Client Fails Compilation on Ubuntu 18.04 [Jul 10, 2018 9:07:23 PM] (xyao) HDDS-208. ozone createVolume command ignores the first character of the [Jul 10, 2018 10:58:47 PM] (aengineer) HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event and [Jul 11, 2018 6:56:32 AM] (sunilg) YARN-8512. ATSv2 entities are not published to HBase from second attempt [Jul 11, 2018 10:50:29 AM] (bibinchundatt) YARN-8491.
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/30/ [Jun 25, 2018 1:15:31 AM] (wwei) YARN-8443. Total #VCores in cluster metrics is wrong when [Jun 25, 2018 1:38:57 PM] (stevel) HADOOP-14396. Add builder interface to FileContext. Contributed by Lei [Jun 25, 2018 4:50:27 PM] (inigoiri) HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on [Jun 25, 2018 5:38:03 PM] (rohithsharmaks) YARN-8457. Compilation is broken with -Pyarn-ui. [Jun 25, 2018 8:05:22 PM] (aengineer) HDDS-191. Queue SCMCommands via EventQueue in SCM. Contributed by Elek, [Jun 25, 2018 8:59:41 PM] (mackrorysd) HADOOP-15423. Merge fileCache and dirCache into ine single cache in [Jun 25, 2018 10:36:45 PM] (todd) HADOOP-15550. Avoid static initialization of ObjectMappers [Jun 25, 2018 10:47:54 PM] (miklos.szegedi) YARN-8438. TestContainer.testKillOnNew flaky on trunk. Contributed by [Jun 26, 2018 4:12:05 AM] (Bharat) HDDS-192:Create new SCMCommand to request a replication of a container. [Jun 26, 2018 6:25:15 PM] (eyang) YARN-8214. Change default RegistryDNS port. Contributed by [Jun 26, 2018 9:34:57 PM] (eyang) YARN-8108. Added option to disable loading existing filters to prevent [Jun 26, 2018 10:21:35 PM] (miklos.szegedi) YARN-8461. Support strict memory control on individual container with [Jun 27, 2018 2:25:57 AM] (wangda) YARN-8423. GPU does not get released even though the application gets [Jun 27, 2018 2:27:17 AM] (wangda) YARN-8464. Async scheduling thread could be interrupted when there are [Jun 27, 2018 5:35:15 PM] (sunilg) YARN-8401. [UI2] new ui is not accessible with out internet connection. [Jun 27, 2018 7:39:15 PM] (xyao) HDDS-194. Remove NodePoolManager and node pool handling from SCM. [Jun 27, 2018 8:25:45 PM] (xyao) Revert "HDDS-194. Remove NodePoolManager and node pool handling from [Jun 27, 2018 8:28:00 PM] (xyao) HDDS-194. Remove NodePoolManager and node pool handling from SCM. [Jun 27, 2018 8:35:30 PM] (xyao) HDDS-186. Create under replicated queue. Contributed by Ajay Kumar. [Jun 27, 2018 8:56:45 PM] (xyao) HDDS-170. Fix TestBlockDeletingService#testBlockDeletionTimeout. [Jun 27, 2018 9:15:15 PM] (aengineer) HDDS-94. Change ozone datanode command to start the standalone datanode [Jun 27, 2018 9:18:25 PM] (aengineer) HDDS-193. Make Datanode heartbeat dispatcher in SCM event based. [Jun 28, 2018 5:37:22 AM] (aajisaka) HADOOP-15495. Upgrade commons-lang version to 3.7 in [Jun 28, 2018 5:58:40 AM] (aajisaka) HADOOP-14313. Replace/improve Hadoop's byte[] comparator. Contributed by [Jun 28, 2018 6:39:33 AM] (aengineer) HDDS-195. Create generic CommandWatcher utility. Contributed by Elek, [Jun 28, 2018 4:21:56 PM] (Bharat) HDFS-13705:The native ISA-L library loading failure should be made [Jun 28, 2018 4:39:49 PM] (eyang) YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService. [Jun 28, 2018 5:23:31 PM] (sunilg) YARN-8379. Improve balancing resources in already satisfied queues by [Jun 28, 2018 10:41:39 PM] (nanda) HDDS-185: TestCloseContainerByPipeline#testCloseContainerViaRatis fail [Jun 28, 2018 11:07:16 PM] (nanda) HDDS-178: DN should update transactionId on block delete. Contributed by [Jun 29, 2018 4:56:13 PM] (inigoiri) HDFS-13707. [PROVIDED Storage] Fix failing integration tests in [Jun 29, 2018 5:02:53 PM] (sunilg) YARN-8455. Add basic ACL check for all ATS v2 REST APIs. Contributed by [Jun 29, 2018 5:21:25 PM] (rohithsharmaks) YARN-8469. [UI2] URL needs to be trimmed to handle index.html [Jun 29, 2018 6:06:28 PM] (jlowe) YARN-8451. Multiple NM heartbeat thread created when a slow NM resync [Jun 29, 2018 6:18:32 PM] (ericp) HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan. [Jun 29, 2018 6:47:30 PM] (gifuma) YARN-8481. AMRMProxyPolicies should accept heartbeat response from -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite pathlen shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace Specific tests: Failed junit tests : hadoop.security.authentication.util.TestKerberosName hadoop.security.authentication.server.TestAltKerberosAuthenticationHandler hadoop.security.authentication.client.TestKerberosAuthenticator mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/30/artifact/out/patch-mvninstall-root.txt [120K] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/30/artifact/out/patch-compile-root.txt [56K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/30/artifact/out/patch-compile-root.txt [56K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/30/artifact/out/patch-compile-root.txt [56K] checkstyle:
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/ [Jun 17, 2018 6:54:26 PM] (cdouglas) HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs [Jun 18, 2018 6:12:18 AM] (cdouglas) HADOOP-15533. Make WASB listStatus messages consistent. Contributed by [Jun 18, 2018 6:48:49 AM] (msingh) HDDS-141. Remove PipeLine Class from SCM and move the data field in the [Jun 18, 2018 5:17:07 PM] (aajisaka) HDFS-13621. Upgrade commons-lang version to 3.7 in hadoop-hdfs-project. [Jun 18, 2018 6:28:22 PM] (eyang) HADOOP-15527. Improve delay check for stopping processes. [Jun 18, 2018 9:25:11 PM] (aajisaka) MAPREDUCE-7063. Fix log level inconsistency in [Jun 18, 2018 11:45:50 PM] (aajisaka) YARN-7668. Remove unused variables from ContainerLocalizer [Jun 19, 2018 5:38:13 PM] (eyang) HADOOP-15527. Improve delay check for stopping processes. [Jun 20, 2018 5:42:13 PM] (haibochen) YARN-8437. Build oom-listener fails on older versions. (Miklos Szegedi [Jun 20, 2018 5:59:33 PM] (miklos.szegedi) YARN-8391. Investigate AllocationFileLoaderService.reloadListener [Jun 20, 2018 6:36:12 PM] (miklos.szegedi) YARN-8440. Typo in YarnConfiguration javadoc: "Miniumum request [Jun 20, 2018 6:40:56 PM] (miklos.szegedi) YARN-7449. Split up class TestYarnClient to TestYarnClient and [Jun 20, 2018 6:55:43 PM] (miklos.szegedi) YARN-8442. Strange characters and missing spaces in FairScheduler [Jun 20, 2018 6:58:18 PM] (miklos.szegedi) YARN-8441. Typo in CSQueueUtils local variable names: [Jun 20, 2018 7:04:44 PM] (miklos.szegedi) MAPREDUCE-7113. Typos in test names in TestTaskAttempt: [Jun 20, 2018 10:45:08 PM] (mackrorysd) HADOOP-14918. Remove the Local Dynamo DB test option. Contributed by [Jun 20, 2018 10:58:26 PM] (xiao) HDFS-13682. Cannot create encryption zone after KMS auth token expires. [Jun 20, 2018 11:43:10 PM] (todd) HADOOP-15551. Avoid use of Arrays.stream in Configuration.addTags [Jun 21, 2018 3:20:24 PM] (eyang) YARN-8445. Improved error message for duplicated service and component [Jun 21, 2018 5:32:52 PM] (todd) HADOOP-15549. Upgrade to commons-configuration 2.1 regresses task CPU [Jun 22, 2018 1:24:10 AM] (inigoiri) YARN-8412. Move ResourceRequest.clone logic everywhere into a proper [Jun 22, 2018 2:50:54 AM] (yqlin) HDFS-13692. StorageInfoDefragmenter floods log when compacting [Jun 22, 2018 5:15:29 PM] (ericp) YARN-8444: NodeResourceMonitor crashes on bad swapFree value. [Jun 22, 2018 5:36:56 PM] (mackrorysd) HADOOP-15416. Clear error message in S3Guard diff if source not found. [Jun 22, 2018 8:05:41 PM] (miklos.szegedi) MAPREDUCE-7114. Make FrameworkUploader symlink ignore improvement. [Jun 22, 2018 9:03:55 PM] (yufei_gu) YARN-8184. Too many metrics if [Jun 22, 2018 11:12:48 PM] (eyang) YARN-8326. Removed exit code file check for launched container. [Jun 23, 2018 10:49:44 PM] (aengineer) HDDS-184. Upgrade common-langs version to 3.7 in [Jun 24, 2018 8:05:04 AM] (aengineer) HDDS-177. Create a releasable ozonefs artifact Contributed by Marton, -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite pathlen shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace Specific tests: Failed junit tests : hadoop.security.authentication.util.TestKerberosName hadoop.security.authentication.server.TestAltKerberosAuthenticationHandler hadoop.security.authentication.client.TestKerberosAuthenticator mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/patch-mvninstall-root.txt [120K] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/patch-compile-root.txt [52K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/patch-compile-root.txt [52K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/patch-compile-root.txt [52K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/diff-checkstyle-root.txt [4.0K] mvnsite: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/patch-mvnsite-root.txt [36K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/29/artifact/out/diff-patch-shelldocs.txt [16K] whitespace:
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/28/ [Jun 11, 2018 5:53:37 AM] (sammi.chen) HADOOP-15499. Performance severe drops when running [Jun 11, 2018 6:12:44 PM] (haibochen) YARN-8323. FairScheduler.allocConf should be declared as volatile. [Jun 11, 2018 6:16:21 PM] (haibochen) YARN-8322. Change log level when there is an IOException when the [Jun 11, 2018 6:19:33 PM] (haibochen) YARN-8321. AllocationFileLoaderService.getAllocationFile() should be [Jun 11, 2018 6:20:29 PM] (inigoiri) HDFS-13653. Make dfs.client.failover.random.order a per nameservice [Jun 11, 2018 10:13:18 PM] (yzhang) Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release. (cherry [Jun 11, 2018 11:02:32 PM] (xyao) HDDS-72. Add deleteTransactionId field in ContainerInfo. Contributed by [Jun 12, 2018 2:25:56 AM] (inigoiri) YARN-8370. Some Node Manager tests fail on Windows due to improper [Jun 12, 2018 11:43:09 AM] (rohithsharmaks) YARN-8405. RM zk-state-store.parent-path ACLs has been changed since [Jun 12, 2018 11:44:22 AM] (rohithsharmaks) YARN-8413. Flow activity page is failing with 'Timeline server failed [Jun 12, 2018 12:10:41 PM] (sunilg) YARN-8419. [UI2] User cannot submit a new service as submit button is [Jun 12, 2018 3:06:23 PM] (msingh) HDDS-158. DatanodeStateMachine endPoint task throws [Jun 12, 2018 3:25:18 PM] (aengineer) HDDS-111. Include tests for Rest Client in TestVolume and TestBucket. [Jun 12, 2018 3:35:37 PM] (aajisaka) YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. [Jun 12, 2018 4:03:55 PM] (xyao) HDDS-130. TestGenerateOzoneRequiredConfigurations should use [Jun 12, 2018 5:03:34 PM] (haibochen) YARN-6931. Make the aggregation interval in AppLevelTimelineCollector [Jun 12, 2018 5:11:30 PM] (haibochen) YARN-8325. Miscellaneous QueueManager code clean up. (Szilard Nemeth via [Jun 12, 2018 5:24:34 PM] (inigoiri) HADOOP-15529. ContainerLaunch#testInvalidEnvVariableSubstitutionType is [Jun 12, 2018 5:59:50 PM] (inigoiri) YARN-8422. TestAMSimulator failing with NPE. Contributed by Giovanni [Jun 12, 2018 6:16:24 PM] (xiao) HADOOP-15307. NFS: flavor AUTH_SYS should use VerifierNone. Contributed [Jun 12, 2018 6:21:51 PM] (gera) MAPREDUCE-7108. TestFileOutputCommitter fails on Windows. (Zuoming Zhang [Jun 12, 2018 9:16:14 PM] (inigoiri) HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. [Jun 12, 2018 10:36:52 PM] (arun suresh) MAPREDUCE-7101. Add config parameter to allow JHS to alway scan user dir [Jun 13, 2018 12:40:32 AM] (eyang) HADOOP-15527. Improve delay check for stopping processes. [Jun 13, 2018 1:28:05 AM] (wwei) YARN-8394. Improve data locality documentation for Capacity Scheduler. [Jun 13, 2018 7:36:02 AM] (jitendra) HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh [Jun 13, 2018 10:39:16 AM] (sunilg) YARN-8404. Timeline event publish need to be async to avoid Dispatcher [Jun 13, 2018 12:05:55 PM] (yqlin) HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun. [Jun 13, 2018 4:50:10 PM] (aengineer) HDDS-109. Add reconnect logic for XceiverClientGrpc. Contributed by [Jun 13, 2018 6:43:18 PM] (xyao) HDDS-159. RestClient: Implement list operations for volume, bucket and [Jun 13, 2018 11:05:52 PM] (eyang) YARN-8411. Restart stopped system service during RM start. [Jun 13, 2018 11:24:31 PM] (eyang) YARN-8259. Improve privileged docker container liveliness checks. [Jun 14, 2018 1:48:59 AM] (aengineer) HDDS-161. Add functionality to queue ContainerClose command from SCM [Jun 14, 2018 3:18:22 AM] (aengineer) HDDS-163. Add Datanode heartbeat dispatcher in SCM. Contributed by [Jun 14, 2018 7:08:10 AM] (rohithsharmaks) YARN-8155. Improve ATSv2 client logging in RM and NM publisher. [Jun 14, 2018 4:58:50 PM] (inigoiri) HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by [Jun 14, 2018 7:54:21 PM] (eyang) YARN-8410. Fixed a bug in A record lookup by CNAME record. [Jun 14, 2018 8:14:25 PM] (Bharat) YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil [Jun 14, 2018 8:43:14 PM] (inigoiri) HDFS-13675. Speed up TestDFSAdminWithHA. Contributed by Lukas Majercak. [Jun 14, 2018 9:14:24 PM] (aengineer) HDDS-146. Refactor the structure of the acceptance tests. Contributed by [Jun 15, 2018 9:28:20 AM] (msingh) HDFS-13679. Fix Typo in javadoc for ScanInfoPerBlockPool#addAll. [Jun 15, 2018 4:40:45 PM] (inigoiri) HADOOP-15537. Clean up ContainerLaunch and ContainerExecutor [Jun 15, 2018 5:33:28 PM] (inigoiri) HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming [Jun 15, 2018 8:07:54 PM] (inigoiri) HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming [Jun 15, 2018 8:36:46 PM] (weichiu) HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by [Jun 15, 2018 9:10:17 PM] (aengineer) HDDS-172. The numbers of operation should be integer in KSM UI. [Jun 15,
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/27/ [Jun 3, 2018 3:12:35 AM] (inigoiri) HDFS-13651. TestReencryptionHandler fails on Windows. Contributed by [Jun 3, 2018 3:19:59 AM] (inigoiri) HDFS-13648. Fix TestGetConf#testGetJournalNodes on Windows due to a [Jun 3, 2018 3:25:42 AM] (inigoiri) MAPREDUCE-7102. Fix TestJavaSerialization for Windows due a mismatch [Jun 3, 2018 6:38:26 PM] (sunilg) YARN-8276. [UI2] After version field became mandatory, form-based [Jun 4, 2018 5:33:34 AM] (xiao) HDFS-13339. Volume reference can't be released and may lead to deadlock [Jun 4, 2018 2:03:05 PM] (weichiu) HDFS-13155. BlockPlacementPolicyDefault.chooseTargetInOrder Not Checking [Jun 4, 2018 2:19:03 PM] (shahrs87) HDFS-13281 Namenode#createFile should be /.reserved/raw/ aware.. [Jun 4, 2018 3:55:01 PM] (xyao) HDDS-126. Fix findbugs warning in MetadataKeyFilters.java. Contributed [Jun 4, 2018 4:15:23 PM] (haibochen) YARN-8390. Fix API incompatible changes in FairScheduler's [Jun 4, 2018 4:28:09 PM] (inigoiri) YARN-8389. Improve the description of machine-list property in [Jun 4, 2018 4:51:04 PM] (xyao) HDDS-145. Freon times out because of because of wrong ratis port number [Jun 4, 2018 5:41:10 PM] (miklos.szegedi) YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian. [Jun 4, 2018 7:55:54 PM] (inigoiri) MAPREDUCE-7105. Fix TestNativeCollectorOnlyHandler.testOnCall on Windows [Jun 4, 2018 9:23:08 PM] (haibochen) YARN-8388. TestCGroupElasticMemoryController.testNormalExit() hangs on [Jun 4, 2018 10:32:03 PM] (rkanter) YARN-4677. RMNodeResourceUpdateEvent update from scheduler can lead to [Jun 4, 2018 11:06:28 PM] (eyang) YARN-8365. Set DNS query type according to client request. [Jun 4, 2018 11:37:07 PM] (Bharat) HADOOP-15137. ClassNotFoundException: [Jun 5, 2018 1:12:43 AM] (inigoiri) HDFS-13652. Randomize baseDir for MiniDFSCluster in TestBlockScanner. [Jun 5, 2018 1:21:38 AM] (inigoiri) HDFS-13649. Randomize baseDir for MiniDFSCluster in [Jun 5, 2018 1:28:11 AM] (inigoiri) HDFS-13650. Randomize baseDir for MiniDFSCluster in [Jun 5, 2018 4:13:47 AM] (xiao) HADOOP-15507. Add MapReduce counters about EC bytes read. [Jun 5, 2018 8:53:24 AM] (aajisaka) HDFS-13545. "guarded" is misspelled as "gaurded" in [Jun 5, 2018 1:58:24 PM] (rohithsharmaks) YARN-8396. Click on an individual container continuously spins and [Jun 5, 2018 3:34:44 PM] (xyao) HDDS-148. Remove ContainerReportManager and ContainerReportManagerImpl. [Jun 5, 2018 5:31:42 PM] (aengineer) HDDS-129. Support for ReportManager in Datanode. Contributed by Nanda [Jun 5, 2018 6:51:29 PM] (cliang) HDFS-13547. Add ingress port based sasl resolver. Contributed by Chen [Jun 5, 2018 7:24:57 PM] (inigoiri) MAPREDUCE-7103. Fix TestHistoryViewerPrinter on windows due to a [Jun 6, 2018 4:18:31 AM] (xiao) HADOOP-15217. FsUrlConnection does not handle paths with spaces. [Jun 6, 2018 4:25:08 AM] (xiao) HDFS-13511. Provide specialized exception when block length cannot be [Jun 6, 2018 8:04:55 AM] (sunilg) HADOOP-15514. NoClassDefFoundError for TimelineCollectorManager when [Jun 6, 2018 3:39:18 PM] (aengineer) HDDS-107. TestOzoneConfigurationFields is failing. Contributed by LiXin [Jun 6, 2018 5:28:14 PM] (stevel) HADOOP-15506. Upgrade Azure Storage Sdk version to 7.0.0 and update [Jun 6, 2018 6:44:17 PM] (inigoiri) HADOOP-15513. Add additional test cases to cover some corner cases for [Jun 7, 2018 4:46:02 AM] (brahma) HDFS-12950. [oiv] ls will fail in secure cluster. Contributed by [Jun 7, 2018 4:55:56 AM] (rohithsharmaks) YARN-8399. NodeManager is giving 403 GSS exception post upgrade to 3.1 [Jun 7, 2018 2:55:49 PM] (stevel) HADOOP-15512. Clean up Shell from JDK7 workarounds. Contributed by Zsolt [Jun 7, 2018 3:30:06 PM] (weichiu) HDFS-13659. Add more test coverage for contentSummary for snapshottable [Jun 7, 2018 4:01:15 PM] (rohithsharmaks) YARN-8386. App log can not be viewed from Logs tab in secure cluster. [Jun 7, 2018 6:16:17 PM] (jhc) HDFS-13534. libhdfs++: Fix GCC7 build. Contributed by James Clampffer. [Jun 7, 2018 7:47:58 PM] (Bharat) HDDS-119:Skip Apache license header check for some ozone doc scripts. [Jun 7, 2018 8:02:57 PM] (jhc) HDFS-13615. libhdfs++ SaslProtocol hanging while accessing invalid lock. [Jun 7, 2018 8:34:52 PM] (inigoiri) HADOOP-15516. Add test cases to cover FileUtil#readLink. Contributed by [Jun 7, 2018 9:11:20 PM] (arp) HDDS-147. Update Ozone site docs. Contributed by Arpit Agarwal. [Jun 7, 2018 9:35:22 PM] (aengineer) HDDS-127. Add CloseContainerEventHandler in SCM. Contributed by [Jun 7, 2018 11:10:15 PM] (inigoiri) YARN-8400. Fix typos in YARN Federation documentation page. Contributed [Jun 7, 2018 11:38:23 PM] (miklos.szegedi) YARN-6677. Preempt opportunistic containers when root container cgroup [Jun 8, 2018 12:09:34 AM] (rkanter) Disable mounting cgroups by default (miklos.szeg...@cloudera.com via [Jun 8, 2018 12:13:03 AM] (inigoiri)
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/26/ [May 28, 2018 8:29:59 AM] (aajisaka) HADOOP-15477. Make unjar in RunJar overrideable [May 28, 2018 8:35:49 AM] (rohithsharmaks) MAPREDUCE-7097. MapReduce JHS should honor [May 28, 2018 10:06:34 AM] (aajisaka) HDFS-13628. Update Archival Storage doc for Provided Storage [May 28, 2018 10:41:07 AM] (aajisaka) HADOOP-15449. Increase default timeout of ZK session to avoid frequent [May 28, 2018 11:02:53 AM] (sunilg) YARN-4781. Support intra-queue preemption for fairness ordering policy. [May 28, 2018 5:26:47 PM] (inigoiri) HDFS-13627. TestErasureCodingExerciseAPIs fails on Windows. Contributed [May 28, 2018 11:34:02 PM] (inigoiri) HDFS-13591. TestDFSShell#testSetrepLow fails on Windows. Contributed by [May 28, 2018 11:45:42 PM] (inigoiri) HADOOP-15498. TestHadoopArchiveLogs (#testGenerateScript, [May 29, 2018 12:32:32 AM] (weichiu) HADOOP-15455. Incorrect debug message in KMSACL#hasAccess. Contributed [May 29, 2018 4:00:30 PM] (jlowe) YARN-8338. TimelineService V1.5 doesn't come up after HADOOP-15406. [May 29, 2018 4:11:08 PM] (inigoiri) HADOOP-15497. TestTrash should use proper test path to avoid failing on [May 29, 2018 4:23:11 PM] (wangda) YARN-8339. Service AM should localize static/archive resource types to [May 29, 2018 4:27:36 PM] (wangda) YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma [May 29, 2018 4:54:06 PM] (aengineer) HDDS-125. Cleanup HDDS CheckStyle issues. Contributed by Anu Engineer. [May 29, 2018 7:15:12 PM] (kihwal) Additional check when unpacking archives. Contributed by Wilfred [May 29, 2018 7:43:17 PM] (jlowe) YARN-8329. Docker client configuration can still be set incorrectly. [May 29, 2018 7:48:50 PM] (aengineer) HDDS-81. Moving ContainerReport inside Datanode heartbeat. Contributed [May 29, 2018 8:38:15 PM] (fabbri) HADOOP-14946 S3Guard testPruneCommandCLI can fail. Contributed by Gabor [May 29, 2018 8:48:55 PM] (aengineer) HDDS-114. Ozone Datanode mbean registration fails for StorageLocation. [May 29, 2018 8:56:58 PM] (eyang) YARN-8362. Bugfix logic in container retries in node manager. [May 30, 2018 2:20:22 AM] (fabbri) HADOOP-15480 AbstractS3GuardToolTestBase.testDiffCommand fails when [May 30, 2018 8:52:21 AM] (yqlin) HDFS-13626. Fix incorrect username when deny the setOwner operation. [May 30, 2018 3:52:07 PM] (aengineer) HDDS-88. Create separate message structure to represent ports in [May 30, 2018 4:50:19 PM] (ericp) YARN-8377: Javadoc build failed in hadoop-yarn-server-nodemanager. [May 30, 2018 5:13:52 PM] (inigoiri) HDFS-13632. Randomize baseDir for MiniJournalCluster in MiniQJMHACluster [May 30, 2018 5:22:04 PM] (inigoiri) HDFS-13629. Some tests in TestDiskBalancerCommand fail on Windows due to [May 30, 2018 7:37:43 PM] (billie) YARN-8368. yarn app start cli should print applicationId. Contributed by [May 30, 2018 8:19:13 PM] (billie) YARN-8350. NPE in service AM related to placement policy. Contributed by [May 30, 2018 9:21:13 PM] (aengineer) HDDS-128. Support for DN to SCM signaling. Contributed by Nanda Kumar. [May 31, 2018 9:31:10 AM] (aajisaka) MAPREDUCE-7098. Upgrade common-langs version to 3.7 in [May 31, 2018 12:46:39 PM] (wwei) YARN-8367. Fix NPE in SingleConstraintAppPlacementAllocator when [May 31, 2018 1:46:34 PM] (billie) YARN-8333. Load balance YARN services using RegistryDNS multiple A [May 31, 2018 1:59:21 PM] (mackrorysd) HDFS-13582. Improve backward compatibility for HDFS-13176 (WebHdfs file [May 31, 2018 5:12:38 PM] (inigoiri) HDFS-13631. TestDFSAdmin#testCheckNumOfBlocksInReportCommand should use [May 31, 2018 5:56:17 PM] (Bharat) HADOOP-15490:Multiple declaration of maven-enforcer-plugin found in [May 31, 2018 7:05:50 PM] (aengineer) HDDS-112. OzoneShell should support commands with url without scheme. [May 31, 2018 9:56:32 PM] (shv) HDFS-12978. Fine-grained locking while consuming journal stream. [May 31, 2018 10:20:59 PM] (weichiu) HDFS-13440. Log HDFS file name when client fails to connect. [May 31, 2018 10:26:08 PM] (weichiu) HDFS-13646. DFSAdmin doesn't display specialized help for [May 31, 2018 11:09:33 PM] (weichiu) HADOOP-14783. [KMS] Add missing configuration properties into [May 31, 2018 11:48:33 PM] (vinodkv) YARN-8197. Fixed AM IP Filter and Webapp proxy to redirect app [Jun 1, 2018 12:37:44 AM] (shv) HDFS-13602. Add checkOperation(WRITE) checks in FSNamesystem. [Jun 1, 2018 1:09:36 AM] (eyang) YARN-8308. Fixed YARN Service AM failure with HDFS token renewal. [Jun 1, 2018 5:30:12 AM] (yufei) YARN-7340. Fix the missing time stamp in exception message in Class [Jun 1, 2018 7:54:47 PM] (aengineer) HDDS-137. Cleanup Hdds-ozone CheckStyle Issues. Contributed by Anu [Jun 1, 2018 9:21:35 PM] (aengineer) HDDS-142. TestMetadataStore fails on Windows. Contributed by Íñigo [Jun 1, 2018 9:42:39 PM] (templedf) HDFS-13636. Cross-Site Scripting vulnerability in HttpServer2 [Jun
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/25/ [May 21, 2018 10:12:34 AM] (stevel) HADOOP-15478. WASB: hflush() and hsync() regression. Contributed by [May 21, 2018 1:36:26 PM] (msingh) HDDS-57. TestContainerCloser#testRepeatedClose and [May 21, 2018 3:01:51 PM] (Bharat) HDDS-87:Fix test failures with uninitialized storageLocation field in [May 21, 2018 3:10:41 PM] (haibochen) YARN-8248. Job hangs when a job requests a resource that its queue does [May 21, 2018 5:33:00 PM] (shahrs87) Skip the proxy user check if the ugi has not been initialized. [May 21, 2018 5:38:20 PM] (msingh) HDDS-71. Send ContainerType to Datanode during container creation. [May 21, 2018 8:14:58 PM] (ericp) YARN-8179: Preemption does not happen due to natural_termination_factor [May 21, 2018 11:09:24 PM] (xyao) HDDS-82. Merge ContainerData and ContainerStatus classes. Contributed by [May 22, 2018 8:03:31 AM] (msingh) HADOOP-15474. Rename properties introduced for . Contributed by [May 22, 2018 2:27:08 PM] (jlowe) YARN-8206. Sending a kill does not immediately kill docker containers. [May 22, 2018 4:20:51 PM] (kihwal) HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk [May 22, 2018 5:44:58 PM] (eyang) YARN-7960. Added security flag no-new-privileges for YARN Docker [May 22, 2018 5:49:10 PM] (aengineer) HDDS-89. Create ozone specific inline documentation as part of the [May 22, 2018 6:38:11 PM] (aengineer) HDDS-74. Rename name of properties related to configuration tags. [May 22, 2018 8:20:42 PM] (aengineer) HDDS-89. Addendum Patch. Create ozone specific inline documentation as [May 22, 2018 8:33:33 PM] (wangda) YARN-8290. SystemMetricsPublisher.appACLsUpdated should be invoked after [May 22, 2018 8:33:33 PM] (wangda) YARN-8332. Incorrect min/max allocation property name in resource types [May 22, 2018 9:24:38 PM] (rkanter) YARN-8273. Log aggregation does not warn if HDFS quota in target [May 22, 2018 9:29:06 PM] (aengineer) HDDS-89. Addendum Patch-1. Create ozone specific inline documentation as [May 22, 2018 10:46:59 PM] (xyao) HDDS-79. Remove ReportState from SCMHeartbeatRequestProto. Contributed [May 23, 2018 1:10:33 AM] (miklos.szegedi) YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and [May 23, 2018 2:56:15 AM] (aengineer) HDDS-49. Standalone protocol should use grpc in place of netty. [May 23, 2018 6:55:20 AM] (wang) HDFS-13601. Optimize ByteString conversions in PBHelper. [May 23, 2018 8:16:23 AM] (aajisaka) Additional check when unpacking archives. Contributed by Jason Lowe and [May 23, 2018 8:45:35 AM] (msingh) HDDS-85. Send Container State Info while sending the container report [May 23, 2018 11:10:09 AM] (sammi.chen) HDFS-13540. DFSStripedInputStream should only allocate new buffers when [May 23, 2018 12:43:44 PM] (skumpf) YARN-8285. Remove unused environment variables from the Docker runtime. [May 23, 2018 1:01:03 PM] (rohithsharmaks) YARN-8297. Incorrect ATS Url used for Wire encrypted cluster.(addendum). [May 23, 2018 3:37:37 PM] (msingh) HDDS-84. The root directory of ozone.tar.gz should contain the version [May 23, 2018 4:29:35 PM] (aengineer) HDDS-44. Ozone: start-ozone.sh fail to start datanode because of [May 23, 2018 4:46:35 PM] (inigoiri) HDFS-13588. Fix TestFsDatasetImpl test failures on Windows. Contributed [May 23, 2018 5:01:53 PM] (aengineer) HDDS-110. Checkstyle is not working in the HDDS precommit hook. [May 23, 2018 5:15:40 PM] (Bharat) HDFS-13589: Add dfsAdmin command to query if upgrade is finalized. [May 23, 2018 5:24:09 PM] (rkanter) HADOOP-15457. Add Security-Related HTTP Response Header in WEBUIs. [May 23, 2018 5:30:12 PM] (arp) HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda [May 23, 2018 6:36:03 PM] (inigoiri) HDFS-13587. TestQuorumJournalManager fails on Windows. Contributed by [May 23, 2018 6:55:31 PM] (inigoiri) YARN-8336. Fix potential connection leak in SchedConfCLI and [May 23, 2018 7:12:08 PM] (inigoiri) HDFS-13493. Reduce the HttpServer2 thread count on DataNodes. [May 23, 2018 9:15:26 PM] (inigoiri) YARN-8344. Missing nm.stop() in TestNodeManagerResync to fix [May 23, 2018 9:43:59 PM] (inigoiri) YARN-8348. Incorrect and missing AfterClass in HBase-tests to fix NPE [May 23, 2018 10:59:30 PM] (inigoiri) YARN-8327. Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on [May 23, 2018 11:35:37 PM] (haibochen) YARN-4599. Set OOM control for memory cgroups. (Miklos Szegedi via Haibo [May 24, 2018 2:57:35 AM] (yqlin) HDFS-13598. Reduce unnecessary byte-to-string transform operation in [May 24, 2018 6:53:47 AM] (rohithsharmaks) YARN-8346. Upgrading to 3.1 kills running containers with error [May 24, 2018 8:49:46 AM] (rohithsharmaks) YARN-8319. More YARN pages need to honor [May 24, 2018 10:23:42 AM] (msingh) HDDS-45. Removal of old OzoneRestClient. Contributed by Lokesh Jain. [May 24, 2018 3:30:39 PM] (skumpf) YARN-6919. Add default volume mount list.
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/24/ [May 14, 2018 6:24:01 AM] (littlezhou) Add 2.9.1 release notes and changes documents [May 14, 2018 6:38:40 AM] (sammichen) Revert "Add 2.9.1 release notes and changes documents" [May 14, 2018 7:14:02 AM] (sammi.chen) Add 2.9.1 release notes and changes documents [May 14, 2018 3:29:31 PM] (sunilg) YARN-8271. [UI2] Improve labeling of certain tables. Contributed by [May 14, 2018 4:05:23 PM] (naganarasimha_gr) YARN-8288. Fix wrong number of table columns in Resource Model doc. [May 14, 2018 4:10:03 PM] (xyao) HDDS-29. Fix TestStorageContainerManager#testRpcPermission. Contributed [May 14, 2018 4:28:39 PM] (xiao) HDFS-13539. DFSStripedInputStream NPE when reportCheckSumFailure. [May 14, 2018 4:55:03 PM] (msingh) HDDS-19. Update ozone to latest ratis snapshot build [May 14, 2018 5:12:08 PM] (hanishakoneru) HDFS-13544. Improve logging for JournalNode in federated cluster. [May 14, 2018 6:08:42 PM] (haibochen) YARN-8130 Race condition when container events are published for KILLED [May 15, 2018 6:31:28 AM] (sunilg) YARN-8266. [UI2] Clicking on application from cluster view should [May 15, 2018 6:43:04 AM] (sunilg) YARN-8166. [UI2] Service page header links are broken. Contributed by [May 15, 2018 6:47:35 AM] (sunilg) YARN-8236. Invalid kerberos principal file name cause NPE in native [May 15, 2018 9:28:19 AM] (wwei) YARN-8278. DistributedScheduling is not working in HA. Contributed by [May 15, 2018 3:13:56 PM] (stevel) HADOOP-15442. ITestS3AMetrics.testMetricsRegister can't know metrics [May 15, 2018 3:19:03 PM] (stevel) HADOOP-15466. Correct units in adl.http.timeout. Contributed by Sean [May 15, 2018 5:21:42 PM] (inigoiri) HDFS-13551. TestMiniDFSCluster#testClusterSetStorageCapacity does not [May 15, 2018 5:27:36 PM] (inigoiri) HDFS-11700. TestHDFSServerPorts#testBackupNodePorts doesn't pass on [May 15, 2018 6:20:32 PM] (inigoiri) HDFS-13548. TestResolveHdfsSymlink#testFcResolveAfs fails on Windows. [May 15, 2018 10:34:54 PM] (inigoiri) HDFS-13567. [May 16, 2018 12:40:39 AM] (eyang) YARN-8081. Add support to upgrade a component. Contributed [May 16, 2018 8:25:31 AM] (aajisaka) YARN-8123. Skip compiling old hamlet package when the Java version is 10 [May 16, 2018 2:23:49 PM] (jlowe) YARN-8284. get_docker_command refactoring. Contributed by Eric Badger [May 16, 2018 4:31:46 PM] (inigoiri) HDFS-13557. TestDFSAdmin#testListOpenFiles fails on Windows. Contributed [May 16, 2018 4:38:26 PM] (eyang) YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder. [May 16, 2018 5:08:49 PM] (inigoiri) HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows. [May 16, 2018 6:28:39 PM] (arp) HDFS-13512. WebHdfs getFileStatus doesn't return ecPolicy. Contributed [May 16, 2018 8:00:01 PM] (haibochen) YARN-7933. [atsv2 read acls] Add TimelineWriter#writeDomain. (Rohith [May 16, 2018 9:17:28 PM] (jlowe) YARN-8071. Add ability to specify nodemanager environment variables [May 17, 2018 2:23:02 AM] (inigoiri) HDFS-13559. TestBlockScanner does not close TestContext properly. [May 17, 2018 10:54:51 AM] (rohithsharmaks) YARN-8297. Incorrect ATS Url used for Wire encrypted cluster. [May 17, 2018 2:23:24 PM] (kihwal) HDFS-13581. DN UI logs link is broken when https is enabled. Contributed [May 17, 2018 3:31:44 PM] (xyao) HDDS-77. Key replication factor and type should be stored per key by [May 17, 2018 3:52:00 PM] (xyao) HDDS-3. Send NodeReport and ContainerReport when datanodes register. [May 17, 2018 4:21:57 PM] (inigoiri) HDFS-13570. TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on [May 17, 2018 6:08:55 PM] (stevel) HADOOP-15469. S3A directory committer commit job fails if _temporary [May 17, 2018 6:16:04 PM] (szegedim) MAPREDUCE-7094. LocalDistributedCacheManager leaves classloaders open, [May 17, 2018 7:47:10 PM] (vinodkv) YARN-8128. Documenting the per-node per-app file limit in YARN log [May 17, 2018 8:35:09 PM] (inigoiri) HDFS-13558. TestDatanodeHttpXFrame does not shut down cluster. [May 17, 2018 9:06:58 PM] (eyang) YARN-8293. Removed "User Name for service" for deploying secure YARN [May 17, 2018 9:16:50 PM] (eyang) YARN-8080. Add restart policy for YARN services. [May 17, 2018 9:29:34 PM] (eyang) YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS [May 17, 2018 9:48:04 PM] (inigoiri) HDFS-13554. TestDatanodeRegistration#testForcedRegistration does not [May 17, 2018 10:21:26 PM] (aengineer) HDDS-73. Add acceptance tests for Ozone Shell. Contributed by Lokesh [May 17, 2018 11:13:28 PM] (aengineer) HDDS-38. Add SCMNodeStorage map in SCM class to store storage statistics [May 17, 2018 11:53:23 PM] (inigoiri) HDFS-13556. TestNestedEncryptionZones does not shut down cluster. [May 18, 2018 12:03:23 AM] (inigoiri) HDFS-13560. Insufficient system resources exist to complete the [May 18, 2018 12:56:04 AM] (eyang) YARN-8141.
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/23/ [May 6, 2018 4:15:14 PM] (aajisaka) MAPREDUCE-7093. Use assertEquals instead of assertTrue(a == b) in [May 7, 2018 3:33:14 AM] (wwei) YARN-8025. UsersManangers#getComputedResourceLimitForActiveUsers throws [May 7, 2018 10:54:08 AM] (stevel) HADOOP-15446. WASB: PageBlobInputStream.skip breaks HBASE replication. [May 7, 2018 8:32:27 PM] (xiao) Revert "HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to [May 7, 2018 8:32:27 PM] (xiao) Revert "HADOOP-14445. Delegation tokens are not shared between KMS [May 7, 2018 9:58:52 PM] (aengineer) HDDS-1. Remove SCM Block DB. Contributed by Xiaoyu Yao. [May 7, 2018 10:36:29 PM] (xiao) HDFS-12981. renameSnapshot a Non-Existent snapshot to itself should [May 8, 2018 1:29:50 AM] (xyao) HDDS-27. Fix TestStorageContainerManager#testBlockDeletionTra;nsactions. [May 8, 2018 5:05:19 AM] (sunilg) YARN-5151. [UI2] Support kill application from new YARN UI. Contributed [May 8, 2018 6:07:03 AM] (sunilg) YARN-8251. [UI2] Clicking on Application link at the header goes to [May 8, 2018 6:58:54 AM] (rohithsharmaks) YARN-8253. HTTPS Ats v2 api call fails with 'bad HTTP parsed'. [May 8, 2018 12:41:33 PM] (msingh) HDDS-23. Remove SCMNodeAddressList from SCMRegisterRequestProto. [May 8, 2018 6:34:45 PM] (wangda) YARN-8232. RMContainer lost queue name when RM HA happens. (Hu Ziqian [May 8, 2018 8:30:36 PM] (jlowe) YARN-8207. Docker container launch use popen have risk of shell [May 8, 2018 8:49:41 PM] (billie) YARN-7894. Improve ATS response for DShell DS_CONTAINER when container [May 8, 2018 10:29:54 PM] (fabbri) HADOOP-13649 s3guard: implement time-based (TTL) expiry for [May 9, 2018 1:58:42 AM] (fabbri) HADOOP-15420 s3guard ITestS3GuardToolLocal failures in diff tests (Gabor [May 9, 2018 4:51:41 AM] (msingh) HDDS-33. Ozone : Fix the test logic in [May 9, 2018 6:30:43 AM] (rohithsharmaks) YARN-8239. [UI2] Clicking on Node Manager UI under AM container info / [May 9, 2018 6:34:31 AM] (rohithsharmaks) YARN-8264. [UI2] GPU Info tab disappears if we click any sub link under [May 9, 2018 6:47:04 AM] (rohithsharmaks) YARN-8260. [UI2] Per-application tracking URL is no longer available in [May 9, 2018 1:36:07 PM] (msingh) HDDS-20. Ozone: Add support for rename key within a bucket for rpc [May 9, 2018 2:50:21 PM] (msingh) HDDS-28. Ozone:Duplicate declaration in [May 9, 2018 5:32:51 PM] (eyang) YARN-8261. Fixed a bug in creation of localized container directory. [May 9, 2018 9:15:51 PM] (mackrorysd) HADOOP-15356. Make HTTP timeout configurable in ADLS connector. [May 9, 2018 11:52:09 PM] (inigoiri) HDFS-13537. TestHdfsHelper does not generate jceks path properly for [May 10, 2018 3:45:46 AM] (bibinchundatt) YARN-8201. Skip stacktrace of few exception from ClientRMService. [May 10, 2018 5:17:48 AM] (vrushali) YARN-8247 Incorrect HTTP status code returned by ATSv2 for [May 10, 2018 6:00:13 AM] (aengineer) HDDS-18. Ozone Shell should use RestClient and RpcClient. Contributed by [May 10, 2018 9:38:08 AM] (aajisaka) HADOOP-15354. hadoop-aliyun & hadoop-azure modules to mark hadoop-common [May 10, 2018 4:31:59 PM] (rkanter) YARN-8202. DefaultAMSProcessor should properly check units of requested [May 10, 2018 4:41:16 PM] (inigoiri) HADOOP-15454. TestRollingFileSystemSinkWithLocal fails on Windows. [May 10, 2018 5:46:55 PM] (haibochen) MAPREDUCE-7095. Race conditions in closing FadvisedChunkedFile. (Miklos [May 10, 2018 6:01:01 PM] (haibochen) YARN-7715. Support NM promotion/demotion of running containers. (Miklos [May 10, 2018 6:36:25 PM] (aengineer) HDDS-30. Fix TestContainerSQLCli. Contributed by Shashikant Banerjee. [May 10, 2018 6:44:14 PM] (aengineer) HDDS-42. Inconsistent module names and descriptions. Contributed by Tsz [May 10, 2018 7:43:13 PM] (aengineer) HDDS-31. Fix TestSCMCli. Contributed by Lokesh Jain. [May 10, 2018 9:49:58 PM] (xyao) HDDS-16. Remove Pipeline from Datanode Container Protocol protobuf [May 10, 2018 11:27:21 PM] (aengineer) HDDS-37. Remove dependency of hadoop-hdds-common and [May 11, 2018 12:08:26 AM] (aengineer) HDDS-34. Remove .meta file during creation of container Contributed by [May 11, 2018 12:24:40 AM] (Bharat) HDDS-43: Rename hdsl to hdds in hadoop-ozone/acceptance-test/README.md. [May 11, 2018 2:05:35 AM] (vinodkv) YARN-8249. Fixed few REST APIs in RMWebServices to have static-user [May 11, 2018 2:47:04 AM] (wwei) YARN-7003. DRAINING state of queues is not recovered after RM restart. [May 11, 2018 6:51:30 AM] (yqlin) HDFS-13346. RBF: Fix synchronization of router quota and nameservice [May 11, 2018 4:47:57 PM] (inigoiri) HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails [May 11, 2018 5:20:04 PM] (aengineer) HDDS-47. Add acceptance tests for Ozone Shell. Contributed by Lokesh [May 11, 2018 6:08:45 PM] (aengineer) HDDS-39. Ozone: Compile Ozone/HDFS/Cblock protobuf files with proto3 [May 11, 2018 6:23:16
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/22/ [Apr 30, 2018 4:20:58 PM] (aengineer) HDDS-11. Fix findbugs exclude rules for ozone and hdds projects. [Apr 30, 2018 6:54:30 PM] (kkaranasos) YARN-8195. Fix constraint cardinality check in the presence of multiple [Apr 30, 2018 8:28:33 PM] (inigoiri) HDFS-13283. Percentage based Reserved Space Calculation for DataNode. [Apr 30, 2018 11:02:57 PM] (fabbri) HADOOP-15239 S3ABlockOutputStream.flush() be no-op when stream closed. [Apr 30, 2018 11:12:53 PM] (eyang) YARN-8228. Added hostname length check for docker container. [May 1, 2018 1:47:10 AM] (wwei) YARN-8212. Pending backlog for async allocation threads should be [May 1, 2018 4:41:10 AM] (aengineer) HDDS-13. Refactor StorageContainerManager into seperate RPC endpoints. [May 1, 2018 8:31:34 AM] (sunilg) YARN-8187. [UI2] Individual Node page does not contain breadcrumb trail. [May 1, 2018 2:27:47 PM] (billie) YARN-2674. Fix distributed shell AM container relaunch during RM work [May 1, 2018 3:12:46 PM] (inigoiri) HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao [May 1, 2018 8:46:34 PM] (eyang) YARN-7799. Improved YARN service jar file handling. [May 1, 2018 9:19:53 PM] (jlowe) MAPREDUCE-7086. Add config to allow FileInputFormat to ignore [May 1, 2018 9:32:40 PM] (stevel) HADOOP-15250. Split-DNS MultiHomed Server Network Cluster Network IPC [May 2, 2018 6:49:39 AM] (yqlin) HDFS-13488. RBF: Reject requests when a Router is overloaded. [May 2, 2018 7:14:28 AM] (aajisaka) MAPREDUCE-7073. Optimize TokenCache#obtainTokensForNamenodesInternal [May 2, 2018 8:09:22 AM] (aajisaka) HADOOP-15377. Improve debug messages in MetricsConfig.java [May 2, 2018 8:30:10 AM] (aajisaka) HADOOP-15406. hadoop-nfs dependencies for mockito and junit are not test [May 2, 2018 9:14:02 AM] (aajisaka) YARN-6385. Fix checkstyle warnings in [May 2, 2018 9:54:46 AM] (wwei) YARN-8222. Fix potential NPE when gets RMApp from RM context. [May 2, 2018 12:33:56 PM] (stevel) HADOOP-12071. conftest is not documented. Contributed by Kengo Seki. [May 2, 2018 3:49:12 PM] (jhc) HDFS-11807. libhdfs++: Get minidfscluster tests running under valgrind. [May 2, 2018 6:33:31 PM] (eyang) YARN-8209. Fixed NPE in Yarn Service deletion. Contributed [May 2, 2018 6:49:56 PM] (kkaranasos) YARN-8113. Update placement constraints doc with application namespaces [May 2, 2018 7:54:49 PM] (aengineer) HDDS-15. Add memory profiler support to Genesis. Contributed by Anu [May 3, 2018 12:07:19 AM] (eyang) YARN-8194. Fixed reinitialization error for LinuxContainerExecutor. [May 3, 2018 12:13:40 AM] (templedf) HDFS-13481. TestRollingFileSystemSinkWithHdfs#testFlushThread: test [May 3, 2018 12:23:17 AM] (inigoiri) YARN-8151. Yarn RM Epoch should wrap around. Contributed by Young Chen. [May 3, 2018 3:30:31 AM] (mackrorysd) HADOOP-15434. Upgrade to ADLS SDK that exposes current timeout. [May 3, 2018 9:13:40 AM] (rohithsharmaks) YARN-8217. RmAuthenticationFilterInitializer and [May 3, 2018 5:27:07 PM] (eyang) YARN-7961. Improve status message for YARN service. [May 3, 2018 5:35:40 PM] (eyang) YARN-8226. Improved anti-affinity description in YARN Service doc. [May 3, 2018 6:24:57 PM] (inigoiri) HDFS-13525. RBF: Add unit test TestStateStoreDisabledNameservice. [May 4, 2018 3:53:55 PM] (billie) YARN-7818. Remove privileged operation warnings during container launch [May 4, 2018 4:27:07 PM] (billie) YARN-8079. Support static and archive unmodified local resources in [May 4, 2018 4:36:31 PM] (eyang) YARN-8223. Improved yarn auxiliary service to load jar file from HDFS. [May 4, 2018 6:34:45 PM] (fabbri) HADOOP-15444 ITestS3GuardToolDynamo should only run with -Ddynamo (Aaron [May 4, 2018 8:36:13 PM] (shahrs87) HADOOP-14841 Kms client should disconnect if unable to get output stream [May 4, 2018 9:59:59 PM] (inigoiri) YARN-8163. Add support for Node Labels in opportunistic scheduling. [May 4, 2018 11:38:30 PM] (fabbri) HDFS-5926 Documentation should clarify dfs.datanode.du.reserved impact -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace Specific tests: Failed junit tests : hadoop.security.authentication.util.TestKerberosName hadoop.security.authentication.server.TestAltKerberosAuthenticationHandler hadoop.security.authentication.client.TestKerberosAuthenticator mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/22/artifact/out/patch-mvninstall-root.txt [152K] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/22/artifact/out/patch-compile-root.txt [88K] cc:
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/21/ [Apr 22, 2018 3:07:19 PM] (arp) HDFS-13055. Aggregate usage statistics from datanodes. Contributed by [Apr 23, 2018 2:49:35 AM] (inigoiri) HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs [Apr 23, 2018 8:02:09 AM] (sunilg) YARN-7956. [UI2] Avoid duplicating Components link under [Apr 23, 2018 8:06:27 AM] (sunilg) YARN-8177. Documentation changes for auto creation of Leaf Queues with [Apr 23, 2018 5:08:53 PM] (arp) HDFS-13433. webhdfs requests can be routed incorrectly in federated [Apr 23, 2018 6:13:18 PM] (cdouglas) HDFS-13408. MiniDFSCluster to support being built on randomized base [Apr 23, 2018 9:14:05 PM] (lei) Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release. [Apr 23, 2018 10:26:53 PM] (fabbri) HADOOP-14756 S3Guard: expose capability query in MetadataStore and add [Apr 23, 2018 10:44:15 PM] (rkanter) HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to [Apr 23, 2018 11:09:01 PM] (Bharat) HDFS-13356. Balancer:Set default value of minBlockSize to 10mb. [Apr 24, 2018 2:12:16 AM] (inigoiri) HDFS-13336. Test cases of TestWriteToReplica failed in windows. [Apr 24, 2018 3:25:23 AM] (yqlin) HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo [Apr 24, 2018 10:29:14 AM] (junping_du) YARN-7598. Document how to use classpath isolation for aux-services in [Apr 24, 2018 6:30:38 PM] (rkanter) MAPREDUCE-7072. mapred job -history prints duplicate counter in human [Apr 25, 2018 10:50:52 PM] (omalley) HDFS-8456. Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8614. OzoneHandler : Add Quota Support. (Contributed by Anu [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8448. Create REST Interface for Volumes. Contributed by Anu [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8637. OzoneHandler : Add Error Table. (Contributed by Anu Engineer) [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8634. OzoneHandler: Add userAuth Interface and Simple userAuth [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8644. OzoneHandler : Add volume handler. (Contributed by Anu [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8654. OzoneHandler : Add ACL support. (Contributed by Anu Engineer) [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8680. OzoneHandler : Add Local StorageHandler support for volumes. [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8717. OzoneHandler : Add common bucket objects. (Contributed by Anu [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8753. Ozone: Unify StorageContainerConfiguration with [Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8695. OzoneHandler : Add Bucket REST Interface. (aengineer) [Apr 25, 2018 10:51:36 PM] (omalley) HDFS-8527. OzoneHandler: Integration of REST interface and container [Apr 25, 2018 10:51:39 PM] (omalley) HDFS-8757 : OzoneHandler : Add localStorageHandler support for Buckets. [Apr 25, 2018 10:51:39 PM] (omalley) HDFS-9834. OzoneHandler : Enable MiniDFSCluster based testing for Ozone. [Apr 25, 2018 10:51:39 PM] (omalley) HDFS-9845. OzoneHandler : Support List and Info Volumes. Contributed by [Apr 25, 2018 10:51:51 PM] (omalley) HDFS-9853. Ozone: Add container definitions. Contributed by Anu [Apr 25, 2018 10:51:53 PM] (omalley) HDFS-9848. Ozone: Add Ozone Client lib for volume handling. Contributed [Apr 25, 2018 10:51:53 PM] (omalley) HDFS-9907. Exclude Ozone protobuf-generated classes from Findbugs [Apr 25, 2018 10:51:53 PM] (omalley) HDFS-9873. Ozone: Add container transport server. Contributed by Anu [Apr 25, 2018 10:51:58 PM] (omalley) HDFS-9891. Ozone: Add container transport client. Contributed by Anu [Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9920. Stop tracking CHANGES.txt in the HDFS-7240 feature branch. [Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer. [Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer. [Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9925. Ozone: Add Ozone Client lib for bucket handling. Contributed [Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9926. ozone : Add volume commands to CLI. Contributed by Anu [Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9944. Ozone : Add container dispatcher. Contributed by Anu [Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9961. Ozone: Add buckets commands to CLI. Contributed by Anu [Apr 25, 2018 10:52:00 PM] (omalley) HDFS-10180. Ozone: Refactor container Namespace. Contributed by Anu [Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9960. OzoneHandler : Add localstorage support for keys. Contributed [Apr 25, 2018 10:52:07 PM] (omalley) HDFS-10179. Ozone: Adding logging support. Contributed by Anu Engineer. [Apr 25, 2018 10:52:09 PM] (omalley) HDFS-10196. Ozone : Enable better error reporting for failed commands in [Apr 25, 2018 10:52:25 PM] (omalley) HDFS-10202. ozone : Add key commands to CLI. Contributed by Anu [Apr 25, 2018 10:52:33 PM]
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see
https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/20/
[Apr 16, 2018 5:15:37 PM] (xyao) HADOOP-15369. Avoid usage of
${project.version} in parent poms.
[Apr 16, 2018 6:24:26 PM] (eyang) YARN-8060. Added default readiness check for
service components.
[Apr 16, 2018 9:16:59 PM] (arp) HDFS-13439. Add test case for read block
operation when it is moved.
[Apr 16, 2018 10:05:04 PM] (haibochen) YARN-8162. Remove Method
DirectoryCollection#verifyDirUsingMkdir. (Yufei
[Apr 16, 2018 10:55:00 PM] (virajith) HDFS-13311. RBF:
TestRouterAdminCLI#testCreateInvalidEntry fails on
[Apr 16, 2018 11:26:54 PM] (inigoiri) YARN-7773. YARN Federation used Mysql as
state store throw exception,
[Apr 16, 2018 11:52:17 PM] (inigoiri) YARN-8165. Incorrect queue name logging
in AbstractContainerAllocator.
[Apr 17, 2018 12:32:19 AM] (inigoiri) YARN-8164. Fix a potential NPE in
AbstractSchedulerPlanFollower.
[Apr 17, 2018 3:23:22 AM] (yqlin) HDFS-13435. RBF: Improve the error loggings
for printing the stack
[Apr 17, 2018 9:38:31 AM] (sunilg) YARN-8126. Support auto-spawning of admin
configured services during
[Apr 17, 2018 12:59:03 PM] (haibochen) YARN-7088. Add application launch time
to Resource Manager REST API.
[Apr 17, 2018 1:04:38 PM] (haibochen) Revert "YARN-7088. Add application launch
time to Resource Manager REST
[Apr 17, 2018 1:57:31 PM] (jlowe) YARN-7996. Allow user supplied Docker client
configurations with YARN
[Apr 17, 2018 6:15:20 PM] (haibochen) YARN-7088. Add application launch time to
Resource Manager REST API.
[Apr 17, 2018 7:37:30 PM] (Bharat) HDFS-13129. Add a test for DfsAdmin
refreshSuperUserGroupsConfiguration.
[Apr 17, 2018 8:08:01 PM] (inigoiri) YARN-8096. Wrong condition in
AmIpFilter#getProxyAddresses() to update
[Apr 17, 2018 8:11:34 PM] (inigoiri) YARN-8134. Support specifying node
resources in SLS. Contributed by
[Apr 17, 2018 9:19:23 PM] (inigoiri) HDFS-13462. Add BIND_HOST configuration
for JournalNode's HTTP and RPC
[Apr 17, 2018 10:01:07 PM] (weiy) HDFS-13466. RBF: Add more router-related
information to the UI.
[Apr 18, 2018 4:33:15 AM] (aajisaka) HADOOP-15393. Upgrade the version of
commons-lang3 to 3.7
[Apr 18, 2018 5:38:23 AM] (aajisaka) HDFS-12828. OIV ReverseXML Processor fails
with escaped characters
[Apr 18, 2018 5:53:32 AM] (yufei) YARN-7966. Remove method
AllocationConfiguration#getQueueAcl and related
[Apr 18, 2018 8:04:00 AM] (yqlin) HADOOP-15391. Add missing css file in
hadoop-aws, hadoop-aliyun,
[Apr 18, 2018 8:09:41 AM] (rohithsharmaks) YARN-8145. yarn rmadmin -getGroups
doesn't return updated groups for
[Apr 18, 2018 8:09:41 AM] (rohithsharmaks) YARN-8171. [UI2] AM Node link from
attempt page should not redirect to
[Apr 18, 2018 10:41:37 AM] (msingh) HDFS-13463. Fix javadoc in
FsDatasetImpl#checkAndUpdate. Contributed by
[Apr 18, 2018 3:23:45 PM] (Bharat) HDFS-13464. Fix javadoc in
FsVolumeList#handleVolumeFailures.
[Apr 18, 2018 11:35:38 PM] (aajisaka) HADOOP-15396. Some java source files are
executable
[Apr 19, 2018 7:07:14 AM] (aajisaka) YARN-8169. Cleanup RackResolver.java
[Apr 19, 2018 4:07:35 PM] (sunilg) YARN-5888. [UI2] Improve unit tests for new
YARN UI. Contributed by
[Apr 19, 2018 6:35:53 PM] (sunilg) YARN-6827. [ATS1/1.5] NPE exception while
publishing recovering
[Apr 19, 2018 9:56:36 PM] (inigoiri) HDFS-13453. RBF: getMountPointDates should
fetch latest subdir time/date
[Apr 19, 2018 11:49:29 PM] (inigoiri) YARN-8186. [Router] Federation: routing
getAppState REST invocations
[Apr 20, 2018 2:05:17 PM] (rohithsharmaks) YARN-8182. [UI2] Proxy- Clicking on
nodes under Nodes HeatMap gives 401
[Apr 20, 2018 2:06:26 PM] (rohithsharmaks) YARN-8189. [UI2] Nodes page column
headers are half truncated.
[Apr 20, 2018 2:35:05 PM] (sunilg) YARN-7830. [UI2] Post selecting grid view in
Attempt page, attempt info
[Apr 20, 2018 2:41:24 PM] (haibochen) YARN-8185. Improve log in
DirectoryCollection constructor. (Yufei Gu via
[Apr 20, 2018 4:09:12 PM] (inigoiri) YARN-8137. Parallelize node addition in
SLS. Contributed by Abhishek
[Apr 20, 2018 4:58:36 PM] (sunilg) YARN-7956. [UI2] Avoid duplicating
Components link under
[Apr 20, 2018 5:03:54 PM] (sunilg) Revert "YARN-7956. [UI2] Avoid duplicating
Components link under
[Apr 20, 2018 5:49:33 PM] (eyang) YARN-8064. Bugfix for clean up
container-executor cmd helper file.
[Apr 20, 2018 6:22:20 PM] (jlowe) YARN-7786. NullPointerException while
launching ApplicationMaster.
[Apr 20, 2018 7:24:48 PM] (kkaranasos) YARN-8111. Simplify PlacementConstraints
API by removing
[Apr 21, 2018 3:33:10 AM] (sjlee) HDFS-10183. Prevent race condition during
class initialization.
[Apr 21, 2018 5:19:09 AM] (yqlin) HDFS-13478. RBF: Disabled Nameservice store
API. Contributed by Inigo
-1 overall
The following subsystems voted -1:
compile findbugs mvninstall mvnsite shadedclient unit xml
The following subsystems voted -1 but
were configured to be filtered/ignored:
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/19/ [Apr 8, 2018 4:01:55 AM] (yqlin) HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed [Apr 9, 2018 3:47:22 PM] (sunilg) YARN-7574. Add support for Node Labels on Auto Created Leaf Queue [Apr 9, 2018 4:16:48 PM] (inigoiri) HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs [Apr 9, 2018 5:09:25 PM] (inigoiri) HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota [Apr 9, 2018 5:48:42 PM] (james.clampffer) HDFS-13376. Specify minimum GCC version to avoid TLS support error in [Apr 9, 2018 10:19:21 PM] (jlowe) YARN-7667. Docker Stop grace period should be configurable. Contributed [Apr 9, 2018 11:37:49 PM] (Bharat) HADOOP-15328. Fix the typo in HttpAuthentication.md. Contributed by fang [Apr 10, 2018 6:29:28 AM] (yqlin) HDFS-13410. RBF: Support federation with no subclusters. Contributed by [Apr 10, 2018 7:34:42 AM] (yqlin) HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by [Apr 10, 2018 9:59:40 AM] (aajisaka) HADOOP-15374. Add links of the new features of 3.1.0 to the top page [Apr 10, 2018 10:39:09 AM] (sunilg) YARN-7804. [UI2] Refresh action on Grid view page should not be [Apr 10, 2018 2:10:44 PM] (wwei) HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage [Apr 10, 2018 2:58:26 PM] (aajisaka) HADOOP-15376. Remove double semi colons on imports that make Clover fall [Apr 10, 2018 6:05:00 PM] (rakeshr) HDFS-13328. Abstract ReencryptionHandler recursive logic in separate [Apr 10, 2018 6:19:48 PM] (xiao) HDFS-13363. Record file path when FSDirAclOp throws AclException. [Apr 10, 2018 6:42:54 PM] (xyao) HADOOP-15340. Provide meaningful RPC server name for RpcMetrics. [Apr 10, 2018 9:40:49 PM] (eyang) YARN-7984. Improved YARN service stop/destroy and clean up. [Apr 10, 2018 9:44:55 PM] (jlowe) HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable [Apr 10, 2018 10:38:25 PM] (xiao) HADOOP-14445. Delegation tokens are not shared between KMS instances. [Apr 10, 2018 11:25:00 PM] (eyang) YARN-7973. Added ContainerRelaunch feature for Docker containers. [Apr 11, 2018 12:32:38 AM] (wangda) YARN-8116. Nodemanager fails with NumberFormatException: For input [Apr 11, 2018 12:33:15 AM] (wangda) YARN-8133. Doc link broken for yarn-service from overview page. (Rohith [Apr 11, 2018 3:48:50 AM] (rohithsharmaks) YARN-7941. Transitive dependencies for component are not resolved. [Apr 11, 2018 4:15:39 AM] (rohithsharmaks) MAPREDUCE-7062. Update mapreduce.job.tags description for making use for [Apr 11, 2018 4:31:48 AM] (xiao) HDFS-13056. Expose file-level composite CRCs in HDFS which are [Apr 11, 2018 6:55:38 AM] (fabbri) HADOOP-15346 S3ARetryPolicy for 400/BadArgument to be "fail". [Apr 11, 2018 9:15:25 AM] (wwei) YARN-8127. Resource leak when async scheduling is enabled. Contributed [Apr 11, 2018 2:27:23 PM] (jhc) HDFS-13403: libhdfs++ Use hdfs::IoService object rather than [Apr 11, 2018 3:37:43 PM] (weiy) HDFS-13045. RBF: Improve error message returned from subcluster. [Apr 11, 2018 5:43:43 PM] (inigoiri) HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. [Apr 11, 2018 6:24:23 PM] (billie) YARN-7221. Add security check for privileged docker container. [Apr 11, 2018 7:03:14 PM] (inigoiri) HDFS-13386. RBF: Wrong date information in list file(-ls) result. [Apr 12, 2018 12:19:56 AM] (fabbri) HADOOP-12502 SetReplication OutOfMemoryError. Contributed by Vinayakumar [Apr 12, 2018 1:44:56 AM] (aajisaka) HDFS-13427. Fix the section titles of transparent encryption document. [Apr 12, 2018 8:19:35 AM] (aajisaka) HADOOP-15350. [JDK10] Update maven plugin tools to fix compile error in [Apr 12, 2018 8:47:37 AM] (aajisaka) HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by [Apr 12, 2018 1:38:30 PM] (haibochen) YARN-7931. [atsv2 read acls] Include domain table creation as part of [Apr 12, 2018 2:42:31 PM] (msingh) HDFS-13426. Fix javadoc in FsDatasetAsyncDiskService#removeVolume. [Apr 12, 2018 3:42:19 PM] (inigoiri) Revert "HDFS-13386. RBF: Wrong date information in list file(-ls) [Apr 12, 2018 4:04:23 PM] (ericp) YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb [Apr 12, 2018 4:12:46 PM] (jlowe) MAPREDUCE-7069. Add ability to specify user environment variables [Apr 12, 2018 4:28:23 PM] (inigoiri) Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple [Apr 12, 2018 4:30:11 PM] (inigoiri) HDFS-13386. RBF: Wrong date information in list file(-ls) result. [Apr 12, 2018 5:53:57 PM] (ericp) YARN-8147. TestClientRMService#testGetApplications sporadically fails. [Apr 12, 2018 7:38:00 PM] (billie) YARN-7936. Add default service AM Xmx. Contributed by Jian He [Apr 13, 2018 4:23:51 AM] (aajisaka) HDFS-13436. Fix javadoc of package-info.java [Apr 13, 2018 4:51:20 AM] (Bharat) HADOOP-15379. Make IrqHandler.bind() public. Contributed by
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/18/ [Apr 2, 2018 2:26:01 PM] (wangda) YARN-7142. Support placement policy in yarn native services. (Gour Saha [Apr 2, 2018 2:52:40 PM] (stevel) HADOOP-15146. Remove DataOutputByteBuffer. Contributed by BELUGA BEHR. [Apr 2, 2018 3:38:13 PM] (jlowe) YARN-8082. Include LocalizedResource size information in the NM download [Apr 2, 2018 10:22:05 PM] (wangda) YARN-8091. Revisit checkUserAccessToQueue RM REST API. (wangda) [Apr 3, 2018 5:48:26 AM] (xiao) HADOOP-15317. Improve NetworkTopology chooseRandom's loop. [Apr 3, 2018 6:10:08 AM] (xiao) HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. [Apr 3, 2018 7:08:40 AM] (yqlin) HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by [Apr 3, 2018 2:59:20 PM] (haibochen) YARN-8051. TestRMEmbeddedElector#testCallbackSynchronization is flaky. [Apr 3, 2018 3:31:34 PM] (stevel) HADOOP-14758. S3GuardTool.prune to handle UnsupportedOperationException. [Apr 3, 2018 5:01:00 PM] (szegedim) YARN-8035. Uncaught exception in ContainersMonitorImpl during relaunch [Apr 4, 2018 3:52:35 AM] (sunilg) YARN-7764. Findbugs warning: Resource#getResources may expose internal [Apr 4, 2018 4:06:24 AM] (wangda) YARN-8106. Update LogAggregationIndexedFileController to use readFull [Apr 4, 2018 4:43:14 PM] (sunilg) YARN-8115. [UI2] URL data like nodeHTTPAddress must be encoded in UI [Apr 4, 2018 5:51:58 PM] (kkaranasos) YARN-8013. Support application tags when defining application namespaces [Apr 4, 2018 6:59:31 PM] (haibochen) YARN-7946. Update TimelineServerV2 doc as per YARN-7919. (Haibo Chen) [Apr 4, 2018 10:08:03 PM] (vrushali) YARN-8073 TimelineClientImpl doesn't honor [Apr 4, 2018 10:35:58 PM] (szegedim) HADOOP-14855. Hadoop scripts may errantly believe a daemon is still [Apr 5, 2018 4:59:10 PM] (lei) HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be [Apr 5, 2018 5:23:42 PM] (haibochen) YARN-6936. [Atsv2] Retrospect storing entities into sub application [Apr 5, 2018 6:02:35 PM] (rohithsharmaks) YARN-8119. [UI2] Timeline Server address' url scheme should be removed [Apr 5, 2018 7:00:52 PM] (weiy) HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by [Apr 5, 2018 10:52:39 PM] (wangda) Added CHANGES/RELEASES/Jdiff for 3.1.0 release [Apr 6, 2018 3:23:17 AM] (fabbri) HADOOP-14759 S3GuardTool prune to prune specific bucket entries. [Apr 6, 2018 4:23:14 PM] (sunilg) YARN-8083. [UI2] All YARN related configurations are paged together in [Apr 6, 2018 4:39:01 PM] (haibochen) YARN-8107. Give an informative message when incorrect format is used in [Apr 6, 2018 11:31:16 PM] (subru) YARN-8110. AMRMProxy recover should catch for all throwable to avoid [Apr 7, 2018 4:24:58 AM] (wangda) YARN-8048. Support auto-spawning of admin configured services during [Apr 7, 2018 4:25:57 AM] (wangda) YARN-1151. Ability to configure auxiliary services from HDFS-based JAR [Apr 7, 2018 5:53:49 AM] (surendralilhore) HDFS-13292. Crypto command should give proper exception when trying to [Apr 7, 2018 6:56:29 AM] (bibinchundatt) YARN-7905. Parent directory permission incorrect during public [Apr 7, 2018 10:59:01 AM] (msingh) HADOOP-15366. Add a helper shutdown routine in HadoopExecutor to ensure -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace Specific tests: Failed junit tests : hadoop.security.authentication.util.TestKerberosName hadoop.security.authentication.server.TestAltKerberosAuthenticationHandler hadoop.security.authentication.client.TestKerberosAuthenticator mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/18/artifact/out/patch-mvninstall-root.txt [116K] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/18/artifact/out/patch-compile-root.txt [52K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/18/artifact/out/patch-compile-root.txt [52K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/18/artifact/out/patch-compile-root.txt [52K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/18/artifact/out/diff-checkstyle-root.txt [3.1M] mvnsite: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/18/artifact/out/patch-mvnsite-root.txt [36K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/18/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/18/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs:
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/17/ [Mar 26, 2018 10:33:07 AM] (yqlin) HDFS-13291. RBF: Implement available space based OrderResolver. [Mar 26, 2018 4:42:51 PM] (inigoiri) HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by [Mar 26, 2018 5:21:35 PM] (eyang) YARN-8043. Added the exception message for failed launches running [Mar 26, 2018 5:45:29 PM] (xyao) HADOOP-15339. Support additional key/value propereties in JMX bean [Mar 26, 2018 6:16:06 PM] (wangda) YARN-8062. yarn rmadmin -getGroups returns group from which the user has [Mar 26, 2018 6:19:15 PM] (wangda) YARN-8068. Application Priority field causes NPE in app timeline publish [Mar 26, 2018 6:20:16 PM] (wangda) YARN-8072. RM log is getting flooded with [Mar 26, 2018 8:05:15 PM] (mackrorysd) HADOOP-15299. Bump Jackson 2 version to Jackson 2.9.x. [Mar 26, 2018 9:30:11 PM] (haibochen) YARN-7794. SLSRunner is not loading timeline service jars, causing [Mar 26, 2018 9:55:53 PM] (rkanter) MAPREDUCE-6441. Improve temporary directory name generation in [Mar 26, 2018 10:46:31 PM] (eyang) YARN-8018. Added support for initiating yarn service upgrade. [Mar 26, 2018 10:59:32 PM] (xiao) HADOOP-15313. TestKMS should close providers. [Mar 27, 2018 5:31:03 PM] (inigoiri) HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. [Mar 27, 2018 6:21:19 PM] (james.clampffer) HDFS-13338. Update BUILDING.txt for building native libraries. [Mar 27, 2018 8:33:41 PM] (weichiu) HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed [Mar 28, 2018 12:39:46 AM] (subru) YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade [Mar 28, 2018 2:33:18 AM] (sunilg) YARN-8075. DShell does not fail when we ask more GPUs than available [Mar 28, 2018 3:00:08 AM] (yqlin) HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. [Mar 28, 2018 9:35:38 AM] (wwei) YARN-7734. Fix UT failure [Mar 28, 2018 4:05:25 PM] (szegedim) YARN-8077. The vmemLimit parameter in [Mar 28, 2018 6:07:45 PM] (wangda) YARN-6629. NPE occurred when container allocation proposal is applied [Mar 28, 2018 6:26:50 PM] (subru) Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass [Mar 28, 2018 6:33:19 PM] (subru) YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade [Mar 28, 2018 6:41:20 PM] (zezhang) YARN-7623. Fix the CapacityScheduler Queue configuration documentation. [Mar 28, 2018 6:58:59 PM] (cdouglas) HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure [Mar 28, 2018 7:49:17 PM] (arp) HDFS-13314. NameNode should optionally exit if it detects FsImage [Mar 29, 2018 12:17:37 AM] (eyang) YARN-8069. Clean up example hostnames for RegistryDNS. [Mar 29, 2018 10:25:39 AM] (sunilg) YARN-8076. Support to specify application tags in distributed shell. [Mar 29, 2018 2:08:22 PM] (weichiu) HDFS-13357. Improve AclException message "Invalid ACL: only directories [Mar 29, 2018 4:11:16 PM] (sunilg) YARN-8085. ResourceProfilesManager should be set in [Mar 29, 2018 4:13:40 PM] (mackrorysd) HADOOP-15342. Updating ADLS connector to use the current SDK version [Mar 29, 2018 9:36:34 PM] (eyang) YARN-6257. Fix CapacityScheduler REST API JSON output. [Mar 29, 2018 10:03:31 PM] (wangda) YARN-8086. ManagedParentQueue with no leaf queues cause JS error in new [Mar 29, 2018 10:46:34 PM] (xiao) HDFS-13087. Snapshotted encryption zone information should be immutable. [Mar 30, 2018 12:16:23 AM] (shv) HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. [Mar 30, 2018 12:23:05 PM] (sammi.chen) HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based [Mar 30, 2018 1:41:33 PM] (wwei) YARN-7497. Add file system based scheduler configuration store. [Mar 30, 2018 2:25:14 PM] (aajisaka) HADOOP-15352. Fix default local maven repository path in create-release [Mar 31, 2018 1:55:35 AM] (shv) HADOOP-15253. Should update maxQueueSize when refresh call queue. [Mar 31, 2018 4:46:13 PM] (inigoiri) HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace Specific tests: Failed junit tests : hadoop.security.authentication.util.TestKerberosName hadoop.security.authentication.server.TestAltKerberosAuthenticationHandler hadoop.security.authentication.client.TestKerberosAuthenticator mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/17/artifact/out/patch-mvninstall-root.txt [136K] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/17/artifact/out/patch-compile-root.txt [56K] cc:
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/16/ [Mar 18, 2018 5:14:33 AM] (sunilg) YARN-8040. [UI2] New YARN UI webapp does not respect current pathname [Mar 18, 2018 5:30:30 AM] (sunilg) YARN-8028. Support authorizeUserAccessToQueue in RMWebServices. [Mar 19, 2018 12:39:49 AM] (aajisaka) MAPREDUCE-7066. TestQueue fails on Java9 [Mar 19, 2018 7:02:37 AM] (sammi.chen) HADOOP-15262. AliyunOSS: move files under a directory in parallel when [Mar 19, 2018 6:04:27 PM] (wangda) YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag. [Mar 19, 2018 9:59:58 PM] (jlowe) YARN-8027. Setting hostname of docker container breaks for --net=host in [Mar 19, 2018 11:05:55 PM] (cdouglas) HADOOP-14667. Flexible Visual Studio support. Contributed by Allen [Mar 20, 2018 12:19:30 AM] (inigoiri) HDFS-13296. GenericTestUtils generates paths with drive letter in [Mar 20, 2018 5:13:40 AM] (weiy) HDFS-13215. RBF: Move Router to its own module. Contributed by Wei Yan [Mar 20, 2018 11:36:21 AM] (haibochen) YARN-8053. Add hadoop-distcp in exclusion in hbase-server dependencies [Mar 20, 2018 6:19:46 PM] (inigoiri) HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. [Mar 20, 2018 10:19:18 PM] (yufei) HADOOP-15062. TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on [Mar 21, 2018 2:41:19 AM] (rohithsharmaks) YARN-7581. HBase filters are not constructed correctly in ATSv2. [Mar 21, 2018 2:51:35 AM] (yqlin) HDFS-13307. RBF: Improve the use of setQuota command. Contributed by [Mar 21, 2018 3:32:05 AM] (yqlin) HDFS-13250. RBF: Router to manage requests across multiple subclusters. [Mar 21, 2018 4:12:20 AM] (mackrorysd) HADOOP-15332. Fix typos in hadoop-aws markdown docs. Contributed by [Mar 21, 2018 5:01:26 AM] (aajisaka) HADOOP-15330. Remove jdk1.7 profile from hadoop-annotations module [Mar 21, 2018 6:04:05 AM] (yzhang) HDFS-13315. Add a test for the issue reported in HDFS-11481 which is [Mar 21, 2018 8:53:35 PM] (xyao) HDFS-11043. TestWebHdfsTimeouts fails. Contributed by Xiaoyu Yao and [Mar 21, 2018 10:19:20 PM] (jlowe) YARN-8054. Improve robustness of the LocalDirsHandlerService [Mar 21, 2018 11:46:03 PM] (shv) HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of [Mar 22, 2018 4:21:52 PM] (inigoiri) HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth [Mar 22, 2018 5:21:10 PM] (kihwal) HDFS-13195. DataNode conf page cannot display the current value after [Mar 22, 2018 5:52:02 PM] (arp) HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit [Mar 22, 2018 6:04:37 PM] (yufei) HADOOP-15331. Fix a race condition causing parsing error of [Mar 22, 2018 6:29:31 PM] (weichiu) HDFS-11900. Hedged reads thread pool creation not synchronized. [Mar 22, 2018 8:32:57 PM] (inigoiri) HDFS-12792. RBF: Test Router-based federation using HDFSContract. [Mar 22, 2018 9:09:06 PM] (jitendra) HADOOP-14067. VersionInfo should load version-info.properties from its [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8723. Integrate the build infrastructure with hdfs-client. [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8724. Import third_party libraries into the repository. Contributed [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8725. Use std::chrono to implement the timer in the asio library. [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8737. Initial implementation of a Hadoop RPC v9 client. Contributed [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8745. Use Doxygen to generate documents for libhdfspp. Contributed [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8758. Implement the continuation library in libhdfspp. Contributed [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8759. Implement remote block reader in libhdfspp. Contributed by [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8764. Generate Hadoop RPC stubs from protobuf definitions. [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8788. Implement unit tests for remote block reader in libhdfspp. [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8775. SASL support for data transfer protocol in libhdfspp. [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8774. Implement FileSystem and InputStream API for libhdfspp. [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8952. InputStream.PositionRead() should be aware of available DNs. [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9025. Fix compilation issues on arch linux. Contributed by Owen [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9093. Initialize protobuf fields in RemoteBlockReaderTest. [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9116. Suppress false positives from Valgrind on uninitialized [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9108. InputStreamImpl::ReadBlockContinuation stores wrong pointers [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9095. RPC client should fail gracefully when the connection is [Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9207.
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/15/ [Mar 12, 2018 2:01:42 PM] (stevel) HADOOP-15297. Make S3A etag => checksum feature optional. Contributed by [Mar 12, 2018 4:58:56 PM] (inigoiri) HDFS-11399. Many tests fails in Windows due to injecting disk failures. [Mar 12, 2018 7:07:22 PM] (aengineer) HDFS-10618. TestPendingReconstruction#testPendingAndInvalidate is flaky [Mar 12, 2018 8:43:27 PM] (cdouglas) HADOOP-14742. Document multi-URI replication Inode for ViewFS. [Mar 12, 2018 9:29:44 PM] (cdouglas) HDFS-12677. Extend TestReconstructStripedFile with a random EC policy. [Mar 12, 2018 11:35:26 PM] (yufei) YARN-8024. LOG in class MaxRunningAppsEnforcer is initialized with a [Mar 13, 2018 12:28:15 AM] (inigoiri) HDFS-13241. RBF: TestRouterSafemode failed if the port is in use. [Mar 13, 2018 2:15:51 AM] (yqlin) HDFS-10803. [Mar 13, 2018 2:26:56 AM] (aajisaka) HDFS-12156. TestFSImage fails without -Pnative [Mar 13, 2018 2:30:20 AM] (yqlin) HDFS-13253. RBF: Quota management incorrect parent-child relationship [Mar 13, 2018 3:03:31 AM] (yqlin) HDFS-13226. RBF: Throw the exception if mount table entry validated [Mar 13, 2018 3:05:39 AM] (cdouglas) HADOOP-14696. parallel tests don't work for Windows. Contributed by [Mar 13, 2018 3:41:37 AM] (xyao) HDFS-13141. WebHDFS: Add support for getting snasphottable directory [Mar 13, 2018 4:43:22 PM] (cdouglas) HDFS-13271. WebHDFS: Add constructor in SnapshottableDirectoryStatus [Mar 13, 2018 4:58:03 PM] (xiao) HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. [Mar 13, 2018 5:07:26 PM] (xiao) HDFS-13239. Fix non-empty dir warning message when setting default EC [Mar 13, 2018 5:14:05 PM] (xiao) HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and [Mar 13, 2018 5:36:16 PM] (xiao) Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC [Mar 13, 2018 5:48:45 PM] (xiao) HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. [Mar 13, 2018 6:08:11 PM] (cdouglas) HDFS-12780. Fix spelling mistake in DistCpUtils.java. Contributed by [Mar 13, 2018 7:36:57 PM] (szegedim) YARN-5764. NUMA awareness support for launching containers. Contributed [Mar 13, 2018 8:55:18 PM] (cdouglas) HADOOP-15311. HttpServer2 needs a way to configure the acceptor/selector [Mar 13, 2018 11:35:51 PM] (arp) HDFS-13235. DiskBalancer: Update Documentation to add newly added [Mar 13, 2018 11:39:17 PM] (arp) HDFS-336. dfsadmin -report should report number of blocks from datanode. [Mar 14, 2018 12:55:17 AM] (wangda) YARN-5015. Support sliding window retry capability for container [Mar 14, 2018 12:55:51 AM] (wangda) YARN-7657. Queue Mapping could provide options to provide 'user' [Mar 14, 2018 3:01:07 AM] (inigoiri) HADOOP-15308. TestConfiguration fails on Windows because of paths. [Mar 14, 2018 3:20:59 AM] (yqlin) HDFS-12773. RBF: Improve State Store FS implementation. Contributed by [Mar 14, 2018 4:12:20 AM] (rohithsharmaks) YARN-8022. ResourceManager UI cluster/app/ page fails to render. [Mar 14, 2018 4:38:07 AM] (aajisaka) HADOOP-15294. TestUGILoginFromKeytab fails on Java9 [Mar 14, 2018 6:39:53 AM] (sammi.chen) HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. [Mar 14, 2018 4:14:26 PM] (xyao) HDFS-13249. Document webhdfs support for getting snapshottable directory [Mar 14, 2018 4:21:57 PM] (eyang) YARN-7999. Added file cache initializer for Linux container-executor. [Mar 14, 2018 4:42:48 PM] (arp) HDFS-13257. Code cleanup: INode never throws QuotaExceededException. [Mar 14, 2018 5:38:00 PM] (xyao) HDFS-13275. Adding log for BlockPoolManager#refreshNamenodes failures. [Mar 14, 2018 6:26:58 PM] (xyao) HDFS-13251. Avoid using hard coded datanode data dirs in unit tests. [Mar 14, 2018 8:05:24 PM] (jlowe) MAPREDUCE-7064. Flaky test [Mar 14, 2018 8:14:36 PM] (inigoiri) HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore [Mar 14, 2018 8:36:53 PM] (wangda) Revert "HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not [Mar 14, 2018 10:47:56 PM] (fabbri) HADOOP-15278 log s3a at info. Contributed by Steve Loughran. [Mar 15, 2018 3:06:04 AM] (yqlin) HDFS-13261. Fix incorrect null value check. Contributed by Jianfei [Mar 15, 2018 4:59:51 AM] (xiao) HDFS-13246. FileInputStream redundant closes in readReplicasFromCache. [Mar 15, 2018 7:12:07 AM] (aajisaka) HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with [Mar 15, 2018 5:14:35 PM] (inigoiri) HDFS-12723. [Mar 15, 2018 5:18:44 PM] (xyao) HDFS-13251. Avoid using hard coded datanode data dirs in unit [Mar 15, 2018 5:32:30 PM] (inigoiri) HDFS-13224. RBF: Resolvers to support mount points across multiple [Mar 15, 2018 6:02:27 PM] (xyao) HDFS-13280. WebHDFS: Fix NPE in get snasphottable directory list call. [Mar 15, 2018 6:05:14 PM] (stevel) HADOOP-15209. DistCp to eliminate needless deletion of files under [Mar 15, 2018 8:26:01 PM] (wangda) MAPREDUCE-7047.
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/14/ [Mar 4, 2018 3:12:52 PM] (aajisaka) HADOOP-15286. Remove unused imports from TestKMSWithZK.java [Mar 4, 2018 3:33:47 PM] (aajisaka) HADOOP-15282. HADOOP-15235 broke TestHttpFSServerWebServer [Mar 5, 2018 3:49:43 AM] (wwei) YARN-7995. Remove unnecessary boxings and unboxings from [Mar 5, 2018 2:06:20 PM] (stevel) HADOOP-13761. S3Guard: implement retries for DDB failures and [Mar 5, 2018 5:08:44 PM] (billie) YARN-7915. Trusted image log message repeated multiple times. [Mar 5, 2018 6:12:38 PM] (stevel) HADOOP-15288. TestSwiftFileSystemBlockLocation doesn't compile. [Mar 5, 2018 7:24:17 PM] (arun suresh) YARN-7972. Support inter-app placement constraints for allocation tags [Mar 5, 2018 7:54:24 PM] (aajisaka) YARN-7736. Fix itemization in YARN federation document [Mar 5, 2018 11:07:58 PM] (aajisaka) HADOOP-15271. Remove unicode multibyte characters from JavaDoc [Mar 6, 2018 2:15:53 AM] (aajisaka) HADOOP-15287. JDK9 JavaDoc build fails due to one-character underscore [Mar 6, 2018 6:25:21 AM] (rohithsharmaks) YARN-7346. Add a profile to allow optional compilation for ATSv2 with [Mar 6, 2018 10:05:12 AM] (stevel) HADOOP-15289. FileStatus.readFields() assertion incorrect. Contributed [Mar 6, 2018 2:01:33 PM] (aajisaka) HADOOP-15291. TestMiniKdc fails on Java 9 [Mar 6, 2018 5:09:32 PM] (inigoiri) HDFS-13188. Disk Balancer: Support multiple block pools during block [Mar 6, 2018 5:57:35 PM] (xiao) HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. [Mar 6, 2018 8:23:03 PM] (szetszwo) HDFS-13223. Reduce DiffListBySkipList memory usage. Contributed by [Mar 6, 2018 9:35:03 PM] (szetszwo) HDFS-13227. Add a method to calculate cumulative diff over multiple [Mar 7, 2018 12:44:20 AM] (xyao) HDFS-13109. Support fully qualified hdfs path in EZ commands. [Mar 7, 2018 7:26:38 AM] (yqlin) HDFS-13214. RBF: Complete document of Router configuration. Contributed [Mar 7, 2018 3:20:34 PM] (jlowe) YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim [Mar 7, 2018 6:51:10 PM] (stevel) HADOOP-15267. S3A multipart upload fails when SSE-C encryption is [Mar 7, 2018 7:27:53 PM] (szetszwo) HDFS-13222. Update getBlocks method to take minBlockSize in RPC calls. [Mar 7, 2018 7:30:06 PM] (wangda) YARN-7891. LogAggregationIndexedFileController should support read from [Mar 7, 2018 7:30:15 PM] (wangda) YARN-7626. Allow regular expression matching in container-executor.cfg [Mar 7, 2018 8:33:41 PM] (mackrorysd) HDFS-13176. WebHdfs file path gets truncated when having semicolon (;) [Mar 7, 2018 10:17:10 PM] (hanishakoneru) HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is [Mar 7, 2018 11:46:47 PM] (wangda) Revert "YARN-7891. LogAggregationIndexedFileController should support [Mar 7, 2018 11:46:47 PM] (wangda) YARN-7891. LogAggregationIndexedFileController should support read from [Mar 8, 2018 8:02:34 AM] (yqlin) HADOOP-15296. Fix a wrong link for RBF in the top page. Contributed by [Mar 8, 2018 10:13:36 AM] (wwei) YARN-8011. [Mar 8, 2018 11:15:46 AM] (stevel) HADOOP-15292. Distcp's use of pread is slowing it down. Contributed by [Mar 8, 2018 11:24:06 AM] (stevel) HADOOP-15273.distcp can't handle remote stores with different checksum [Mar 8, 2018 5:32:05 PM] (inigoiri) HDFS-13232. RBF: ConnectionManager's cleanup task will compare each [Mar 8, 2018 6:17:02 PM] (xiao) HADOOP-15280. TestKMS.testWebHDFSProxyUserKerb and [Mar 8, 2018 6:23:36 PM] (sunilg) YARN-7944. [UI2] Remove master node link from headers of application [Mar 9, 2018 7:42:57 AM] (yqlin) HDFS-13233. RBF: MountTableResolver doesn't return the correct mount [Mar 9, 2018 10:44:07 AM] (stevel) HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation [Mar 9, 2018 4:41:16 PM] (jlowe) MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores [Mar 9, 2018 4:50:28 PM] (billie) YARN-8000. Yarn Service component instance name shows up as component [Mar 9, 2018 6:20:35 PM] (aajisaka) HADOOP-15293. TestLogLevel fails on Java 9 [Mar 9, 2018 9:20:32 PM] (hanishakoneru) HDFS-11394. Support for getting erasure coding policy through [Mar 9, 2018 11:06:15 PM] (aajisaka) HDFS-13190. Document WebHDFS support for snapshot diff [Mar 9, 2018 11:27:17 PM] (hanishakoneru) HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN [Mar 9, 2018 11:50:26 PM] (szetszwo) HDFS-13252. Code refactoring: Remove Diff.ListType. [Mar 10, 2018 1:18:51 AM] (inigoiri) HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei [Mar 10, 2018 2:25:05 AM] (inigoiri) HDFS-13232. RBF: ConnectionPool should return first usable connection. [Mar 10, 2018 3:28:55 AM] (yqlin) HDFS-13240. RBF: Update some inaccurate document descriptions. [Mar 10, 2018 6:46:30 AM] (wangda) Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed [Mar 10, 2018 6:46:41 AM] (wangda) Revert "HADOOP-13119.
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/13/ [Feb 26, 2018 4:28:04 PM] (kihwal) HDFS-12070. Failed block recovery leaves files open indefinitely and at [Feb 26, 2018 8:15:16 PM] (kkaranasos) YARN-7921. Transform a PlacementConstraint to a string expression. [Feb 26, 2018 9:56:34 PM] (arp) HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing [Feb 26, 2018 9:56:53 PM] (arp) HADOOP-15265. Exclude json-smart explicitly in hadoop-auth avoid being [Feb 26, 2018 10:32:46 PM] (billie) MAPREDUCE-7010. Make Job History File Permissions configurable. [Feb 26, 2018 11:13:41 PM] (weiy) HDFS-13187. RBF: Fix Routers information shown in the web UI. [Feb 26, 2018 11:49:01 PM] (eyang) YARN-7963. Updated MockServiceAM unit test to prevent test hang. [Feb 27, 2018 12:15:00 AM] (shv) HDFS-13145. SBN crash when transition to ANN with in-progress edit [Feb 27, 2018 2:48:52 AM] (yqlin) HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. [Feb 27, 2018 3:38:29 PM] (arp) HADOOP-15178. Generalize NetUtils#wrapException to handle other [Feb 27, 2018 4:48:03 PM] (inigoiri) HDFS-13193. Various Improvements for BlockTokenSecretManager. [Feb 27, 2018 4:53:00 PM] (inigoiri) HDFS-13192. Change the code order in getFileEncryptionInfo to avoid [Feb 27, 2018 6:15:43 PM] (arp) HADOOP-14959. DelegationTokenAuthenticator.authenticate() to wrap [Feb 27, 2018 6:18:07 PM] (arp) HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . [Feb 27, 2018 6:27:18 PM] (arp) MAPREDUCE-7061. SingleCluster setup document needs to be updated. [Feb 27, 2018 9:19:16 PM] (wangda) YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via [Feb 27, 2018 9:19:24 PM] (wangda) YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper [Feb 27, 2018 10:33:57 PM] (billie) YARN-7446. Remove --user flag when running privileged mode docker [Feb 27, 2018 11:28:41 PM] (szetszwo) HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if [Feb 28, 2018 1:39:02 AM] (inigoiri) HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. [Feb 28, 2018 2:17:43 AM] (yqlin) HDFS-13194. CachePool permissions incorrectly checked. Contributed by [Feb 28, 2018 9:58:09 AM] (wwei) YARN-7929. Support to set container execution type in SLS. (Jiandan Yang [Feb 28, 2018 1:11:07 PM] (stevel) HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17. [Feb 28, 2018 2:42:25 PM] (stevel) HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as [Feb 28, 2018 4:37:01 PM] (xyao) HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace [Feb 28, 2018 5:44:39 PM] (xyao) HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged [Feb 28, 2018 7:57:24 PM] (billie) YARN-7954. Set component status to STOPPED when YARN service is stopped. [Feb 28, 2018 9:42:58 PM] (szetszwo) HDFS-13102. Implement SnapshotSkipList class to store Multi level [Feb 28, 2018 11:01:56 PM] (billie) YARN-7955. Improve result of calling stop on an already stopped service. [Mar 1, 2018 1:48:55 AM] (eyang) YARN-7985. Removed duplicate service name validation in Yarn Service. [Mar 1, 2018 2:18:53 AM] (wwei) MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of [Mar 1, 2018 5:04:54 AM] (haibochen) yarn-7346.07.patch [Mar 1, 2018 5:10:42 AM] (haibochen) YARN-7835. Race condition in NM while publishing events if second [Mar 1, 2018 5:11:36 AM] (haibochen) Revert "yarn-7346.07.patch" [Mar 1, 2018 9:51:43 AM] (yqlin) HDFS-13202. Fix the outdated javadocs in HAUtil. Contributed by Chao [Mar 1, 2018 10:03:47 AM] (aajisaka) HADOOP-15275. Incorrect javadoc for return type of [Mar 1, 2018 4:00:13 PM] (billie) YARN-7958. ServiceMaster should only wait for recovery of containers [Mar 1, 2018 4:38:53 PM] (yufei) YARN-5028. RMStateStore should trim down app state for completed [Mar 1, 2018 5:09:32 PM] (sunilg) YARN-7637. GPU volume creation command fails when work preserving is [Mar 1, 2018 10:12:15 PM] (szetszwo) HDFS-13211. Fix a bug in DirectoryDiffList.getMinListForRange. [Mar 1, 2018 11:08:30 PM] (aajisaka) HADOOP-15274. Move hadoop-openstack to slf4j [Mar 1, 2018 11:32:43 PM] (aw) HADOOP-15279. increase maven heap size recommendations [Mar 1, 2018 11:36:10 PM] (rchiang) HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang) [Mar 2, 2018 3:49:12 AM] (yqlin) HDFS-13210. Fix the typo in MiniDFSCluster class. Contributed by fang [Mar 2, 2018 3:59:46 PM] (jlowe) YARN-7511. NPE in ContainerLocalizer when localization failed for [Mar 2, 2018 6:42:39 PM] (szetszwo) HDFS-1686. Federation: Add more Balancer tests with federation setting. [Mar 2, 2018 6:51:05 PM] (szetszwo) HDFS-13171. Handle Deletion of nodes in SnasphotSkipList. Contributed [Mar 2, 2018 11:47:43 PM] (aajisaka) HADOOP-15261. Upgrade commons-io from 2.4 to 2.5. Contributed by [Mar 3, 2018 12:15:04 AM] (aajisaka) MAPREDUCE-7023.
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/12/ [Feb 11, 2018 3:17:38 AM] (wangda) Preparing for 3.2.0 development [Feb 11, 2018 4:02:10 AM] (yqlin) HDFS-13130. Log object instance get incorrectly in SlowDiskTracker. [Feb 11, 2018 6:20:46 AM] (wwei) YARN-7838. Support AND/OR constraints in Distributed Shell. Contributed [Feb 12, 2018 2:25:22 AM] (wangda) YARN-7906. Fix mvn site fails with error: Multiple sources of package [Feb 12, 2018 2:27:15 AM] (wangda) YARN-5848. Remove unnecessary public/crossdomain.xml from YARN UIv2 sub [Feb 12, 2018 2:28:35 AM] (wangda) YARN-7697. NM goes down with OOM due to leak in log-aggregation. (Xuan [Feb 12, 2018 2:29:37 AM] (wangda) YARN-7739. DefaultAMSProcessor should properly check customized resource [Feb 12, 2018 3:13:00 PM] (stevel) HADOOP-15187. Remove ADL mock test dependency on REST call invoked from [Feb 12, 2018 3:17:40 PM] (arp) HDFS-10453. ReplicationMonitor thread could stuck for long time due to [Feb 12, 2018 3:27:43 PM] (jlowe) YARN-7917. Fix failing test [Feb 12, 2018 4:44:34 PM] (brahma) HDFS-8693. Addendum patch to execute the command using UGI. Contributed [Feb 12, 2018 7:21:09 PM] (jlowe) MAPREDUCE-7048. Uber AM can crash due to unknown task in statusUpdate. [Feb 12, 2018 9:50:10 PM] (jlowe) YARN-7914. Fix exit code handling for short lived Docker containers. [Feb 13, 2018 5:00:47 AM] (cdouglas) HADOOP-15195. With SELinux enabled, directories mounted with [Feb 13, 2018 5:06:10 AM] (cdouglas) Revert "HADOOP-15195. With SELinux enabled, directories mounted with [Feb 13, 2018 5:07:15 AM] (cdouglas) HADOOP-15195. With SELinux enabled, directories mounted with [Feb 13, 2018 4:11:02 PM] (epayne) YARN-7813: Capacity Scheduler Intra-queue Preemption should be [Feb 13, 2018 6:14:16 PM] (arp) HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO [Feb 14, 2018 2:51:22 AM] (fabbri) HADOOP-15040 Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log [Feb 14, 2018 3:11:10 PM] (wangda) YARN-7789. Should fail RM if 3rd resource type is configured but RM uses [Feb 14, 2018 4:20:14 PM] (stevel) HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions. [Feb 14, 2018 6:25:05 PM] (xiao) Revert "HADOOP-12897. KerberosAuthenticator.authenticate to include URL [Feb 14, 2018 8:29:20 PM] (epayne) Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be [Feb 14, 2018 9:11:37 PM] (aengineer) HADOOP-15204. Add Configuration API for parsing storage sizes. [Feb 15, 2018 11:33:44 AM] (szetszwo) HDFS-13142. Define and Implement a DiifList Interface to store and [Feb 15, 2018 2:26:00 PM] (stevel) HADOOP-15090. Add ADL troubleshooting doc. Contributed by Steve [Feb 15, 2018 2:57:56 PM] (stevel) HADOOP-15076. Enhance S3A troubleshooting documents and add a [Feb 15, 2018 3:57:10 PM] (stevel) HADOOP-15176. Enhance IAM Assumed Role support in S3A client. [Feb 15, 2018 4:27:31 PM] (stevel) HADOOP-13972. ADLS to support per-store configuration. Contributed by [Feb 15, 2018 5:11:55 PM] (kihwal) xattr api cleanup [Feb 15, 2018 9:12:57 PM] (jlowe) MAPREDUCE-7052. TestFixedLengthInputFormat#testFormatCompressedIn is [Feb 15, 2018 9:32:42 PM] (kihwal) HDFS-13112. Token expiration edits may cause log corruption or deadlock. [Feb 15, 2018 10:23:38 PM] (kkaranasos) YARN-7920. Simplify configuration for PlacementConstraints. Contributed [Feb 15, 2018 11:09:00 PM] (jlowe) YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim [Feb 16, 2018 7:07:40 AM] (sunilg) YARN-7292. Retrospect Resource Profile Behavior for overriding [Feb 16, 2018 7:22:24 AM] (aajisaka) HDFS-13151. Fix the javadoc error in ReplicaInfo [Feb 16, 2018 2:15:09 PM] (epayne) MAPREDUCE-7053: Timed out tasks can fail to produce thread dump. [Feb 16, 2018 4:37:06 PM] (stevel) HADOOP-14507. Extend per-bucket secret key config with explicit [Feb 16, 2018 5:38:34 PM] (arp) HDFS-13153. Enable HDFS diskbalancer by default. Contributed by Ajay [Feb 16, 2018 6:29:22 PM] (arp) HDFS-13058. Fix dfs.namenode.shared.edits.dir in TestJournalNode. [Feb 16, 2018 8:49:00 PM] (jlowe) HADOOP-15206. BZip2 drops and duplicates records when input split size [Feb 17, 2018 12:04:50 AM] (cliang) HDFS-13161. Update comment in start-dfs.sh to mention correct variable [Feb 17, 2018 4:28:08 AM] (wangda) YARN-7328. ResourceUtils allows [Feb 17, 2018 4:28:55 AM] (wangda) HADOOP-14875. Create end user documentation from the compatibility [Feb 17, 2018 11:24:55 AM] (arun suresh) YARN-7918. Fix TestAMRMClientPlacementConstraints. (Gergely Novák via [Feb 17, 2018 3:00:28 PM] (rohithsharmaks) YARN-7919. Refactor timelineservice-hbase module into submodules. [Feb 18, 2018 8:31:23 AM] (rohithsharmaks) YARN-7937. Fix http method name in Cluster Application Timeout Update [Feb 18, 2018 1:19:39 PM] (aajisaka) HADOOP-15223. Replace Collections.EMPTY* with empty* when available [Feb 19, 2018 3:42:10 AM] (szetszwo) HDFS-12998.
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/ [Feb 5, 2018 6:30:20 PM] (jlowe) YARN-7876. Localized jars that are expanded after localization are not [Feb 5, 2018 11:16:04 PM] (jlowe) YARN-7849. TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization [Feb 6, 2018 2:04:09 AM] (billie) YARN-7890. NPE during container relaunch. Contributed by Jason Lowe [Feb 6, 2018 6:56:25 AM] (jianhe) YARN-7889. Missing kerberos token when check for RM REST API [Feb 6, 2018 10:02:09 AM] (sunilg) YARN-7850. [UI2] Log Aggregation status to be displayed in Application [Feb 6, 2018 10:30:34 AM] (sunilg) YARN-7866. [UI2] Error to be displayed correctly while accessing [Feb 6, 2018 11:33:04 AM] (wwei) YARN-7860. Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning. [Feb 6, 2018 9:33:18 PM] (kihwal) HADOOP-15212. Add independent secret manager method for logging expired [Feb 6, 2018 9:43:45 PM] (aengineer) HDFS-12990. Change default NameNode RPC port back to 8020. Contributed [Feb 6, 2018 10:36:49 PM] (rkanter) YARN-7841. Cleanup AllocationFileLoaderService's reloadAllocations [Feb 6, 2018 10:46:44 PM] (szetszwo) HDFS-12947. Limit the number of Snapshots allowed to be created for a [Feb 6, 2018 11:39:00 PM] (mackrorysd) HDFS-13106. Need to exercise all HDFS APIs for EC. Contributed by Haibo [Feb 7, 2018 12:59:26 AM] (szetszwo) HDFS-13107. Add Mover Cli Unit Tests for Federated cluster. Contributed [Feb 7, 2018 6:54:53 AM] (xiao) HDFS-12933. Improve logging when DFSStripedOutputStream failed to write [Feb 7, 2018 3:09:45 PM] (billie) YARN-7516. Add security check for trusted docker images. Contributed by [Feb 7, 2018 3:17:00 PM] (billie) Revert "YARN-6078. Containers stuck in Localizing state. Contributed by [Feb 7, 2018 5:40:33 PM] (brahma) HDFS-12935. Get ambiguous result for DFSAdmin command in HA mode when [Feb 7, 2018 7:09:08 PM] (jlowe) YARN-7815. Make the YARN mounts added to Docker containers more [Feb 7, 2018 7:22:36 PM] (jitendra) HDFS-11701. NPE from Unresolved Host causes permanent DFSInputStream [Feb 7, 2018 8:58:09 PM] (yzhang) HDFS-13115. In getNumUnderConstructionBlocks(), ignore the inodeIds for [Feb 8, 2018 4:59:48 PM] (xyao) HDFS-13120. Snapshot diff could be corrupted after concat. Contributed [Feb 8, 2018 6:55:54 PM] (stevel) HADOOP-15214. Make Hadoop compatible with Guava 21.0. Contributed by [Feb 8, 2018 7:35:30 PM] (jianhe) YARN-5428. Allow for specifying the docker client configuration [Feb 8, 2018 8:32:43 PM] (yufei) YARN-7655. Avoid AM preemption caused by RRs for specific nodes or [Feb 9, 2018 5:32:40 AM] (jianhe) YARN-7827. Stop and Delete Yarn Service from RM UI fails with HTTP ERROR [Feb 9, 2018 5:57:42 AM] (yqlin) HDFS-13099. RBF: Use the ZooKeeper as the default State Store. [Feb 10, 2018 1:01:25 AM] (eyang) YARN-7909. Add charset to YARN Service REST API. (Contributed by Eric -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/patch-mvninstall-root.txt [1.8M] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/patch-compile-root.txt [48K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/patch-compile-root.txt [48K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/patch-compile-root.txt [48K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/diff-checkstyle-root.txt [3.1M] mvnsite: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/patch-mvnsite-root.txt [48K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/whitespace-eol.txt [9.2M] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/whitespace-tabs.txt [292K] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/xml.txt [8.0K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/11/artifact/out/branch-findbugs-hadoop-common-project_hadoop-annotations.txt [296K]
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/ [Feb 2, 2018 2:03:01 AM] (aengineer) HDFS-12942. Synchronization issue in FSDataSetImpl#moveBlock. [Feb 2, 2018 3:25:41 AM] (yqlin) HDFS-13068. RBF: Add router admin option to manage safe mode. [Feb 2, 2018 5:34:07 AM] (aajisaka) HDFS-13048. LowRedundancyReplicatedBlocks metric can be negative [Feb 2, 2018 5:33:26 PM] (jlowe) HADOOP-15170. Add symlink support to FileUtil#unTarUsingJava. [Feb 2, 2018 6:28:22 PM] (arun suresh) YARN-7839. Modify PlacementAlgorithm to Check node capacity before [Feb 2, 2018 7:10:47 PM] (jianhe) YARN-7868. Provide improved error message when YARN service is disabled. [Feb 2, 2018 7:37:51 PM] (arp) HADOOP-15198. Correct the spelling in CopyFilter.java. Contributed by [Feb 2, 2018 8:51:27 PM] (hanishakoneru) HADOOP-15168. Add kdiag tool to hadoop command. Contributed by Bharat [Feb 2, 2018 10:38:33 PM] (jianhe) YARN-7831. YARN Service CLI should use hadoop.http.authentication.type [Feb 2, 2018 10:46:20 PM] (kkaranasos) YARN-7778. Merging of placement constraints defined at different levels. [Feb 3, 2018 12:28:03 AM] (hanishakoneru) HDFS-13073. Cleanup code in InterQJournalProtocol.proto. Contributed by [Feb 3, 2018 12:48:57 AM] (szegedim) YARN-7879. NM user is unable to access the application filecache due to [Feb 3, 2018 1:18:42 AM] (weichiu) HDFS-11187. Optimize disk access for last partial chunk checksum of [Feb 3, 2018 6:58:44 AM] (yzhang) HDFS-13100. Handle IllegalArgumentException when GETSERVERDEFAULTS is -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/patch-mvninstall-root.txt [1.6M] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/patch-compile-root.txt [48K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/patch-compile-root.txt [48K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/patch-compile-root.txt [48K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/diff-checkstyle-root.txt [3.1M] mvnsite: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/patch-mvnsite-root.txt [48K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/whitespace-eol.txt [9.2M] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/whitespace-tabs.txt [292K] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/xml.txt [8.0K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-common-project_hadoop-annotations.txt [200K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-common-project_hadoop-auth.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-common-project_hadoop-auth-examples.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-common-project_hadoop-common.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-common-project_hadoop-kms.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-common-project_hadoop-minikdc.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-common-project_hadoop-nfs.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/10/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt [8.0K]
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/ No changes -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/patch-mvninstall-root.txt [1.7M] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/patch-compile-root.txt [48K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/patch-compile-root.txt [48K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/patch-compile-root.txt [48K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/diff-checkstyle-root.txt [3.1M] mvnsite: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/patch-mvnsite-root.txt [48K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/whitespace-eol.txt [9.2M] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/whitespace-tabs.txt [292K] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/xml.txt [8.0K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-common-project_hadoop-annotations.txt [260K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-common-project_hadoop-auth.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-common-project_hadoop-auth-examples.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-common-project_hadoop-common.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-common-project_hadoop-kms.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-common-project_hadoop-minikdc.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-common-project_hadoop-nfs.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-nfs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-app.txt [36K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-common.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-plugins.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [20K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/9/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [12K]
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/8/ [Oct 29, 2017 11:44:16 PM] (yufei) YARN-6747. TestFSAppStarvation.testPreemptionEnable fails [Oct 30, 2017 1:54:33 AM] (templedf) YARN-7374. Improve performance of DRF comparisons for resource types in [Oct 30, 2017 4:49:22 PM] (cdouglas) HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat [Oct 30, 2017 6:04:22 PM] (templedf) YARN-6927. Add support for individual resource types requests in [Oct 30, 2017 7:41:28 PM] (templedf) YARN-7336. Unsafe cast from long to int Resource.hashCode() method [Oct 30, 2017 10:16:51 PM] (junping_du) HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. [Oct 31, 2017 4:49:15 AM] (aajisaka) HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. [Oct 31, 2017 4:50:28 AM] (aajisaka) Revert "HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. [Oct 31, 2017 4:51:26 AM] (aajisaka) HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. [Oct 31, 2017 7:36:02 AM] (aajisaka) YARN-7407. Moving logging APIs over to slf4j in [Oct 31, 2017 8:09:45 AM] (aajisaka) YARN-7379. Moving logging APIs over to slf4j in hadoop-yarn-client. [Oct 31, 2017 2:30:13 PM] (jlowe) HADOOP-14919. BZip2 drops records when reading data in splits. [Oct 31, 2017 2:34:01 PM] (mackrorysd) HDFS-206. Support for head in FSShell. Contributed by Gabor Bota. [Oct 31, 2017 4:44:01 PM] (cdouglas) HDFS-7878. API - expose a unique file identifier. [Oct 31, 2017 5:21:42 PM] (inigoiri) HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo [Oct 31, 2017 5:23:00 PM] (arp) HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode [Oct 31, 2017 5:46:10 PM] (wang) Revert "HDFS-12499. dfs.namenode.shared.edits.dir property is currently [Oct 31, 2017 7:05:43 PM] (subru) YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via [Nov 1, 2017 4:58:14 AM] (lei) HDFS-12482. Provide a configuration to adjust the weight of EC recovery [Nov 1, 2017 5:44:16 AM] (jzhuge) HDFS-12714. Hadoop 3 missing fix for HDFS-5169. Contributed by Joe [Nov 1, 2017 6:37:08 AM] (yqlin) HDFS-12219. Javadoc for FSNamesystem#getMaxObjects is incorrect. [Nov 1, 2017 8:41:45 AM] (wwei) HDFS-12744. More logs when short-circuit read is failed and disabled. [Nov 1, 2017 8:26:37 PM] (inigoiri) YARN-7276 addendum to add timeline service depencies. Contributed by [Nov 1, 2017 9:48:16 PM] (junping_du) YARN-7400. Incorrect log preview displayed in jobhistory server ui. [Nov 1, 2017 10:39:56 PM] (eyang) YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed [Nov 2, 2017 12:00:32 AM] (jianhe) YARN-7396. NPE when accessing container logs due to null dirsHandler. [Nov 2, 2017 8:25:19 AM] (rohithsharmaks) addendum patch for YARN-7289. [Nov 2, 2017 8:43:08 AM] (aajisaka) MAPREDUCE-6983. Moving logging APIs over to slf4j in [Nov 2, 2017 9:12:04 AM] (sammi.chen) HADOOP-14997. Add hadoop-aliyun as dependency of hadoop-cloud-storage. [Nov 2, 2017 9:32:24 AM] (aajisaka) MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by [Nov 2, 2017 2:37:17 PM] (jlowe) YARN-7286. Add support for docker to have no capabilities. Contributed [Nov 2, 2017 4:51:28 PM] (wangda) YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil [Nov 2, 2017 5:37:33 PM] (epayne) YARN-7370: Preemption properties should be refreshable. Contrubted by [Nov 3, 2017 12:15:33 AM] (arun suresh) HADOOP-15013. Fix ResourceEstimator findbugs issues. (asuresh) [Nov 3, 2017 12:39:23 AM] (subru) YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs [Nov 3, 2017 1:55:29 AM] (sunilg) YARN-7410. Cleanup FixedValueResource to avoid dependency to [Nov 3, 2017 4:27:35 AM] (xiao) HDFS-12682. ECAdmin -listPolicies will always show [Nov 3, 2017 4:29:53 AM] (inigoiri) YARN-7434. Router getApps REST invocation fails with multiple RMs. [Nov 3, 2017 4:53:13 AM] (xiao) HDFS-12725. BlockPlacementPolicyRackFaultTolerant fails with very uneven [Nov 3, 2017 6:15:50 AM] (sunilg) YARN-7392. Render cluster information on new YARN web ui. Contributed by [Nov 3, 2017 7:05:45 PM] (xiao) HDFS-11467. Support ErasureCoding section in OIV XML/ReverseXML. [Nov 3, 2017 8:16:46 PM] (kihwal) HDFS-12771. Add genstamp and block size to metasave Corrupt blocks list. [Nov 3, 2017 9:30:57 PM] (cdouglas) HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus. [Nov 3, 2017 11:10:37 PM] (xyao) HADOOP-14987. Improve KMSClientProvider log around delegation token [Nov 4, 2017 3:34:40 AM] (xyao) HDFS-10528. Add logging to successful standby checkpointing. Contributed [Nov 4, 2017 4:01:56 AM] (liuml07) HADOOP-15015. TestConfigurationFieldsBase to use SLF4J for logging. [Nov 6, 2017 7:28:38 AM] (naganarasimha_gr) MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph. [Nov 6, 2017 5:09:10 PM] (bibinchundatt) Add containerId to Localizer failed logs. Contributed by
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/7/ [Oct 25, 2017 5:17:56 AM] (haibochen) YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter [Oct 25, 2017 8:17:21 AM] (aajisaka) HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu [Oct 25, 2017 2:40:33 PM] (aajisaka) HADOOP-14979. Upgrade maven-dependency-plugin to 3.0.2. Contributed by [Oct 25, 2017 3:08:22 PM] (aw) HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs [Oct 25, 2017 5:54:40 PM] (manojpec) HDFS-12544. SnapshotDiff - support diff generation on any snapshot root [Oct 25, 2017 9:11:30 PM] (xiao) HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in [Oct 25, 2017 9:24:22 PM] (arp) HDFS-12579. JournalNodeSyncer should use fromUrl field of [Oct 25, 2017 10:07:50 PM] (subru) YARN-4827. Document configuration of ReservationSystem for [Oct 25, 2017 10:51:27 PM] (subru) HADOOP-14840. Tool to estimate resource requirements of an application [Oct 26, 2017 5:25:10 PM] (rkanter) YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore [Oct 26, 2017 7:10:14 PM] (subu) YARN-5516. Add REST API for supporting recurring reservations. (Sean Po [Oct 26, 2017 10:50:14 PM] (rkanter) YARN-7320. Duplicate LiteralByteStrings in [Oct 27, 2017 12:47:32 AM] (rkanter) YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token [Oct 27, 2017 2:13:58 AM] (junping_du) Update CHANGES.md and RELEASENOTES for 2.8.2 release. [Oct 27, 2017 2:15:35 AM] (junping_du) Set jdiff stable version to 2.8.2. [Oct 27, 2017 2:30:48 AM] (junping_du) Add several jdiff xml files for 2.8.2 release. [Oct 27, 2017 3:15:19 AM] (wangda) YARN-7307. Allow client/AM update supported resource types via YARN [Oct 27, 2017 9:45:03 AM] (stevel) MAPREDUCE-6977 Move logging APIs over to slf4j in [Oct 27, 2017 2:43:54 PM] (arp) HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by [Oct 27, 2017 3:23:57 PM] (sunilg) YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active [Oct 27, 2017 5:16:38 PM] (rohithsharmaks) YARN-7289. Application lifetime does not work with FairScheduler. [Oct 27, 2017 9:41:37 PM] (yufei) YARN-6505. Define the strings used in SLS JSON input file format. [Oct 27, 2017 9:56:05 PM] (jlowe) YARN-7244. ShuffleHandler is not aware of disks that are added. [Oct 27, 2017 10:36:03 PM] (cdouglas) HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. [Oct 27, 2017 11:46:05 PM] (inigoiri) YARN-7276. Federation Router Web Service fixes. Contributed by Inigo [Oct 28, 2017 1:47:45 AM] (cdouglas) HADOOP-14986. Enforce JDK limitations. [Oct 28, 2017 4:59:27 AM] (cdouglas) HADOOP-14991. Add missing figures to Resource Estimator tool. [Oct 28, 2017 5:56:41 AM] (Arun Suresh) YARN-7178. Add documentation for Container Update API. (asuresh) [Oct 28, 2017 6:08:18 AM] (Arun Suresh) YARN-7299. Fix TestDistributedScheduler. (asuresh) [Oct 28, 2017 4:13:13 PM] (templedf) YARN-7397. Reduce lock contention in FairScheduler#getAppWeight() [Oct 29, 2017 5:38:44 AM] (sunilg) YARN-7224. Support GPU isolation for docker container. Contributed by ERROR: File 'out/email-report.txt' does not exist - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/ No changes -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite shadedclient unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace Specific tests: Failed junit tests : hadoop.security.authentication.util.TestKerberosName hadoop.security.authentication.server.TestAltKerberosAuthenticationHandler hadoop.security.authentication.client.TestKerberosAuthenticator hadoop.minikdc.TestChangeOrgNameAndDomain hadoop.minikdc.TestMiniKdc mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/patch-mvninstall-root.txt [1.6M] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/patch-compile-root.txt [48K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/patch-compile-root.txt [48K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/patch-compile-root.txt [48K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/diff-checkstyle-root.txt [3.1M] mvnsite: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/patch-mvnsite-root.txt [44K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/whitespace-eol.txt [8.5M] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/whitespace-tabs.txt [292K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-common-project_hadoop-annotations.txt [288K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-common-project_hadoop-auth.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-common-project_hadoop-auth-examples.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-common-project_hadoop-common.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-common-project_hadoop-kms.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-common-project_hadoop-minikdc.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-common-project_hadoop-nfs.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-nfs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-app.txt [36K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-common.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-plugins.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/3/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [20K]
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/ [Oct 20, 2017 9:24:17 PM] (haibochen) YARN-7372. [Oct 20, 2017 9:27:04 PM] (stevel) HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. [Oct 20, 2017 10:54:15 PM] (wangda) YARN-7318. Fix shell check warnings of SLS. (Gergely Novák via wangda) [Oct 20, 2017 11:13:41 PM] (jzhuge) HADOOP-14954. MetricsSystemImpl#init should increment refCount when [Oct 20, 2017 11:25:04 PM] (xiao) HDFS-12518. Re-encryption should handle task cancellation and progress -1 overall The following subsystems voted -1: compile findbugs mvninstall mvnsite shadedclient unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace Specific tests: Failed junit tests : hadoop.security.authentication.client.TestKerberosAuthenticator hadoop.security.authentication.util.TestKerberosName hadoop.security.authentication.server.TestAltKerberosAuthenticationHandler hadoop.minikdc.TestChangeOrgNameAndDomain hadoop.minikdc.TestMiniKdc mvninstall: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/patch-mvninstall-root.txt [1.7M] compile: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/patch-compile-root.txt [48K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/patch-compile-root.txt [48K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/patch-compile-root.txt [48K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/diff-checkstyle-root.txt [3.1M] mvnsite: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/patch-mvnsite-root.txt [40K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/whitespace-eol.txt [8.5M] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/whitespace-tabs.txt [292K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-common-project_hadoop-annotations.txt [276K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-common-project_hadoop-auth.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-common-project_hadoop-auth-examples.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-common-project_hadoop-common.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-common-project_hadoop-kms.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-common-project_hadoop-minikdc.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-common-project_hadoop-nfs.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-nfs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-app.txt [36K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-common.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/artifact/out/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [12K]
