Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64
For more details, see https://builds.apache.org/job/hadoop-trunk-win/525/ [Jul 10, 2018 2:41:47 PM] (sunilg) YARN-8473. Containers being launched as app tears down can leave [Jul 10, 2018 3:52:57 PM] (mackrorysd) HADOOP-15541. [s3a] Shouldn't try to drain stream before aborting [Jul 10, 2018 5:36:17 PM] (gifuma) YARN-8502. Use path strings consistently for webservice endpoints in [Jul 10, 2018 7:17:44 PM] (aw) HDFS-13722. HDFS Native Client Fails Compilation on Ubuntu 18.04 [Jul 10, 2018 9:07:23 PM] (xyao) HDDS-208. ozone createVolume command ignores the first character of the [Jul 10, 2018 10:58:47 PM] (aengineer) HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event and [Jul 11, 2018 6:56:32 AM] (sunilg) YARN-8512. ATSv2 entities are not published to HBase from second attempt [Jul 11, 2018 10:50:29 AM] (bibinchundatt) YARN-8491. TestServiceCLI#testEnableFastLaunch fail when umask is 077. [Jul 11, 2018 2:11:59 PM] (yqlin) HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu [Jul 11, 2018 2:53:08 PM] (aajisaka) HADOOP-15594. Exclude commons-lang3 from hadoop-client-minicluster. [Jul 11, 2018 5:02:08 PM] (weichiu) HDFS-13723. Occasional "Should be different group" error in [Jul 11, 2018 6:46:43 PM] (aajisaka) HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor [Jul 11, 2018 7:03:42 PM] (aengineer) Revert "HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event" [Jul 11, 2018 7:08:50 PM] (aengineer) HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event and [Jul 12, 2018 4:03:19 AM] (xiao) HDFS-12837. Intermittent failure in TestReencryptionWithKMS. -1 overall The following subsystems voted -1: compile mvninstall pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed junit tests : hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec hadoop.fs.contract.rawlocal.TestRawlocalContractAppend hadoop.fs.TestFileUtil hadoop.fs.TestFsShellCopy hadoop.fs.TestFsShellList hadoop.http.TestHttpServer hadoop.http.TestHttpServerLogs hadoop.io.nativeio.TestNativeIO hadoop.ipc.TestSocketFactory hadoop.metrics2.impl.TestStatsDMetrics hadoop.security.TestGroupsCaching hadoop.security.TestSecurityUtil hadoop.security.TestShellBasedUnixGroupsMapping hadoop.security.token.TestDtUtilShell hadoop.util.TestDiskCheckerWithDiskIo hadoop.util.TestNativeCodeLoader hadoop.hdfs.qjournal.server.TestJournalNode hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics hadoop.hdfs.server.datanode.TestDataNodeFaultInjector hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC hadoop.hdfs.server.mover.TestMover hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs hadoop.hdfs.TestDFSShell hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy hadoop.hdfs.TestDFSStripedOutputStreamWithFailure hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.TestDFSUpgradeFromImage hadoop.hdfs.TestFetchImage hadoop.hdfs.TestHDFSFileSystemContract hadoop.hdfs.TestLeaseRecovery2 hadoop.hdfs.TestPread hadoop.hdfs.TestReadStripedFileWithDecodingDeletedData hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy hadoop.hdfs.TestSecureEncryptionZoneWithKMS hadoop.hdfs.TestTrashWithSecureEncryptionZones hadoop.hdfs.tools.TestDFSAdmin hadoop.hdfs.web.TestWebHDFS hadoop.hdfs.web.TestWebHdfsUrl hadoop.fs.http.server.TestHttpFSServerWebServer hadoop.yarn.logaggregation.filecontroller.ifile.TestLogAggregationIndexFileController hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch hadoop.yarn.server.nodemanager.containermanager.TestAuxServices hadoop.yarn.server.nodemanager.containermanager.TestContainerManager hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService
[jira] [Created] (HDFS-13734) Add Heapsize variables for HDFS daemons
Brandon Scheller created HDFS-13734: --- Summary: Add Heapsize variables for HDFS daemons Key: HDFS-13734 URL: https://issues.apache.org/jira/browse/HDFS-13734 Project: Hadoop HDFS Issue Type: New Feature Components: datanode, journal-node, namenode Affects Versions: 3.0.3 Reporter: Brandon Scheller Currently there are no variables to set HDFS daemon heapsize differently. While still possible through adding the -Xmx to HDFS_*DAEMON*_OPTS, this is not intuitive for this relatively common setting. YARN currently has these separate YARN_*DAEMON*_HEAPSIZE variables supported so it seems natural for HDFS too. It also looks like HDFS use to have this for namenode with HADOOP_NAMENODE_INIT_HEAPSIZE This JIRA is to have these configurations added/supported -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-252) Eliminate the datanode ID file
Bharat Viswanadham created HDDS-252: --- Summary: Eliminate the datanode ID file Key: HDDS-252 URL: https://issues.apache.org/jira/browse/HDDS-252 Project: Hadoop Distributed Data Store Issue Type: Improvement Reporter: Bharat Viswanadham Assignee: Bharat Viswanadham This Jira is to remove the datanodeID file. After ContainerIO work (HDDS-48 branch) is merged, we have a version file in each Volume which stores datanodeUuid and some additional fields in that file. And also if this disk containing datanodeId path is removed, that DN will now be unusable with current code. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/ [Jul 11, 2018 6:56:32 AM] (sunilg) YARN-8512. ATSv2 entities are not published to HBase from second attempt [Jul 11, 2018 10:50:29 AM] (bibinchundatt) YARN-8491. TestServiceCLI#testEnableFastLaunch fail when umask is 077. [Jul 11, 2018 2:11:59 PM] (yqlin) HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu [Jul 11, 2018 2:53:08 PM] (aajisaka) HADOOP-15594. Exclude commons-lang3 from hadoop-client-minicluster. [Jul 11, 2018 5:02:08 PM] (weichiu) HDFS-13723. Occasional "Should be different group" error in [Jul 11, 2018 6:46:43 PM] (aajisaka) HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor [Jul 11, 2018 7:03:42 PM] (aengineer) Revert "HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event" [Jul 11, 2018 7:08:50 PM] (aengineer) HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event and -1 overall The following subsystems voted -1: asflicense findbugs pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed CTEST tests : test_test_libhdfs_threaded_hdfs_static test_libhdfs_threaded_hdfspp_test_shim_static Failed junit tests : hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.mapred.TestMRTimelineEventHandling cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-compile-javac-root.txt [360K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-checkstyle-root.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/whitespace-eol.txt [9.4M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/xml.txt [4.0K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-hdds_client.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_client.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_common.txt [28K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_ozonefs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_tools.txt [4.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-javadoc-javadoc-root.txt [760K] CTEST: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt [116K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [440K]
[jira] [Created] (HDFS-13733) RBF: Add Web UI configurations and descriptions to RBF document
Takanobu Asanuma created HDFS-13733: --- Summary: RBF: Add Web UI configurations and descriptions to RBF document Key: HDFS-13733 URL: https://issues.apache.org/jira/browse/HDFS-13733 Project: Hadoop HDFS Issue Type: Sub-task Components: documentation Reporter: Takanobu Asanuma Assignee: Takanobu Asanuma Looks like Web UI configurations and descriptions are lack in the document at the moment. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13732) Erasure Coding policy name is not coming when the new policy is set
Soumyapn created HDFS-13732: --- Summary: Erasure Coding policy name is not coming when the new policy is set Key: HDFS-13732 URL: https://issues.apache.org/jira/browse/HDFS-13732 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs Affects Versions: 3.0.0 Reporter: Soumyapn Fix For: 3.1.0 Attachments: EC_Policy.PNG Scenerio: If the new policy apart from the default EC policy is set for the HDFS directory, then the console message is coming as "Set default erasure coding policy on " Expected output: It would be good If the EC policy name is displayed when the policy is set... Actual output: Set default erasure coding policy on -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
