[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483423#comment-16483423 ]
genericqa commented on HDFS-13601: ---------------------------------- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 37s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 1 new or modified test files. {color} | || || || || {color:brown} trunk Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 10s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 25m 48s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 16m 41s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 6s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m 46s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 13m 14s{color} | {color:green} branch has no errors when building and testing our client artifacts. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 35s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 15s{color} | {color:green} trunk passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 11s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 42s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 16m 32s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 16m 32s{color} | {color:green} the patch passed {color} | | {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange} 0m 59s{color} | {color:orange} hadoop-hdfs-project: The patch generated 2 new + 51 unchanged - 0 fixed = 53 total (was 51) {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m 40s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:red}-1{color} | {color:red} shadedclient {color} | {color:red} 11m 2s{color} | {color:red} patch has errors when building and testing our client artifacts. {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m 46s{color} | {color:red} hadoop-hdfs-project/hadoop-hdfs-client generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0) {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m 4s{color} | {color:red} hadoop-hdfs-project/hadoop-hdfs generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 13s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} unit {color} | {color:green} 1m 31s{color} | {color:green} hadoop-hdfs-client in the patch passed. {color} | | {color:red}-1{color} | {color:red} unit {color} | {color:red} 71m 54s{color} | {color:red} hadoop-hdfs in the patch failed. {color} | | {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m 28s{color} | {color:red} The patch generated 1 ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black}174m 18s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | FindBugs | module:hadoop-hdfs-project/hadoop-hdfs-client | | | Found reliance on default encoding in new org.apache.hadoop.hdfs.protocol.DatanodeID(String, String, String, int, int, int, int):in new org.apache.hadoop.hdfs.protocol.DatanodeID(String, String, String, int, int, int, int): String.getBytes() At DatanodeID.java:[line 99] | | | Found reliance on default encoding in org.apache.hadoop.hdfs.protocolPB.PBHelperClient.getFixedByteString(String):in org.apache.hadoop.hdfs.protocolPB.PBHelperClient.getFixedByteString(String): String.getBytes() At PBHelperClient.java:[line 258] | | | Return value of putIfAbsent is ignored, but value is reused in org.apache.hadoop.hdfs.protocolPB.PBHelperClient.getFixedByteString(String) At PBHelperClient.java:ignored, but value is reused in org.apache.hadoop.hdfs.protocolPB.PBHelperClient.getFixedByteString(String) At PBHelperClient.java:[line 259] | | | Return value of putIfAbsent is ignored, but value is reused in org.apache.hadoop.hdfs.protocolPB.PBHelperClient.getFixedByteString(Text) At PBHelperClient.java:ignored, but value is reused in org.apache.hadoop.hdfs.protocolPB.PBHelperClient.getFixedByteString(Text) At PBHelperClient.java:[line 250] | | | Found reliance on default encoding in org.apache.hadoop.hdfs.protocolPB.PBHelperClient$1.load(String):in org.apache.hadoop.hdfs.protocolPB.PBHelperClient$1.load(String): String.getBytes() At PBHelperClient.java:[line 274] | | FindBugs | module:hadoop-hdfs-project/hadoop-hdfs | | | Found reliance on default encoding in new org.apache.hadoop.hdfs.server.protocol.DatanodeRegistration(String, DatanodeRegistration):in new org.apache.hadoop.hdfs.server.protocol.DatanodeRegistration(String, DatanodeRegistration): String.getBytes() At DatanodeRegistration.java:[line 48] | | Failed junit tests | hadoop.hdfs.TestParallelShortCircuitRead | | | hadoop.fs.contract.hdfs.TestHDFSContractMkdir | | | hadoop.hdfs.TestBlockStoragePolicy | | | hadoop.hdfs.TestEncryptedTransfer | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics | | | hadoop.hdfs.TestDFSInotifyEventInputStream | | | hadoop.hdfs.TestSnapshotCommands | | | hadoop.hdfs.TestFileLengthOnClusterRestart | | | hadoop.hdfs.TestAppendSnapshotTruncate | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing | | | hadoop.hdfs.TestRead | | | hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots | | | hadoop.hdfs.TestBlocksScheduledCounter | | | hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate | | | hadoop.cli.TestHDFSCLI | | | hadoop.hdfs.TestDFSPermission | | | hadoop.hdfs.server.datanode.TestBatchIbr | | | hadoop.hdfs.server.namenode.TestCheckpoint | | | hadoop.hdfs.TestReplaceDatanodeOnFailure | | | hadoop.hdfs.server.namenode.TestStartup | | | hadoop.hdfs.server.namenode.TestNestedEncryptionZones | | | hadoop.hdfs.TestDFSStorageStateRecovery | | | hadoop.hdfs.TestDFSStripedOutputStreamWithRandomECPolicy | | | hadoop.hdfs.TestMultiThreadedHflush | | | hadoop.fs.contract.hdfs.TestHDFSContractRename | | | hadoop.hdfs.TestDFSClientFailover | | | hadoop.hdfs.server.mover.TestMover | | | hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks | | | hadoop.hdfs.TestErasureCodingPoliciesWithRandomECPolicy | | | hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality | | | hadoop.hdfs.TestLeaseRecovery2 | | | hadoop.fs.loadGenerator.TestLoadGenerator | | | hadoop.hdfs.TestDataStream | | | hadoop.hdfs.server.namenode.TestLargeDirectoryDelete | | | hadoop.hdfs.TestWriteConfigurationToDFS | | | hadoop.fs.TestFcHdfsSetUMask | | | hadoop.hdfs.TestPread | | | hadoop.hdfs.server.namenode.TestFSEditLogLoader | | | hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation | | | hadoop.hdfs.server.namenode.ha.TestQuotasWithHA | | | hadoop.hdfs.crypto.TestHdfsCryptoStreams | | | hadoop.fs.viewfs.TestViewFsFileStatusHdfs | | | hadoop.hdfs.server.datanode.TestReadOnlySharedStorage | | | hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl | | | hadoop.hdfs.web.TestHttpsFileSystem | | | hadoop.tracing.TestTracingShortCircuitLocalRead | | | hadoop.hdfs.TestDecommissionWithStriped | | | hadoop.hdfs.web.TestWebHdfsUrl | | | hadoop.hdfs.server.namenode.TestFSDirectory | | | hadoop.hdfs.server.datanode.TestDataNodeFaultInjector | | | hadoop.hdfs.TestApplyingStoragePolicy | | | hadoop.hdfs.server.datanode.TestBlockScanner | | | hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency | | | hadoop.tracing.TestTracing | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol | | | hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles | | | hadoop.hdfs.TestParallelRead | | | hadoop.hdfs.TestDFSStripedInputStream | | | hadoop.hdfs.tools.TestDelegationTokenFetcher | | | hadoop.hdfs.TestRestartDFS | | | hadoop.fs.TestWebHdfsFileContextMainOperations | | | hadoop.hdfs.TestParallelShortCircuitReadNoChecksum | | | hadoop.hdfs.server.blockmanagement.TestSequentialBlockId | | | hadoop.hdfs.TestDFSOutputStream | | | hadoop.hdfs.server.namenode.TestNamenodeStorageDirectives | | | hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages | | | hadoop.hdfs.TestSetTimes | | | hadoop.hdfs.TestParallelShortCircuitLegacyRead | | | hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock | | | hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS | | | hadoop.hdfs.TestReadStripedFileWithMissingBlocks | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory | | | hadoop.hdfs.TestDatanodeDeath | | | hadoop.hdfs.server.datanode.TestDataNodeVolumeMetrics | | | hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA | | | hadoop.hdfs.server.namenode.ha.TestPipelinesFailover | | | hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer | | | hadoop.hdfs.server.diskbalancer.TestDiskBalancer | | | hadoop.fs.TestFcHdfsCreateMkdir | | | hadoop.hdfs.TestHFlush | | | hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled | | | hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication | | | hadoop.hdfs.server.namenode.ha.TestDNFencing | | | hadoop.hdfs.TestDFSRollback | | | hadoop.hdfs.TestDFSUpgrade | | | hadoop.fs.TestFcHdfsPermission | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap | | | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration | | | hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks | | | hadoop.hdfs.server.namenode.TestNamenodeRetryCache | | | hadoop.hdfs.server.datanode.TestFsDatasetCache | | | hadoop.hdfs.server.namenode.TestAddStripedBlockInFBR | | | hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN | | | hadoop.hdfs.TestMissingBlocksAlert | | | hadoop.hdfs.server.namenode.TestNNThroughputBenchmark | | | hadoop.hdfs.server.namenode.ha.TestHAMetrics | | | hadoop.hdfs.TestQuota | | | hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer | | | hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot | | | hadoop.hdfs.TestReplaceDatanodeFailureReplication | | | hadoop.hdfs.server.namenode.TestQuotaByStorageType | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion | | | hadoop.hdfs.server.namenode.TestParallelImageWrite | | | hadoop.hdfs.server.datanode.TestDataNodeTcpNoDelay | | | hadoop.hdfs.tools.TestDebugAdmin | | | hadoop.hdfs.server.datanode.TestDiskError | | | hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots | | | hadoop.hdfs.server.namenode.TestNameEditsConfigs | | | hadoop.hdfs.TestErasureCodingExerciseAPIs | | | hadoop.hdfs.server.namenode.TestSnapshotPathINodes | | | hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd | | | hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer | | | hadoop.hdfs.server.namenode.TestGetContentSummaryWithPermission | | | hadoop.hdfs.shortcircuit.TestShortCircuitCache | | | hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup | | | hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters | | | hadoop.hdfs.TestModTime | | | hadoop.hdfs.server.blockmanagement.TestBlockManager | | | hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations | | | hadoop.hdfs.TestSetrepIncreasing | | | hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy | | | hadoop.hdfs.TestGetBlocks | | | hadoop.hdfs.TestDFSStartupVersions | | | hadoop.hdfs.TestReadWhileWriting | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl | | | hadoop.hdfs.TestRenameWhileOpen | | | hadoop.tools.TestJMXGet | | | hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead | | | hadoop.hdfs.TestHDFSFileSystemContract | | | hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter | | | hadoop.hdfs.TestFileAppend4 | | | hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy | | | hadoop.hdfs.server.namenode.TestAddBlock | | | hadoop.hdfs.TestDataTransferKeepalive | | | hadoop.hdfs.server.datanode.TestDataNodeMetrics | | | hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes | | | hadoop.security.TestPermissionSymlinks | | | hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA | | | hadoop.hdfs.server.namenode.TestINodeFile | | | hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer | | | hadoop.hdfs.TestFileAppend2 | | | hadoop.hdfs.TestErasureCodeBenchmarkThroughput | | | hadoop.hdfs.TestSetrepDecreasing | | | hadoop.hdfs.server.namenode.TestProcessCorruptBlocks | | | hadoop.hdfs.security.TestDelegationTokenForProxyUser | | | hadoop.hdfs.server.namenode.TestAuditLogs | | | hadoop.fs.TestSWebHdfsFileContextMainOperations | | | hadoop.hdfs.TestInjectionForSimulatedStorage | | | hadoop.hdfs.server.namenode.TestFsck | | | hadoop.hdfs.TestErasureCodingPolicyWithSnapshot | | | hadoop.fs.contract.hdfs.TestHDFSContractDelete | | | hadoop.hdfs.TestLocalDFS | | | hadoop.hdfs.server.namenode.TestListCorruptFileBlocks | | | hadoop.hdfs.TestCrcCorruption | | | hadoop.hdfs.TestListFilesInFileContext | | | hadoop.hdfs.TestDataTransferProtocol | | | hadoop.hdfs.server.namenode.snapshot.TestRandomOpsWithSnapshots | | | hadoop.hdfs.TestConnCache | | | hadoop.hdfs.server.namenode.TestStripedINodeFile | | | hadoop.hdfs.TestGetFileChecksum | | | hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks | | | hadoop.hdfs.TestFileAppend | | | hadoop.hdfs.TestReservedRawPaths | | | hadoop.hdfs.server.blockmanagement.TestPendingReconstruction | | | hadoop.hdfs.TestReadStripedFileWithDecoding | | | hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade | | | hadoop.hdfs.TestDisableConnCache | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement | | | hadoop.hdfs.server.datanode.TestIncrementalBrVariations | | | hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped | | | hadoop.hdfs.TestParallelShortCircuitReadUnCached | | | hadoop.hdfs.TestDecommission | | | hadoop.fs.TestUrlStreamHandler | | | hadoop.hdfs.server.namenode.TestNameNodeMXBean | | | hadoop.hdfs.TestSeekBug | | | hadoop.hdfs.server.namenode.TestReconstructStripedBlocks | | | hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot | | | hadoop.fs.TestEnhancedByteBufferAccess | | | hadoop.hdfs.TestDFSFinalize | | | hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness | | | hadoop.hdfs.TestDFSMkdirs | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename | | | hadoop.hdfs.TestDFSClientExcludedNodes | | | hadoop.hdfs.server.datanode.TestTransferRbw | | | hadoop.hdfs.server.namenode.TestAuditLogger | | | hadoop.hdfs.TestRollingUpgrade | | | hadoop.hdfs.server.namenode.TestFSImage | | | hadoop.hdfs.server.balancer.TestBalancer | | | hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage | | | hadoop.hdfs.server.namenode.TestReencryptionWithKMS | | | hadoop.hdfs.TestSafeModeWithStripedFile | | | hadoop.fs.TestHDFSFileContextMainOperations | | | hadoop.hdfs.TestSafeMode | | | hadoop.hdfs.protocolPB.TestPBHelper | | | hadoop.hdfs.server.namenode.TestBackupNode | | | hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints | | | hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes | | | hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement | | | hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData | | | hadoop.hdfs.TestWriteRead | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength | | | hadoop.hdfs.TestWriteReadStripedFile | | | hadoop.hdfs.TestErasureCodingMultipleRacks | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport | | | hadoop.hdfs.server.namenode.TestMetaSave | | | hadoop.fs.contract.hdfs.TestHDFSContractAppend | | | hadoop.hdfs.TestReconstructStripedFile | | | hadoop.hdfs.TestDFSStripedOutputStream | | | hadoop.hdfs.TestReadStripedFileWithDecodingDeletedData | | | hadoop.hdfs.TestHdfsAdmin | | | hadoop.fs.contract.hdfs.TestHDFSContractOpen | | | hadoop.hdfs.server.namenode.TestAddStripedBlocks | | | hadoop.hdfs.TestFileCreation | | | hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshot | | | hadoop.hdfs.server.mover.TestStorageMover | | | hadoop.hdfs.TestClientReportBadBlock | | | hadoop.hdfs.TestDistributedFileSystem | | | hadoop.hdfs.TestFileCorruption | | | hadoop.hdfs.server.namenode.TestHDFSConcat | | | hadoop.hdfs.server.datanode.TestDataNodeMXBean | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation | | | hadoop.hdfs.web.TestWebHdfsFileSystemContract | | | hadoop.hdfs.server.datanode.TestBlockReplacement | | | hadoop.hdfs.client.impl.TestBlockReaderRemote | | | hadoop.hdfs.TestClose | | | hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics | | | hadoop.hdfs.TestAbandonBlock | | | hadoop.hdfs.TestDFSShell | | | hadoop.hdfs.client.impl.TestBlockReaderLocal | | | hadoop.hdfs.server.datanode.TestBlockRecovery | | | hadoop.hdfs.TestDFSInputStream | | | hadoop.hdfs.TestLeaseRecovery | | | hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes | | | hadoop.hdfs.server.namenode.TestListOpenFiles | | | hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs | | | hadoop.hdfs.server.datanode.TestTriggerBlockReport | | | hadoop.hdfs.TestTrashWithEncryptionZones | | | hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand | | | hadoop.hdfs.tools.TestDFSAdmin | | | hadoop.hdfs.TestWriteBlockGetsBlockLengthHint | | | hadoop.hdfs.TestLeaseRecoveryStriped | | | hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation | | | hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages | | | hadoop.fs.viewfs.TestViewFsHdfs | | | hadoop.hdfs.TestFSInputChecker | | | hadoop.fs.contract.hdfs.TestHDFSContractConcat | | | hadoop.hdfs.server.namenode.TestFileLimit | | | hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot | | | hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes | | | hadoop.hdfs.TestHDFSTrash | | | hadoop.hdfs.server.datanode.TestCachingStrategy | | | hadoop.hdfs.TestSmallBlock | | | hadoop.hdfs.TestFileCreationDelete | | | hadoop.hdfs.tools.TestWebHDFSStoragePolicyCommands | | | hadoop.hdfs.TestReplication | | | hadoop.hdfs.server.namenode.ha.TestHAAppend | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles | | | hadoop.cli.TestAclCLI | | | hadoop.fs.TestSymlinkHdfsFileContext | | | hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy | | | hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot | | | hadoop.hdfs.TestFileAppendRestart | | | hadoop.fs.TestSymlinkHdfsFileSystem | | | hadoop.hdfs.TestFileAppend3 | | | hadoop.hdfs.server.blockmanagement.TestProvidedStorageMap | | | hadoop.hdfs.server.namenode.TestFileContextXAttr | | | hadoop.hdfs.TestDatanodeReport | | | hadoop.hdfs.TestMiniDFSCluster | | | hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean | | | hadoop.fs.TestUnbuffer | | | hadoop.hdfs.TestPipelines | | | hadoop.hdfs.TestErasureCodingPolicies | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl | | | hadoop.hdfs.server.namenode.TestDecommissioningStatus | | | hadoop.hdfs.tools.TestViewFSStoragePolicyCommands | | | hadoop.hdfs.server.namenode.ha.TestHASafeMode | | | hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes | | | hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps | | | hadoop.hdfs.server.namenode.TestNamenodeCapacityReport | | | hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication | | | hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff | | | hadoop.hdfs.server.namenode.ha.TestStandbyIsHot | | | hadoop.hdfs.server.namenode.TestFileTruncate | | | hadoop.hdfs.TestFSOutputSummer | | | hadoop.hdfs.TestDistributedFileSystemWithECFile | | | hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId | | | hadoop.hdfs.server.namenode.TestFSImageWithSnapshot | | | hadoop.hdfs.TestFsShellPermission | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter | | | hadoop.hdfs.TestSecureEncryptionZoneWithKMS | | | hadoop.hdfs.client.impl.TestBlockReaderFactory | | | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting | | | hadoop.hdfs.server.namenode.ha.TestHAStateTransitions | | | hadoop.hdfs.TestEncryptionZones | | | hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands | | | hadoop.fs.TestResolveHdfsSymlink | | | hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks | | | hadoop.hdfs.client.impl.TestClientBlockVerification | | | hadoop.hdfs.TestFileConcurrentReader | | | hadoop.hdfs.server.blockmanagement.TestNodeCount | | | hadoop.fs.viewfs.TestViewFsDefaultValue | | | hadoop.hdfs.web.TestWebHDFSForHA | | | hadoop.hdfs.TestMaintenanceState | | | hadoop.hdfs.TestAppendDifferentChecksum | | | hadoop.hdfs.TestEncryptionZonesWithHA | | | hadoop.hdfs.server.namenode.TestCacheDirectives | | | hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus | | | hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy | | | hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA | | | hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary | | | hadoop.hdfs.TestFileStatus | | | hadoop.hdfs.web.TestWebHDFSXAttr | | | hadoop.hdfs.server.namenode.TestNameNodeXAttr | | | hadoop.hdfs.server.datanode.TestHSync | | | hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer | | | hadoop.hdfs.TestTrashWithSecureEncryptionZones | | | hadoop.fs.viewfs.TestViewFileSystemHdfs | | | hadoop.hdfs.TestParallelUnixDomainRead | | | hadoop.cli.TestAclCLIWithPosixAclInheritance | | | hadoop.fs.viewfs.TestViewFileSystemLinkMergeSlash | | | hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery | | | hadoop.hdfs.tools.TestStoragePolicyCommands | | | hadoop.hdfs.TestDFSRemove | | | hadoop.fs.viewfs.TestViewFsAtHdfsRoot | | | hadoop.hdfs.TestDistributedFileSystemWithECFileWithRandomECPolicy | | | hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport | | | hadoop.hdfs.server.datanode.TestDeleteBlockPool | | | hadoop.hdfs.TestDFSClientRetries | | | hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork | | | hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs | | | hadoop.hdfs.TestUnsetAndChangeDirectoryEcPolicy | | | hadoop.hdfs.server.namenode.TestReencryption | | | hadoop.hdfs.TestListFilesInDFS | | | hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC | | | hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks | | | hadoop.hdfs.server.namenode.TestHostsFiles | | | hadoop.fs.viewfs.TestViewFileSystemWithTruncate | | | hadoop.hdfs.TestFileChecksum | | | hadoop.fs.contract.hdfs.TestHDFSContractCreate | | | hadoop.fs.permission.TestStickyBit | | | hadoop.hdfs.web.TestFSMainOperationsWebHdfs | | | hadoop.hdfs.TestEncryptionZonesWithKMS | | | hadoop.fs.TestSymlinkHdfsDisable | | | hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot | | | hadoop.hdfs.TestDFSRename | | | hadoop.hdfs.server.balancer.TestBalancerRPCDelay | | | hadoop.hdfs.server.namenode.TestDeleteRace | | | hadoop.hdfs.TestLease | | | hadoop.fs.viewfs.TestViewFileSystemLinkFallback | | | hadoop.hdfs.TestLargeBlock | | | hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes | | | hadoop.fs.contract.hdfs.TestHDFSContractPathHandle | | | hadoop.hdfs.security.TestDelegationToken | | | hadoop.hdfs.TestClientProtocolForPipelineRecovery | | | hadoop.hdfs.server.datanode.TestDataXceiverBackwardsCompat | | | hadoop.security.TestPermission | | | hadoop.hdfs.server.datanode.TestDirectoryScanner | | | hadoop.hdfs.web.TestWebHDFS | | | hadoop.fs.contract.hdfs.TestHDFSContractSeek | | | hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart | | | hadoop.fs.shell.TestHdfsTextCommand | | | hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot | | | hadoop.hdfs.TestBlockMissingException | \\ \\ || Subsystem || Report/Notes || | Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:abb62dd | | JIRA Issue | HDFS-13601 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12924441/HDFS-13601.001.patch | | Optional Tests | asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle | | uname | Linux b88317be6d79 3.13.0-143-generic #192-Ubuntu SMP Tue Feb 27 10:45:36 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /testptch/patchprocess/precommit/personality/provided.sh | | git revision | trunk / 5e88126 | | maven | version: Apache Maven 3.3.9 | | Default Java | 1.8.0_162 | | findbugs | v3.1.0-RC1 | | checkstyle | https://builds.apache.org/job/PreCommit-HDFS-Build/24271/artifact/out/diff-checkstyle-hadoop-hdfs-project.txt | | findbugs | https://builds.apache.org/job/PreCommit-HDFS-Build/24271/artifact/out/new-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.html | | findbugs | https://builds.apache.org/job/PreCommit-HDFS-Build/24271/artifact/out/new-findbugs-hadoop-hdfs-project_hadoop-hdfs.html | | unit | https://builds.apache.org/job/PreCommit-HDFS-Build/24271/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt | | Test Results | https://builds.apache.org/job/PreCommit-HDFS-Build/24271/testReport/ | | asflicense | https://builds.apache.org/job/PreCommit-HDFS-Build/24271/artifact/out/patch-asflicense-problems.txt | | Max. process+thread count | 2368 (vs. ulimit of 10000) | | modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project | | Console output | https://builds.apache.org/job/PreCommit-HDFS-Build/24271/console | | Powered by | Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org | This message was automatically generated. > Optimize ByteString conversions in PBHelper > ------------------------------------------- > > Key: HDFS-13601 > URL: https://issues.apache.org/jira/browse/HDFS-13601 > Project: Hadoop HDFS > Issue Type: Bug > Affects Versions: 3.1.0, 2.9.1 > Reporter: Andrew Wang > Assignee: Andrew Wang > Priority: Major > Attachments: HDFS-13601.001.patch > > > While doing some profiling of the NN with JMC, I saw a lot of time being > spent on String->ByteString conversions. These are often the same strings > being converted over and over again, meaning there's room for optimization. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org