[jira] [Commented] (HDFS-14084) Need for more stats in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738856#comment-16738856 ] Wangda Tan commented on HDFS-14084: --- Thanks [~jlowe] for letting me know, will redo the RC.  > Need

[jira] [Updated] (HDFS-13661) Ls command with e option fails when the filesystem is not HDFS

[ https://issues.apache.org/jira/browse/HDFS-13661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13661: -- Target Version/s: 3.2.0, 3.0.4, 3.1.3 (was: 3.2.0, 3.0.4, 3.1.2) > Ls command with e option fails

[jira] [Updated] (HDFS-13998) ECAdmin NPE with -setPolicy -replicate

[ https://issues.apache.org/jira/browse/HDFS-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13998: -- Target Version/s: 3.2.0, 3.1.3 (was: 3.2.0, 3.1.2) > ECAdmin NPE with -setPolicy -replicate >

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13541: -- Target Version/s: 3.1.3 (was: 3.1.2) > NameNode Port based selective encryption >

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13566: -- Target Version/s: 3.1.2 (was: 3.1.1) > Add configurable additional RPC listener to NameNode >

[jira] [Updated] (HDFS-13661) Ls command with e option fails when the filesystem is not HDFS

[ https://issues.apache.org/jira/browse/HDFS-13661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13661: -- Target Version/s: 3.2.0, 3.0.4, 3.1.2 (was: 3.2.0, 3.1.1, 3.0.4) > Ls command with e option fails

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13541: -- Target Version/s: 3.1.2 (was: 3.1.1) > NameNode Port based selective encryption >

[jira] [Commented] (HDFS-12716) 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available

[ https://issues.apache.org/jira/browse/HDFS-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562346#comment-16562346 ] Wangda Tan commented on HDFS-12716: --- Updated fixed version to 3.1.2 given this don't exist in

[jira] [Updated] (HDFS-12716) 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available

[ https://issues.apache.org/jira/browse/HDFS-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12716: -- Fix Version/s: (was: 3.1.1) 3.1.2 > 'dfs.datanode.failed.volumes.tolerated' to

[jira] [Commented] (HDFS-11060) make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable

[ https://issues.apache.org/jira/browse/HDFS-11060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562314#comment-16562314 ] Wangda Tan commented on HDFS-11060: --- Updated fixed version to 3.1.2 given this don't exist in

[jira] [Updated] (HDFS-11060) make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable

[ https://issues.apache.org/jira/browse/HDFS-11060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-11060: -- Fix Version/s: (was: 3.1.1) 3.1.2 > make

[jira] [Commented] (HDFS-13448) HDFS Block Placement - Ignore Locality for First Block Replica

[ https://issues.apache.org/jira/browse/HDFS-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562301#comment-16562301 ] Wangda Tan commented on HDFS-13448: --- Updated fixed version to 3.1.2 given this don't exist in

[jira] [Updated] (HDFS-13448) HDFS Block Placement - Ignore Locality for First Block Replica

[ https://issues.apache.org/jira/browse/HDFS-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13448: -- Fix Version/s: (was: 3.1.1) 3.1.2 > HDFS Block Placement - Ignore Locality for

[jira] [Commented] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549706#comment-16549706 ] Wangda Tan commented on HDFS-13596: --- Given there's no movement of this issue for 2 months and this is

[jira] [Updated] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13596: -- Target Version/s: 3.2.0, 3.0.4, 3.1.2 (was: 3.2.0, 3.1.1, 3.0.4) > NN restart fails after

[jira] [Commented] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497138#comment-16497138 ] Wangda Tan commented on HDFS-13176: --- Thanks [~mackrorysd] for the notice. I'm fine with either: if you

[jira] [Updated] (HDFS-13352) RBF: Add xsl stylesheet for hdfs-rbf-default.xml

[ https://issues.apache.org/jira/browse/HDFS-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13352: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-12884) BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo

[ https://issues.apache.org/jira/browse/HDFS-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12884: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-13204) RBF: Optimize name service safe mode icon

[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13204: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13195: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-12512) RBF: Add WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12512: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12792: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13250: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-13291) RBF: Implement available space based OrderResolver

[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13291: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-13318) RBF: Fix FindBugs in hadoop-hdfs-rbf

[ https://issues.apache.org/jira/browse/HDFS-13318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13318: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-13347) RBF: Cache datanode reports

[ https://issues.apache.org/jira/browse/HDFS-13347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13347: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-7877) [Umbrella] Support maintenance state for datanodes

[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-7877: - Summary: [Umbrella] Support maintenance state for datanodes (was: Support maintenance state for

[jira] [Commented] (HDFS-12884) BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo

[ https://issues.apache.org/jira/browse/HDFS-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409062#comment-16409062 ] Wangda Tan commented on HDFS-12884: --- [~shv], I just moved this to 3.1.1 since we're working on 3.1.0 on

[jira] [Updated] (HDFS-12884) BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo

[ https://issues.apache.org/jira/browse/HDFS-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12884: -- Fix Version/s: (was: 3.1.0) 3.1.1 > BlockUnderConstructionFeature.truncateBlock

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409060#comment-16409060 ] Wangda Tan commented on HDFS-13230: --- [~elgoiri], while doing Jira scan, I found the committed message

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12859: -- Fix Version/s: (was: 3.1.0) > Admin command resetBalancerBandwidth >

[jira] [Updated] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

[ https://issues.apache.org/jira/browse/HDFS-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12487: -- Fix Version/s: (was: 3.1.0) > FsDatasetSpi.isValidBlock() lacks null pointer check inside and

[jira] [Updated] (HDFS-12700) Fix datanode link that can not be accessed in dfshealth.html

[ https://issues.apache.org/jira/browse/HDFS-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12700: -- Fix Version/s: (was: 3.1.0) > Fix datanode link that can not be accessed in dfshealth.html >

[jira] [Updated] (HDFS-12708) Fix hdfs haadmin usage

[ https://issues.apache.org/jira/browse/HDFS-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12708: -- Fix Version/s: (was: 3.1.0) > Fix hdfs haadmin usage > --- > >

[jira] [Updated] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13136: -- Fix Version/s: (was: 3.2.0) (was: 3.0.2) (was: 3.1.0)

[jira] [Updated] (HDFS-12284) RBF: Support for Kerberos authentication

[ https://issues.apache.org/jira/browse/HDFS-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12284: -- Target Version/s: 3.2.0 (was: 3.1.0) > RBF: Support for Kerberos authentication >

[jira] [Updated] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12257: -- Target Version/s: 2.8.3, 2.9.1, 3.2.0 (was: 2.8.3, 3.1.0, 2.9.1) > Expose getSnapshottableDirListing

[jira] [Updated] (HDFS-8430) Erasure coding: compute file checksum for striped files (stripe by stripe)

[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-8430: - Target Version/s: 3.2.0 (was: 3.1.0) > Erasure coding: compute file checksum for striped files (stripe by

[jira] [Updated] (HDFS-11397) TestThrottledAsyncChecker#testCancellation timed out

[ https://issues.apache.org/jira/browse/HDFS-11397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-11397: -- Target Version/s: 3.2.0 (was: 3.1.0) > TestThrottledAsyncChecker#testCancellation timed out >

[jira] [Updated] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-11885: -- Target Version/s: 2.8.3, 2.9.1, 3.2.0 (was: 2.8.3, 3.1.0, 2.9.1) > createEncryptionZone should not

[jira] [Updated] (HDFS-11503) Integrate Chocolate Cloud RS coder implementation

[ https://issues.apache.org/jira/browse/HDFS-11503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-11503: -- Target Version/s: 3.2.0 (was: 3.1.0) > Integrate Chocolate Cloud RS coder implementation >

[jira] [Updated] (HDFS-13289) RBF: TestConnectionManager#testCleanup() test case need correction

[ https://issues.apache.org/jira/browse/HDFS-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13289: -- Target Version/s: 2.10.0, 2.9.1, 3.0.2, 3.2.0 (was: 3.1.0, 2.10.0, 2.9.1, 3.0.2, 3.2.0) > RBF:

[jira] [Updated] (HDFS-12811) A cheaper, faster, less memory intensive Hadoop fsck

[ https://issues.apache.org/jira/browse/HDFS-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12811: -- Target Version/s: 3.2.0 (was: 3.1.0) > A cheaper, faster, less memory intensive Hadoop fsck >

[jira] [Updated] (HDFS-13051) dead lock occurs when rolleditlog rpc call happen and editPendingQ is full

[ https://issues.apache.org/jira/browse/HDFS-13051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13051: -- Target Version/s: 2.10.0, 2.9.1, 2.8.4, 2.7.6, 3.0.2 (was: 3.1.0, 2.10.0, 2.9.1, 2.8.4, 2.7.6, 3.0.2)

[jira] [Updated] (HDFS-13291) RBF: Implement available space based OrderResolver

[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13291: -- Target Version/s: 2.9.0, 3.2.0 (was: 2.9.0, 3.1.0) > RBF: Implement available space based

[jira] [Updated] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13314: -- Target Version/s: 2.10.0, 3.2.0 (was: 3.1.0, 2.10.0) > NameNode should optionally exit if it detects

[jira] [Updated] (HDFS-13174) hdfs mover -p /path times out after 20 min

[ https://issues.apache.org/jira/browse/HDFS-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13174: -- Target Version/s: 2.9.1, 3.0.1, 2.8.4, 2.7.6 (was: 3.1.0, 2.9.1, 3.0.1, 2.8.4, 2.7.6) > hdfs mover -p

[jira] [Updated] (HDFS-13252) Code refactoring: Remove Diff.ListType

[ https://issues.apache.org/jira/browse/HDFS-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13252: -- Fix Version/s: 3.1.0 > Code refactoring: Remove Diff.ListType > --

[jira] [Updated] (HDFS-13227) Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList

[ https://issues.apache.org/jira/browse/HDFS-13227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13227: -- Fix Version/s: 3.1.0 > Add a method to calculate cumulative diff over multiple snapshots in >

[jira] [Updated] (HDFS-13130) Log object instance get incorrectly in SlowDiskTracker

[ https://issues.apache.org/jira/browse/HDFS-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13130: -- Fix Version/s: 3.1.0 > Log object instance get incorrectly in SlowDiskTracker >

[jira] [Updated] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13246: -- Fix Version/s: 3.1.0 > FileInputStream redundant closes in readReplicasFromCache >

[jira] [Updated] (HDFS-13211) Fix a bug in DirectoryDiffList.getMinListForRange

[ https://issues.apache.org/jira/browse/HDFS-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13211: -- Fix Version/s: 3.1.0 > Fix a bug in DirectoryDiffList.getMinListForRange >

[jira] [Updated] (HDFS-12780) Fix spelling mistake in DistCpUtils.java

[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12780: -- Fix Version/s: 3.1.0 > Fix spelling mistake in DistCpUtils.java >

[jira] [Updated] (HDFS-13171) Handle Deletion of nodes in SnasphotSkipList

[ https://issues.apache.org/jira/browse/HDFS-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13171: -- Fix Version/s: 3.1.0 > Handle Deletion of nodes in SnasphotSkipList >

[jira] [Updated] (HDFS-13202) Fix the outdated javadocs in HAUtil

[ https://issues.apache.org/jira/browse/HDFS-13202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13202: -- Fix Version/s: 3.1.0 > Fix the outdated javadocs in HAUtil > --- > >

[jira] [Updated] (HDFS-13223) Reduce DiffListBySkipList memory usage

[ https://issues.apache.org/jira/browse/HDFS-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13223: -- Fix Version/s: 3.1.0 > Reduce DiffListBySkipList memory usage > --

[jira] [Updated] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13168: -- Fix Version/s: 3.1.0 > XmlImageVisitor - Prefer Array over LinkedList >

[jira] [Updated] (HDFS-1686) Federation: Add more Balancer tests with federation setting

[ https://issues.apache.org/jira/browse/HDFS-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-1686: - Fix Version/s: 3.1.0 > Federation: Add more Balancer tests with federation setting >

[jira] [Updated] (HDFS-13193) Various Improvements for BlockTokenSecretManager

[ https://issues.apache.org/jira/browse/HDFS-13193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13193: -- Fix Version/s: 3.1.0 > Various Improvements for BlockTokenSecretManager >

[jira] [Updated] (HDFS-13222) Update getBlocks method to take minBlockSize in RPC calls

[ https://issues.apache.org/jira/browse/HDFS-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13222: -- Fix Version/s: 3.1.0 > Update getBlocks method to take minBlockSize in RPC calls >

[jira] [Updated] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13102: -- Fix Version/s: 3.1.0 > Implement SnapshotSkipList class to store Multi level DirectoryDiffs >

[jira] [Updated] (HDFS-13173) Replace ArrayList with DirectoryDiffList(SnapshotSkipList) to store DirectoryDiffs

[ https://issues.apache.org/jira/browse/HDFS-13173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13173: -- Fix Version/s: 3.1.0 > Replace ArrayList with DirectoryDiffList(SnapshotSkipList) to store >

[jira] [Updated] (HDFS-13178) Disk Balancer: Add skipDateCheck option to DiskBalancer Execute command

[ https://issues.apache.org/jira/browse/HDFS-13178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13178: -- Fix Version/s: 3.1.0 > Disk Balancer: Add skipDateCheck option to DiskBalancer Execute command >

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13235: -- Fix Version/s: 3.1.0 > DiskBalancer: Update Documentation to add newly added options >

[jira] [Updated] (HDFS-13188) Disk Balancer: Support multiple block pools during block move

[ https://issues.apache.org/jira/browse/HDFS-13188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13188: -- Fix Version/s: 3.1.0 > Disk Balancer: Support multiple block pools during block move >

[jira] [Updated] (HDFS-13159) TestTruncateQuotaUpdate fails in trunk

[ https://issues.apache.org/jira/browse/HDFS-13159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13159: -- Fix Version/s: 3.1.0 > TestTruncateQuotaUpdate fails in trunk > --

[jira] [Updated] (HDFS-13210) Fix the typo in MiniDFSCluster class

[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13210: -- Fix Version/s: 3.1.0 > Fix the typo in MiniDFSCluster class > - >

[jira] [Updated] (HDFS-13192) Change the code order in getFileEncryptionInfo to avoid unnecessary call of assignment

[ https://issues.apache.org/jira/browse/HDFS-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13192: -- Fix Version/s: 3.1.0 > Change the code order in getFileEncryptionInfo to avoid unnecessary call of >

[jira] [Updated] (HDFS-10803) TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available

[ https://issues.apache.org/jira/browse/HDFS-10803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10803: -- Fix Version/s: 3.1.0 > TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails >

[jira] [Updated] (HDFS-13257) Code cleanup: INode never throws QuotaExceededException

[ https://issues.apache.org/jira/browse/HDFS-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13257: -- Fix Version/s: 3.1.0 > Code cleanup: INode never throws QuotaExceededException >

[jira] [Updated] (HDFS-13167) DatanodeAdminManager Improvements

[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13167: -- Fix Version/s: 3.1.0 > DatanodeAdminManager Improvements > - > >

[jira] [Updated] (HDFS-336) dfsadmin -report should report number of blocks from datanode

[ https://issues.apache.org/jira/browse/HDFS-336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-336: Fix Version/s: 3.1.0 > dfsadmin -report should report number of blocks from datanode >

[jira] [Updated] (HDFS-13142) Define and Implement a DiifList Interface to store and manage SnapshotDiffs

[ https://issues.apache.org/jira/browse/HDFS-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13142: -- Fix Version/s: 3.1.0 > Define and Implement a DiifList Interface to store and manage SnapshotDiffs >

[jira] [Commented] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390704#comment-16390704 ] Wangda Tan commented on HDFS-12999: --- [~figo], removed fix version, it should be only set by committer

[jira] [Updated] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12999: -- Fix Version/s: (was: 3.1.0) > When reach the end of the block group, it may not need to flush all

[jira] [Updated] (HDFS-8893) DNs with failed volumes stop serving during rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-8893: - Target Version/s: 3.2.0 (was: 3.1.0) > DNs with failed volumes stop serving during rolling upgrade >

[jira] [Commented] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365087#comment-16365087 ] Wangda Tan commented on HDFS-12452: --- [~xyao], if this patch can be done by this week, please commit to

[jira] [Updated] (HDFS-11310) Reduce the performance impact of the balancer (trunk port)

[ https://issues.apache.org/jira/browse/HDFS-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-11310: -- Target Version/s: 3.2.0 (was: 3.1.0) > Reduce the performance impact of the balancer (trunk port) >

[jira] [Updated] (HDFS-12049) Recommissioning live nodes stalls the NN

[ https://issues.apache.org/jira/browse/HDFS-12049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12049: -- Target Version/s: 3.2.0 (was: 3.1.0) > Recommissioning live nodes stalls the NN >

[jira] [Updated] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12452: -- Target Version/s: 3.2.0 (was: 3.1.0) > TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

[jira] [Updated] (HDFS-12548) HDFS Jenkins build is unstable on branch-2

[ https://issues.apache.org/jira/browse/HDFS-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12548: -- Target Version/s: 3.2.0 > HDFS Jenkins build is unstable on branch-2 >

[jira] [Updated] (HDFS-12548) HDFS Jenkins build is unstable on branch-2

[ https://issues.apache.org/jira/browse/HDFS-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12548: -- Target Version/s: (was: 3.1.0) > HDFS Jenkins build is unstable on branch-2 >

[jira] [Commented] (HDFS-12548) HDFS Jenkins build is unstable on branch-2

[ https://issues.apache.org/jira/browse/HDFS-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353291#comment-16353291 ] Wangda Tan commented on HDFS-12548: --- We plan to start merge vote of 3.1.0 on Feb 18, please let me know

[jira] [Commented] (HDFS-12049) Recommissioning live nodes stalls the NN

[ https://issues.apache.org/jira/browse/HDFS-12049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353288#comment-16353288 ] Wangda Tan commented on HDFS-12049: --- We plan to start merge vote of 3.1.0 on Feb 18, please let me know

[jira] [Commented] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353289#comment-16353289 ] Wangda Tan commented on HDFS-12452: --- We plan to start merge vote of 3.1.0 on Feb 18, please let me know

[jira] [Commented] (HDFS-11310) Reduce the performance impact of the balancer (trunk port)

[ https://issues.apache.org/jira/browse/HDFS-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353286#comment-16353286 ] Wangda Tan commented on HDFS-11310: --- Thanks [~daryn] for reporting this issue. We plan to start merge

[jira] [Commented] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353284#comment-16353284 ] Wangda Tan commented on HDFS-11225: --- [~manojg]/[~shashikant], any progress here? We plan to start merge

[jira] [Commented] (HDFS-8893) DNs with failed volumes stop serving during rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353282#comment-16353282 ] Wangda Tan commented on HDFS-8893: -- [~daryn] / [~shahrs87], any progress here? Since this is an issue

[jira] [Updated] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-11163: -- Attachment: temp-YARN-6278.HDFS-11163.patch > Mover should move the file blocks to default storage once

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.2

[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10692: -- Summary: Point JDiff base version for HDFS from 2.6.0 to 2.7.2 (was: Point JDiff base version for HDFS

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.3

[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10692: -- Attachment: HDFS-10692.2.patch Attached ver.2 patch, downgraded 2.7.3 to 2.7.2 since 2.7.3 is not

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.2

[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10692: -- Description: Now JDiff is pointed to 2.6.0, we need to upgrade it to the latest stable release (2.7.2)

[jira] [Commented] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.3

[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427160#comment-15427160 ] Wangda Tan commented on HDFS-10692: --- This needs some common fixes of HADOOP-13428, added link. > Point

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.3

[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10692: -- Attachment: 3.0.0-alpha1-jdiff-hdfs.zip Attached generated jdiff file for review as well. > Point

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.3

[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10692: -- Attachment: HDFS-10692.1.patch Attached ver.1 patch, this is on top of HADOOP-13428 > Point JDiff base

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.3

[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10692: -- Priority: Blocker (was: Major) > Point JDiff base version for HDFS from 2.6.0 to 2.7.3 >

[jira] [Created] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.3

Wangda Tan created HDFS-10692: - Summary: Point JDiff base version for HDFS from 2.6.0 to 2.7.3 Key: HDFS-10692 URL: https://issues.apache.org/jira/browse/HDFS-10692 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317900#comment-15317900 ] Wangda Tan commented on HDFS-10458: --- Thanks, [~zhz]! > getFileEncryptionInfo should return quickly for

[jira] [Commented] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317881#comment-15317881 ] Wangda Tan commented on HDFS-10458: --- [~zhz], perhaps this causes by different JDK version, etc. I didn't

[jira] [Commented] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317872#comment-15317872 ] Wangda Tan commented on HDFS-10458: --- branch-2 has the same issue, reverting patch from branch-2 as well.

  1   2   >