[jira] [Updated] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9415: - Target Version/s: 2.6.4 > Document dfs.cluster.administrators and dfs.permissions.superusergroup >

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127547#comment-15127547 ] Junping Du commented on HDFS-9688: -- Move non-critical issue out of 2.6.4 to 2.6.5. > Test the effect of

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127545#comment-15127545 ] Junping Du commented on HDFS-9698: -- Move non-critical issue out of 2.6.4 to 2.6.5. > Long running

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119738#comment-15119738 ] Junping Du commented on HDFS-7694: -- I have cherry-pick it to branch-2.6. > FSDataInputStream should

[jira] [Updated] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7694: - Fix Version/s: 2.6.4 > FSDataInputStream should support "unbuffer" >

[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9555: - Target Version/s: 2.6.5 (was: 2.6.4) > LazyPersistFileScrubber should still sleep if there are errors in

[jira] [Commented] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120147#comment-15120147 ] Junping Du commented on HDFS-9555: -- Move all non-critical pending issues out of 2.6.4 into 2.6.5. >

[jira] [Updated] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8870: - Target Version/s: 2.7.3, 2.6.5 (was: 2.7.3, 2.6.4) > Lease is leaked on write failure >

[jira] [Commented] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120137#comment-15120137 ] Junping Du commented on HDFS-8870: -- Move it to 2.6.5 as the JIRA haven't been update for a while. > Lease

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120148#comment-15120148 ] Junping Du commented on HDFS-9500: -- Move all non-critical pending issues out of 2.6.4 into 2.6.5. >

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9500: - Target Version/s: 2.7.3, 2.6.5 (was: 2.7.3, 2.6.4) > datanodesSoftwareVersions map may counting wrong

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117491#comment-15117491 ] Junping Du commented on HDFS-7694: -- Thanks [~cmccabe] for confirmation. I will cherry-pick this patch to

[jira] [Resolved] (HDFS-4886) Override verifyBlockPlacement() API in BlockPlacementPolicyWithNodeGroup

[ https://issues.apache.org/jira/browse/HDFS-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-4886. -- Resolution: Duplicate Assignee: (was: Junping Du) There are already work in HDFS-9456 in

[jira] [Updated] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7694: - Target Version/s: 2.7.0, 2.6.4 (was: 2.7.0) > FSDataInputStream should support "unbuffer" >

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114100#comment-15114100 ] Junping Du commented on HDFS-7694: -- bq. Is there compatibility concern for backporting this to 2.6 branch?

[jira] [Commented] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103968#comment-15103968 ] Junping Du commented on HDFS-8870: -- Hi [~daryn], is this issue related to HDFS-9294? Thanks! > Lease is

[jira] [Commented] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103991#comment-15103991 ] Junping Du commented on HDFS-8871: -- Move it out of 2.6.4 given no update for a while. > Decommissioning

[jira] [Updated] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8871: - Target Version/s: 2.7.3, 2.6.5 (was: 2.7.3, 2.6.4) > Decommissioning of a node with a failed volume may

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103980#comment-15103980 ] Junping Du commented on HDFS-9500: -- bq. So the simplest way to fix this is that we always recounting the

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15104034#comment-15104034 ] Junping Du commented on HDFS-9220: -- Thanks [~kihwal] for clarification on this. For layout fix, I think

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103521#comment-15103521 ] Junping Du commented on HDFS-9294: -- BTW, I set back fix version to include 2.7.2 and 2.8.0. Given 2.6.4

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103519#comment-15103519 ] Junping Du commented on HDFS-9294: -- Thanks [~brahmareddy] and [~szetszwo] for help on this! > DFSClient

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9294: - Fix Version/s: 2.7.2 2.8.0 > DFSClient deadlock when close file and failed to renew

[jira] [Commented] (HDFS-8326) Documentation about when checkpoints are run is out of date

[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098149#comment-15098149 ] Junping Du commented on HDFS-8326: -- Looks like we wrongly add this to the CHANGES.txt entry of 2.7.2 for

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089145#comment-15089145 ] Junping Du commented on HDFS-8767: -- Thank u, [~ajisakaa]! > RawLocalFileSystem.listStatus() returns null

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089150#comment-15089150 ] Junping Du commented on HDFS-8891: -- Thanks [~ajisakaa] and [~chris.douglas] for confirmation. > HDFS

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087482#comment-15087482 ] Junping Du commented on HDFS-9047: -- bq. IMO +1 on removing them in 2.6 / 2.7 if it's breaking the

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9314: - Target Version/s: 2.6.4 > Improve BlockPlacementPolicyDefault's picking of excess replicas >

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8647: - Target Version/s: 2.6.4 > Abstract BlockManager's rack policy into BlockPlacementPolicy >

[jira] [Updated] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9313: - Target Version/s: 2.6.4 > Possible NullPointerException in BlockManager if no excess replica can be >

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086600#comment-15086600 ] Junping Du commented on HDFS-9047: -- Hi [~wheat9], what's the plan for branch-2.6/2.7? Remove it or fix it?

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083445#comment-15083445 ] Junping Du commented on HDFS-9047: -- >From the discussion above (and HDFS-8346), I don't think

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083199#comment-15083199 ] Junping Du commented on HDFS-8346: -- Ok. Thanks for pushing it, [~kihwal]! > libwebhdfs build fails during

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082159#comment-15082159 ] Junping Du commented on HDFS-8346: -- So Kihwal, you are preferring to push HDFS-9047 (deprecate/remove

[jira] [Updated] (HDFS-9445) Datanode may deadlock while handling a bad volume

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9445: - Resolution: Fixed Fix Version/s: 2.6.4 Status: Resolved (was: Patch Available) I have

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081208#comment-15081208 ] Junping Du commented on HDFS-9294: -- Thanks for your confirmation, Nicholas. I tried to cherry-pick to

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081268#comment-15081268 ] Junping Du commented on HDFS-8346: -- Hi [~cnauroth], do we need this fix in branch-2.6/branch-2.7? >

[jira] [Commented] (HDFS-9445) Datanode may deadlock while handling a bad volume

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081272#comment-15081272 ] Junping Du commented on HDFS-9445: -- Thanks [~kihwal] for reminding on this. I have ping Chris on

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081516#comment-15081516 ] Junping Du commented on HDFS-8346: -- Thanks Chris for clarification on this. I agree that this is not a

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080554#comment-15080554 ] Junping Du commented on HDFS-8767: -- Hi [~wheat9] and [~cnauroth], does this fix should land on branch-2.6

[jira] [Updated] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8767: - Target Version/s: 2.7.2, 2.6.4 > RawLocalFileSystem.listStatus() returns null for UNIX pipefile >

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080567#comment-15080567 ] Junping Du commented on HDFS-6945: -- I have cherry-pick the patch to branch-2.6. > BlockManager should

[jira] [Updated] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6945: - Fix Version/s: 2.6.4 > BlockManager should remove a block from excessReplicateMap and decrement >

[jira] [Updated] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6945: - Target Version/s: 2.8.0, 2.6.4 (was: 2.8.0) > BlockManager should remove a block from excessReplicateMap

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080582#comment-15080582 ] Junping Du commented on HDFS-9294: -- Hi [~szetszwo] and [~brahmareddy], shall we cherry-pick this fix to

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9294: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > DFSClient deadlock when close file and failed to renew

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8676: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Delayed rolling upgrade finalization can cause heartbeat

[jira] [Commented] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080557#comment-15080557 ] Junping Du commented on HDFS-8676: -- Hi [~walter.k.su] and [~kihwal], I tried to cherry-pick this patch to

[jira] [Commented] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080559#comment-15080559 ] Junping Du commented on HDFS-7645: -- Hi [~kihwal], do you suggest we should backport these three fixes

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8891: - Target Version/s: 2.6.4 > HDFS concat should keep srcs order > -- > >

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080579#comment-15080579 ] Junping Du commented on HDFS-8891: -- Hi [~chris.douglas] and [~jingzhao], shall we cherry-pick this fix to

[jira] [Commented] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080547#comment-15080547 ] Junping Du commented on HDFS-9178: -- Hi [~kihwal], I saw you already attached the patch for 2.6 branch.

[jira] [Updated] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9178: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Slow datanode I/O can cause a wrong node to be marked bad >

[jira] [Commented] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080542#comment-15080542 ] Junping Du commented on HDFS-4660: -- Hi [~kihwal], shall we backport this patch to 2.6.x branch? > Block

[jira] [Updated] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4660: - Target Version/s: 2.7.1, 2.6.4 (was: 2.7.1) > Block corruption can happen during pipeline recovery >

[jira] [Updated] (HDFS-8722) Optimize datanode writes for small writes and flushes

[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8722: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Optimize datanode writes for small writes and flushes >

[jira] [Updated] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8995: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Flaw in registration bookeeping can make DN die on

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080553#comment-15080553 ] Junping Du commented on HDFS-8995: -- Hi [~hitliuyi] and [~kihwal], as Sangjin's comments earlier, shall we

[jira] [Updated] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9106: - Target Version/s: 2.8.0, 2.6.4 (was: 2.8.0) > Transfer failure during pipeline recovery causes permanent

[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080543#comment-15080543 ] Junping Du commented on HDFS-8722: -- Hi [~kihwal], shall we backport the fix to 2.6 branch also? >

[jira] [Commented] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080549#comment-15080549 ] Junping Du commented on HDFS-9106: -- Hi [~hitliuyi], [~jingzhao] and [~kihwal], do we think this bug should

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080570#comment-15080570 ] Junping Du commented on HDFS-9220: -- Hi [~jingzhao] and [~kihwal], shall we cherry-pick the fix to

[jira] [Updated] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9220: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Reading small file (< 512 bytes) that is open for append

[jira] [Updated] (HDFS-9445) Datanode may deadlock while handling a bad volume

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9445: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Datanode may deadlock while handling a bad volume >

[jira] [Commented] (HDFS-9445) Datanode may deadlock while handling a bad volume

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080586#comment-15080586 ] Junping Du commented on HDFS-9445: -- Hi [~walter.k.su], [~vinayrpet] and [~kihwal], does the same issue

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070296#comment-15070296 ] Junping Du commented on HDFS-9470: -- Hi [~vinodkv], this should be cherry-pick to latest 2.7.2 RC too. >

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051198#comment-15051198 ] Junping Du commented on HDFS-9263: -- Move it out to 2.6.4 given the JIRA is not updated for a period of

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9263: - Target Version/s: 3.0.0, 2.7.3, 2.6.4 (was: 3.0.0, 2.7.3, 2.6.3) > tests are using /test/build/data;

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8791: - Target Version/s: 2.8.0, 2.7.3, 2.6.4 (was: 2.8.0, 2.7.3, 2.6.3) > block ID-based DN storage layout can

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051195#comment-15051195 ] Junping Du commented on HDFS-8791: -- Working on 2.6.3-RC0 now, move it out to 2.6.4. > block ID-based DN

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9500: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2, 2.6.3) > datanodesSoftwareVersions map may counting wrong

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037832#comment-15037832 ] Junping Du commented on HDFS-9500: -- Moving non-blocker/non-critical issues out of 2.6.3 into 2.6.4. >

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8791: - Priority: Blocker (was: Critical) > block ID-based DN storage layout can be very slow for datanode on

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035938#comment-15035938 ] Junping Du commented on HDFS-8791: -- Mark this as blocker per comments from [~jrottinghuis] and [~kihwal].

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034931#comment-15034931 ] Junping Du commented on HDFS-8791: -- bq. If you want to pull this in 2.6.3, it might make sense to push it

[jira] [Updated] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8870: - Target Version/s: 2.7.3, 2.6.4 (was: 2.7.3, 2.6.3) > Lease is leaked on write failure >

[jira] [Commented] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033819#comment-15033819 ] Junping Du commented on HDFS-8870: -- Move it to 2.6.4 as the JIRA haven't been update for a while. > Lease

[jira] [Updated] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8871: - Target Version/s: 2.7.3, 2.6.4 (was: 2.7.3, 2.6.3) > Decommissioning of a node with a failed volume may

[jira] [Commented] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032172#comment-15032172 ] Junping Du commented on HDFS-8871: -- Moving this to 2.6.4 as no update for a while. > Decommissioning of a

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032187#comment-15032187 ] Junping Du commented on HDFS-8791: -- bq. I think it's important to cherry-pick this patch to the 2.6 line

[jira] [Commented] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030117#comment-15030117 ] Junping Du commented on HDFS-8871: -- Hi, can we move this out of 2.6.3? Thanks! > Decommissioning of a

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030121#comment-15030121 ] Junping Du commented on HDFS-9263: -- Hi, can we move this out of 2.6.3? Thanks! > tests are using

[jira] [Commented] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030111#comment-15030111 ] Junping Du commented on HDFS-8870: -- Hi, can we move this out of 2.6.3? Thanks! > Lease is leaked on write

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030118#comment-15030118 ] Junping Du commented on HDFS-9470: -- Hi, can we move this out of 2.6.3? Thanks! > Encryption zone on root

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024385#comment-15024385 ] Junping Du commented on HDFS-9314: -- Let's keep BlockPlacementPolicyWithNodeGroup#pickupReplicaSet there,

[jira] [Created] (HDFS-9456) BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement() from BlockPlacementPolicyDefault.

Junping Du created HDFS-9456: Summary: BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement() from BlockPlacementPolicyDefault. Key: HDFS-9456 URL: https://issues.apache.org/jira/browse/HDFS-9456

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024715#comment-15024715 ] Junping Du commented on HDFS-9314: -- Filed HDFS-9456. > Improve BlockPlacementPolicyDefault's picking of

[jira] [Commented] (HDFS-6261) Document for enabling node group layer in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569020#comment-14569020 ] Junping Du commented on HDFS-6261: -- Thanks [~decster] for updating the patch and [~aw] for

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517015#comment-14517015 ] Junping Du commented on HDFS-7613: -- Thanks [~zhz], the multi-policies implementation here

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514046#comment-14514046 ] Junping Du commented on HDFS-7613: -- Thanks guys for good discussions above. For support

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376969#comment-14376969 ] Junping Du commented on HDFS-6261: -- Hi [~decster], given HADOOP-11495 is already get

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306543#comment-14306543 ] Junping Du commented on HDFS-6261: -- Sounds like a reasonable plan, [~decster]! I may need

[jira] [Commented] (HDFS-4989) Balancer needs to consider storage type in balancing

[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285320#comment-14285320 ] Junping Du commented on HDFS-4989: -- [~arpitagarwal], sounds good! Please feel free to

[jira] [Commented] (HDFS-6506) Newly moved block replica been invalidated and deleted in TestBalancer

[ https://issues.apache.org/jira/browse/HDFS-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088807#comment-14088807 ] Junping Du commented on HDFS-6506: -- Sorry for late response. Patch looks good to me in

[jira] [Commented] (HDFS-6506) Newly moved block replica been invalidated and deleted in TestBalancer

[ https://issues.apache.org/jira/browse/HDFS-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061614#comment-14061614 ] Junping Du commented on HDFS-6506: -- Sure. I will be around to review soon. Thanks,

[jira] [Commented] (HDFS-6500) Snapshot shouldn't be removed silently after renaming to an existing snapshot

[ https://issues.apache.org/jira/browse/HDFS-6500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021127#comment-14021127 ] Junping Du commented on HDFS-6500: -- +1. Patch looks good to me. Will commit it shortly.

[jira] [Updated] (HDFS-6500) Snapshot shouldn't be removed silently after renaming to an existing snapshot

[ https://issues.apache.org/jira/browse/HDFS-6500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6500: - Resolution: Fixed Fix Version/s: 2.5.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021639#comment-14021639 ] Junping Du commented on HDFS-6362: -- Hi [~arpitagarwal], I saw TestBalancerWithNodeGroup

[jira] [Commented] (HDFS-6159) TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success

[ https://issues.apache.org/jira/browse/HDFS-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021641#comment-14021641 ] Junping Du commented on HDFS-6159: -- Thanks [~decster] for investigation on it. I will ping

[jira] [Created] (HDFS-6500) Snapshot shouldn't be removed silently after renaming to an existing snapshot

Junping Du created HDFS-6500: Summary: Snapshot shouldn't be removed silently after renaming to an existing snapshot Key: HDFS-6500 URL: https://issues.apache.org/jira/browse/HDFS-6500 Project: Hadoop

<    1   2   3   4   5   6   7   8   9   10   >