[jira] [Resolved] (HDFS-17376) Distcp creates Factor 1 replication file on target if Source is EC

2024-02-09 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-17376. -- Fix Version/s: 3.5.0 Resolution: Fixed > Distcp creates Factor 1 replication

[jira] [Resolved] (HDFS-17237) Remove IPCLoggerChannel Metrics when the logger is closed

2023-10-24 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-17237. -- Resolution: Fixed > Remove IPCLoggerChannel Metrics when the logger is closed >

[jira] [Updated] (HDFS-17237) Remove IPCLoggerChannel Metrics when the logger is closed

2023-10-24 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-17237: - Fix Version/s: 3.4.0 3.3.7 > Remove IPCLoggerChannel Metrics when the

[jira] [Updated] (HDFS-17237) Remove IPCLoggerChannel Metrics when the logger is closed

2023-10-23 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-17237: - Summary: Remove IPCLoggerChannel Metrics when the logger is closed (was: Remove

[jira] [Created] (HDFS-17237) Remove IPCLogger Metrics when the logger is closed

2023-10-23 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-17237: Summary: Remove IPCLogger Metrics when the logger is closed Key: HDFS-17237 URL: https://issues.apache.org/jira/browse/HDFS-17237 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-14626) Decommission all nodes hosting last block of open file succeeds unexpectedly

2023-08-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-14626: Assignee: (was: Stephen O'Donnell) > Decommission all nodes hosting last

[jira] [Commented] (HDFS-17061) EC: Let data blocks and parity blocks on DNs more balanced

2023-06-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738581#comment-17738581 ] Stephen O'Donnell commented on HDFS-17061: -- I don't know of any tool, and certainly the datanode

[jira] [Commented] (HDFS-17061) EC: Let data blocks and parity blocks on DNs more balanced

2023-06-27 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737802#comment-17737802 ] Stephen O'Donnell commented on HDFS-17061: -- On a large cluster with many datanodes, and

[jira] [Commented] (HDFS-17002) Erasure coding:Generate parity blocks in time to prevent file corruption

2023-05-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721241#comment-17721241 ] Stephen O'Donnell commented on HDFS-17002: -- If the directory scanner is not working, then the

[jira] [Commented] (HDFS-17002) Erasure coding:Generate parity blocks in time to prevent file corruption

2023-05-09 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721080#comment-17721080 ] Stephen O'Donnell commented on HDFS-17002: -- If some of the parity blocks go missing, the

[jira] [Resolved] (HDFS-16942) Send error to datanode if FBR is rejected due to bad lease

2023-03-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16942. -- Resolution: Fixed > Send error to datanode if FBR is rejected due to bad lease >

[jira] [Updated] (HDFS-16942) Send error to datanode if FBR is rejected due to bad lease

2023-03-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16942: - Fix Version/s: 3.2.5 3.3.6 > Send error to datanode if FBR is

[jira] [Updated] (HDFS-16942) Send error to datanode if FBR is rejected due to bad lease

2023-03-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16942: - Fix Version/s: 3.4.0 > Send error to datanode if FBR is rejected due to bad lease >

[jira] [Created] (HDFS-16942) Send error to datanode if FBR is rejected due to bad lease

2023-03-07 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-16942: Summary: Send error to datanode if FBR is rejected due to bad lease Key: HDFS-16942 URL: https://issues.apache.org/jira/browse/HDFS-16942 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-14548) Cannot create snapshot when the snapshotCounter reaches MaxSnapshotID

2023-02-27 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-14548. -- Resolution: Duplicate > Cannot create snapshot when the snapshotCounter reaches

[jira] [Commented] (HDFS-16761) Namenode UI for Datanodes page not loading if any data node is down

2023-02-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689891#comment-17689891 ] Stephen O'Donnell commented on HDFS-16761: -- Branch 3.2 seems to be OK too, so resolving this

[jira] [Updated] (HDFS-16761) Namenode UI for Datanodes page not loading if any data node is down

2023-02-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16761: - Resolution: Fixed Status: Resolved (was: Patch Available) > Namenode UI for

[jira] [Updated] (HDFS-16761) Namenode UI for Datanodes page not loading if any data node is down

2023-02-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16761: - Fix Version/s: 3.4.0 > Namenode UI for Datanodes page not loading if any data node is

[jira] [Assigned] (HDFS-16761) Namenode UI for Datanodes page not loading if any data node is down

2023-02-09 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-16761: Assignee: Zita Dombi > Namenode UI for Datanodes page not loading if any data

[jira] [Commented] (HDFS-8789) Block Placement policy migrator

2022-09-14 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603945#comment-17603945 ] Stephen O'Donnell commented on HDFS-8789: - I don't think this tool is needed as er have HDFS-14053

[jira] [Resolved] (HDFS-16610) Make fsck read timeout configurable

2022-06-07 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16610. -- Resolution: Fixed > Make fsck read timeout configurable >

[jira] [Updated] (HDFS-16610) Make fsck read timeout configurable

2022-06-07 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16610: - Fix Version/s: 3.4.0 3.2.4 3.3.4 > Make fsck read

[jira] [Reopened] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2022-05-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reopened HDFS-16583: -- Reopening to add a branch-3.2 PR. > DatanodeAdminDefaultMonitor can get stuck in an

[jira] [Created] (HDFS-16610) Make fsck read timeout configurable

2022-05-31 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-16610: Summary: Make fsck read timeout configurable Key: HDFS-16610 URL: https://issues.apache.org/jira/browse/HDFS-16610 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-16594) Many RpcCalls are blocked for a while while Decommission works

2022-05-25 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542230#comment-17542230 ] Stephen O'Donnell commented on HDFS-16594: -- Some people have reported good results with the

[jira] [Updated] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2022-05-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16583: - Description: We encountered a case where the decommission monitor in the namenode got

[jira] [Created] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

2022-05-19 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-16583: Summary: DatanodeAdminDefaultMonitor can get stuck in an infinite loop Key: HDFS-16583 URL: https://issues.apache.org/jira/browse/HDFS-16583 Project: Hadoop

[jira] [Commented] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause bad

2022-04-27 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529026#comment-17529026 ] Stephen O'Donnell commented on HDFS-16093: -- I think HDFS-16076 addressed the sorting, to put the

[jira] [Updated] (HDFS-16531) Avoid setReplication logging an edit record if old replication equals the new value

2022-04-20 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16531: - Fix Version/s: (was: 3.4.0) (was: 3.2.4)

[jira] [Resolved] (HDFS-16531) Avoid setReplication logging an edit record if old replication equals the new value

2022-04-20 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16531. -- Resolution: Abandoned Reverted this change down the branches. Sorry for causing the

[jira] [Commented] (HDFS-16531) Avoid setReplication logging an edit record if old replication equals the new value

2022-04-20 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525235#comment-17525235 ] Stephen O'Donnell commented on HDFS-16531: -- I worry what else might break that is not covered by

[jira] [Commented] (HDFS-16548) Failed unit test testRenameMoreThanOnceAcrossSnapDirs_2

2022-04-20 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525133#comment-17525133 ] Stephen O'Donnell commented on HDFS-16548: -- Huum, do you see any way to fix this easily, or

[jira] [Updated] (HDFS-16531) Avoid setReplication logging an edit record if old replication equals the new value

2022-04-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16531: - Fix Version/s: 3.2.4 3.3.4 > Avoid setReplication logging an edit

[jira] [Resolved] (HDFS-16530) setReplication debug log creates a new string even if debug is disabled

2022-04-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16530. -- Resolution: Fixed > setReplication debug log creates a new string even if debug is

[jira] [Updated] (HDFS-16530) setReplication debug log creates a new string even if debug is disabled

2022-04-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16530: - Fix Version/s: 3.2.4 > setReplication debug log creates a new string even if debug is

[jira] [Updated] (HDFS-16530) setReplication debug log creates a new string even if debug is disabled

2022-04-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16530: - Fix Version/s: 3.4.0 3.3.3 > setReplication debug log creates a new

[jira] [Created] (HDFS-16531) Avoid setReplication logging an edit record if old replication equals the new value

2022-04-05 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-16531: Summary: Avoid setReplication logging an edit record if old replication equals the new value Key: HDFS-16531 URL: https://issues.apache.org/jira/browse/HDFS-16531

[jira] [Created] (HDFS-16530) setReplication debug log creates a new string even if debug is disabled

2022-04-05 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-16530: Summary: setReplication debug log creates a new string even if debug is disabled Key: HDFS-16530 URL: https://issues.apache.org/jira/browse/HDFS-16530

[jira] [Resolved] (HDFS-16496) Snapshot diff on snapshotable directory fails with not snapshottable error

2022-03-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16496. -- Fix Version/s: 3.4.0 Resolution: Fixed > Snapshot diff on snapshotable

[jira] [Updated] (HDFS-16496) Snapshot diff on snapshotable directory fails with not snapshottable error

2022-03-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16496: - Component/s: namanode > Snapshot diff on snapshotable directory fails with not

[jira] [Updated] (HDFS-16496) Snapshot diff on snapshotable directory fails with not snapshottable error

2022-03-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16496: - Affects Version/s: 3.4.0 > Snapshot diff on snapshotable directory fails with not

[jira] [Created] (HDFS-16496) Snapshot diff on snapshotable directory fails with not snapshottable error

2022-03-06 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-16496: Summary: Snapshot diff on snapshotable directory fails with not snapshottable error Key: HDFS-16496 URL: https://issues.apache.org/jira/browse/HDFS-16496

[jira] [Commented] (HDFS-14626) Decommission all nodes hosting last block of open file succeeds unexpectedly

2022-02-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496014#comment-17496014 ] Stephen O'Donnell commented on HDFS-14626: -- [~aajisaka] I have not looked into this issue for

[jira] [Commented] (HDFS-16423) balancer should not get blocks on stale storages

2022-01-26 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482324#comment-17482324 ] Stephen O'Donnell commented on HDFS-16423: -- I have a question on this Jira. As I understand it,

[jira] [Commented] (HDFS-16438) Avoid holding read locks for a long time when scanDatanodeStorage

2022-01-25 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481923#comment-17481923 ] Stephen O'Donnell commented on HDFS-16438: -- [~weichiu] Thanks for pinging me on this. I will

[jira] [Resolved] (HDFS-16262) Async refresh of cached locations in DFSInputStream

2022-01-25 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16262. -- Resolution: Fixed I have committed this to trunk and branch-3.3. There are conflicts

[jira] [Updated] (HDFS-16262) Async refresh of cached locations in DFSInputStream

2022-01-25 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16262: - Fix Version/s: 3.4.0 3.3.3 > Async refresh of cached locations in

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471862#comment-17471862 ] Stephen O'Donnell commented on HDFS-16420: -- Since release 3.1.0, I think there have been quite a

[jira] [Resolved] (HDFS-16408) Ensure LeaseRecheckIntervalMs is greater than zero

2022-01-05 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16408. -- Resolution: Fixed > Ensure LeaseRecheckIntervalMs is greater than zero >

[jira] [Updated] (HDFS-16408) Ensure LeaseRecheckIntervalMs is greater than zero

2022-01-05 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16408: - Fix Version/s: 3.4.0 3.2.4 3.3.3 > Ensure

[jira] [Assigned] (HDFS-16408) Ensure LeaseRecheckIntervalMs is greater than zero

2022-01-05 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-16408: Assignee: Jingxuan Fu (was: Stephen O'Donnell) > Ensure LeaseRecheckIntervalMs

[jira] [Assigned] (HDFS-16408) Ensure LeaseRecheckIntervalMs is greater than zero

2022-01-05 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-16408: Assignee: Stephen O'Donnell > Ensure LeaseRecheckIntervalMs is greater than zero

[jira] [Updated] (HDFS-16408) Ensure LeaseRecheckIntervalMs is greater than zero

2022-01-05 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16408: - Summary: Ensure LeaseRecheckIntervalMs is greater than zero (was: Negative

[jira] [Resolved] (HDFS-16391) Avoid evaluation of LOG.debug statement in NameNodeHeartbeatService

2021-12-21 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16391. -- Resolution: Fixed > Avoid evaluation of LOG.debug statement in

[jira] [Assigned] (HDFS-16391) Avoid evaluation of LOG.debug statement in NameNodeHeartbeatService

2021-12-21 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-16391: Assignee: wangzhaohui > Avoid evaluation of LOG.debug statement in

[jira] [Updated] (HDFS-16391) Avoid evaluation of LOG.debug statement in NameNodeHeartbeatService

2021-12-21 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16391: - Fix Version/s: 3.4.0 3.2.4 3.3.3 > Avoid

[jira] [Updated] (HDFS-16386) Reduce DataNode load when FsDatasetAsyncDiskService is working

2021-12-21 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16386: - Fix Version/s: 3.2.3 > Reduce DataNode load when FsDatasetAsyncDiskService is working >

[jira] [Resolved] (HDFS-16386) Reduce DataNode load when FsDatasetAsyncDiskService is working

2021-12-20 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16386. -- Resolution: Fixed > Reduce DataNode load when FsDatasetAsyncDiskService is working >

[jira] [Updated] (HDFS-16386) Reduce DataNode load when FsDatasetAsyncDiskService is working

2021-12-20 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16386: - Fix Version/s: 3.4.0 3.2.4 3.3.3 > Reduce DataNode

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2021-11-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450379#comment-17450379 ] Stephen O'Donnell commented on HDFS-15180: -- In Cloudera, we have not been looking into this

[jira] [Resolved] (HDFS-16343) Add some debug logs when the dfsUsed are not used during Datanode startup

2021-11-23 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16343. -- Resolution: Fixed > Add some debug logs when the dfsUsed are not used during Datanode

[jira] [Updated] (HDFS-16343) Add some debug logs when the dfsUsed are not used during Datanode startup

2021-11-23 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16343: - Fix Version/s: 3.4.0 3.2.4 3.3.3 > Add some debug

[jira] [Updated] (HDFS-16173) Improve CopyCommands#Put#executor queue configurability

2021-11-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16173: - Fix Version/s: 3.2.3 > Improve CopyCommands#Put#executor queue configurability >

[jira] [Commented] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

2021-11-04 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438658#comment-17438658 ] Stephen O'Donnell commented on HDFS-16286: -- Yes, we added it already to the HDFSCommands.md in

[jira] [Resolved] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

2021-11-03 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16286. -- Resolution: Fixed Committed down the active 3.x branches. Thanks for the contribution

[jira] [Updated] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

2021-11-03 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16286: - Fix Version/s: 3.3.2 3.2.3 3.4.0 > Debug tool to

[jira] [Resolved] (HDFS-16259) Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger)

2021-11-02 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16259. -- Resolution: Fixed Thanks for the review [~weichiu] and the discussion on this

[jira] [Updated] (HDFS-16259) Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger)

2021-11-02 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16259: - Fix Version/s: 3.3.2 3.4.0 > Catch and re-throw sub-classes of

[jira] [Commented] (HDFS-16259) Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger)

2021-10-28 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435315#comment-17435315 ] Stephen O'Donnell commented on HDFS-16259: -- [~ayushtkn] Thanks for the discussion on this. I

[jira] [Commented] (HDFS-16286) Debug tool to verify the correctness of erasure coding on file

2021-10-27 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17434741#comment-17434741 ] Stephen O'Donnell commented on HDFS-16286: -- You may be interested in this tool which we

[jira] [Resolved] (HDFS-16272) Int overflow in computing safe length during EC block recovery

2021-10-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16272. -- Resolution: Fixed Committed down the active branches. Thanks for the contribution

[jira] [Updated] (HDFS-16272) Int overflow in computing safe length during EC block recovery

2021-10-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16272: - Fix Version/s: 3.3.2 3.2.3 3.4.0 > Int overflow in

[jira] [Updated] (HDFS-16272) Int overflow in computing safe length during EC block recovery

2021-10-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16272: - Description: There exists an int overflow problem in StripedBlockUtil#getSafeLength,

[jira] [Assigned] (HDFS-16272) Int overflow in computing safe length during EC block recovery

2021-10-13 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-16272: Assignee: daimin > Int overflow in computing safe length during EC block recovery

[jira] [Commented] (HDFS-16259) Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger)

2021-10-07 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425573#comment-17425573 ] Stephen O'Donnell commented on HDFS-16259: -- {quote} What do you think about Compatibility? I

[jira] [Commented] (HDFS-16259) Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger)

2021-10-07 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425383#comment-17425383 ] Stephen O'Donnell commented on HDFS-16259: -- I think it can be argued both ways. HDFS should have

[jira] [Updated] (HDFS-16252) Correct docs for dfs.http.client.retry.policy.spec

2021-10-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16252: - Resolution: Fixed Status: Resolved (was: Patch Available) > Correct docs for

[jira] [Updated] (HDFS-16252) Correct docs for dfs.http.client.retry.policy.spec

2021-10-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16252: - Fix Version/s: 3.3.2 3.4.0 > Correct docs for

[jira] [Created] (HDFS-16259) Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger)

2021-10-06 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-16259: Summary: Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger) Key: HDFS-16259 URL:

[jira] [Updated] (HDFS-16252) Correct docs for dfs.http.client.retry.policy.spec

2021-10-04 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16252: - Attachment: HDFS-16252.002.patch > Correct docs for dfs.http.client.retry.policy.spec >

[jira] [Updated] (HDFS-16252) Correct docs for dfs.http.client.retry.policy.spec

2021-10-04 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16252: - Status: Patch Available (was: Open) > Correct docs for

[jira] [Updated] (HDFS-16252) Correct docs for dfs.http.client.retry.policy.spec

2021-10-04 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16252: - Attachment: HDFS-16252.001.patch > Correct docs for dfs.http.client.retry.policy.spec >

[jira] [Created] (HDFS-16252) Correct docs for dfs.http.client.retry.policy.spec

2021-10-04 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-16252: Summary: Correct docs for dfs.http.client.retry.policy.spec Key: HDFS-16252 URL: https://issues.apache.org/jira/browse/HDFS-16252 Project: Hadoop HDFS

[jira] [Created] (HDFS-16190) Combine some tests in TestOzoneManagerHAWithData to reuse mini-Clusters

2021-08-27 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-16190: Summary: Combine some tests in TestOzoneManagerHAWithData to reuse mini-Clusters Key: HDFS-16190 URL: https://issues.apache.org/jira/browse/HDFS-16190

[jira] [Resolved] (HDFS-16153) Avoid evaluation of LOG.debug statement in QuorumJournalManager

2021-08-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16153. -- Resolution: Fixed > Avoid evaluation of LOG.debug statement in QuorumJournalManager >

[jira] [Updated] (HDFS-16153) Avoid evaluation of LOG.debug statement in QuorumJournalManager

2021-08-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16153: - Fix Version/s: 3.3.2 3.2.3 3.4.0 > Avoid

[jira] [Commented] (HDFS-16147) load fsimage with parallelization and compression

2021-08-04 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393386#comment-17393386 ] Stephen O'Donnell commented on HDFS-16147: -- With your patch in place I think the output file

[jira] [Commented] (HDFS-16147) load fsimage with parallelization and compression

2021-08-04 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393356#comment-17393356 ] Stephen O'Donnell commented on HDFS-16147: -- On further review, most of what I wrote above is

[jira] [Comment Edited] (HDFS-16147) load fsimage with parallelization and compression

2021-08-04 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393310#comment-17393310 ] Stephen O'Donnell edited comment on HDFS-16147 at 8/4/21, 4:44 PM: ---

[jira] [Commented] (HDFS-16147) load fsimage with parallelization and compression

2021-08-04 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393310#comment-17393310 ] Stephen O'Donnell commented on HDFS-16147: -- When the image is saved, there is a single stream

[jira] [Updated] (HDFS-16055) Quota is not preserved in snapshot INode

2021-08-03 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16055: - Fix Version/s: 3.2.3 > Quota is not preserved in snapshot INode >

[jira] [Updated] (HDFS-16055) Quota is not preserved in snapshot INode

2021-08-03 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16055: - Fix Version/s: 3.3.2 > Quota is not preserved in snapshot INode >

[jira] [Commented] (HDFS-16147) load fsimage with parallelization and compression

2021-07-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389923#comment-17389923 ] Stephen O'Donnell commented on HDFS-16147: -- It is important that OIV can read these images. If

[jira] [Commented] (HDFS-16147) load fsimage with parallelization and compression

2021-07-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389880#comment-17389880 ] Stephen O'Donnell commented on HDFS-16147: -- I only quickly looked at this, but I have a few

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2021-07-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389821#comment-17389821 ] Stephen O'Donnell commented on HDFS-15175: -- Thanks for committing it. It saved me some work

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2021-07-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389810#comment-17389810 ] Stephen O'Donnell commented on HDFS-15175: -- We should backport to branch-3.3 too, otherwise the

[jira] [Resolved] (HDFS-16132) SnapshotDiff report fails with invalid path assertion with external Attribute provider

2021-07-28 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16132. -- Resolution: Won't Fix Closing this as it is no longer relevant after HDFS-16144

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

2021-07-28 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Resolution: Fixed Status: Resolved (was: Patch Available) > Revert HDFS-15372

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

2021-07-28 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Fix Version/s: 3.3.2 3.4.0 > Revert HDFS-15372 (Files in snapshots no

[jira] [Commented] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

2021-07-28 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17388784#comment-17388784 ] Stephen O'Donnell commented on HDFS-16144: -- The only changes between 003 and 004 were white

  1   2   3   4   5   6   7   8   9   10   >