[jira] [Updated] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-05-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-17528: -- Issue Type: Bug (was: Improvement) > FsImageValidation: set txid when saving a new image >

[jira] [Assigned] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-05-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze reassigned HDFS-17528: - Component/s: tools Assignee: Tsz-wo Sze Description: - When the fsimage is specified

[jira] [Created] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-05-14 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-17528: - Summary: FsImageValidation: set txid when saving a new image Key: HDFS-17528 URL: https://issues.apache.org/jira/browse/HDFS-17528 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-17495) Change FSNamesystem.digest to use a configurable algorithm.

2024-04-22 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-17495: - Summary: Change FSNamesystem.digest to use a configurable algorithm. Key: HDFS-17495 URL: https://issues.apache.org/jira/browse/HDFS-17495 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-17403) jenkins build failing for HDFS 3.5.0-SNAPSHOT

2024-03-01 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-17403. --- Resolution: Not A Problem Resolving ... > jenkins build failing for HDFS 3.5.0-SNAPSHOT >

[jira] [Commented] (HDFS-17403) jenkins build failing for HDFS 3.5.0-SNAPSHOT

2024-03-01 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822628#comment-17822628 ] Tsz-wo Sze commented on HDFS-17403: --- [~slfan1989], thanks a lot for checking the build! The machine

[jira] [Commented] (HDFS-17403) jenkins build failing for HDFS 3.5.0-SNAPSHOT

2024-02-29 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822275#comment-17822275 ] Tsz-wo Sze commented on HDFS-17403: --- [~slfan1989], the jenkins build are failing after updating the

[jira] [Commented] (HDFS-17403) jenkins build failing for HDFS 3.5.0-SNAPSHOT

2024-02-28 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821839#comment-17821839 ] Tsz-wo Sze commented on HDFS-17403: --- Below was copied from

[jira] [Moved] (HDFS-17403) jenkins build failing for HDFS 3.5.0-SNAPSHOT

2024-02-28 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze moved RATIS-2034 to HDFS-17403: -- Component/s: build (was: build) Key:

[jira] [Updated] (HDFS-17380) FsImageValidation: remove inaccessible nodes

2024-02-13 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-17380: -- Attachment: (was: HDFS-17380_20240213.patch) > FsImageValidation: remove inaccessible nodes >

[jira] [Updated] (HDFS-17380) FsImageValidation: remove inaccessible nodes

2024-02-13 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-17380: -- Attachment: HDFS-17380_20240213.patch > FsImageValidation: remove inaccessible nodes >

[jira] [Created] (HDFS-17380) FsImageValidation: remove inaccessible nodes

2024-02-13 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-17380: - Summary: FsImageValidation: remove inaccessible nodes Key: HDFS-17380 URL: https://issues.apache.org/jira/browse/HDFS-17380 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2024-01-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17808737#comment-17808737 ] Tsz-wo Sze commented on HDFS-10224: --- [~zhanghaobo], it is unfortunate that this and the

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2023-12-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17796865#comment-17796865 ] Tsz-wo Sze commented on HDFS-13056: --- [~dennishuo], thanks for the nice work! Filed HADOOP-19012 for

[jira] [Created] (HDFS-17164) During rolling upgrade, datanode should copy-on-append when bumpReplicaGS

2023-08-18 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-17164: - Summary: During rolling upgrade, datanode should copy-on-append when bumpReplicaGS Key: HDFS-17164 URL: https://issues.apache.org/jira/browse/HDFS-17164 Project: Hadoop

[jira] [Resolved] (HDFS-17045) File renamed from a snapshottable dir to a non-snapshottable dir cannot be deleted.

2023-06-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-17045. --- Fix Version/s: 3.4.0 Resolution: Fixed The pull request is now merged. > File renamed from a

[jira] [Updated] (HDFS-17045) File renamed from a snapshottable dir to a non-snapshottable dir cannot be deleted.

2023-06-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-17045: -- Description: HDFS-16972 added a

[jira] [Updated] (HDFS-17045) File renamed from a snapshottable dir to a non-snapshottable dir cannot be deleted.

2023-06-12 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-17045: -- Description: HDFS-16972 added a

[jira] [Updated] (HDFS-17045) File renamed from a snapshottable dir to a non-snapshottable dir cannot be deleted.

2023-06-12 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-17045: -- Description: HDFS-16972 added a

[jira] [Created] (HDFS-17045) File renamed from a snapshottable dir to a non-snapshottable dir cannot be deleted.

2023-06-12 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-17045: - Summary: File renamed from a snapshottable dir to a non-snapshottable dir cannot be deleted. Key: HDFS-17045 URL: https://issues.apache.org/jira/browse/HDFS-17045 Project:

[jira] [Resolved] (HDFS-17010) Add a subtree test to TestSnapshotDiffReport

2023-05-18 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-17010. --- Fix Version/s: 3.4.0 Resolution: Fixed The pull request is now merged. > Add a subtree test

[jira] [Created] (HDFS-17010) Add a subtree test to TestSnapshotDiffReport

2023-05-14 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-17010: - Summary: Add a subtree test to TestSnapshotDiffReport Key: HDFS-17010 URL: https://issues.apache.org/jira/browse/HDFS-17010 Project: Hadoop HDFS Issue Type: Test

[jira] [Resolved] (HDFS-16972) Delete a snapshot may deleteCurrentFile

2023-04-27 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-16972. --- Fix Version/s: 3.4.0 Resolution: Fixed The pull request is now merged. > Delete a snapshot

[jira] [Comment Edited] (HDFS-16972) Delete a snapshot may deleteCurrentFile

2023-04-27 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717243#comment-17717243 ] Tsz-wo Sze edited comment on HDFS-16972 at 4/27/23 4:20 PM: szetszwo

[jira] [Resolved] (HDFS-16975) FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage.

2023-04-24 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-16975. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed The pull request is now

[jira] [Updated] (HDFS-16975) FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage.

2023-04-12 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-16975: -- Summary: FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage. (was:

[jira] [Created] (HDFS-16975) FileWithSnapshotFeature.isCurrentFileDeleted is not serialized to FSImage.

2023-04-11 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-16975: - Summary: FileWithSnapshotFeature.isCurrentFileDeleted is not serialized to FSImage. Key: HDFS-16975 URL: https://issues.apache.org/jira/browse/HDFS-16975 Project: Hadoop

[jira] [Created] (HDFS-16972) Delete a snapshot may deleteCurrentFile

2023-04-04 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-16972: - Summary: Delete a snapshot may deleteCurrentFile Key: HDFS-16972 URL: https://issues.apache.org/jira/browse/HDFS-16972 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16963) Remove the unnecessary use of Optional from DistributedFileSystem

2023-03-23 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-16963: - Summary: Remove the unnecessary use of Optional from DistributedFileSystem Key: HDFS-16963 URL: https://issues.apache.org/jira/browse/HDFS-16963 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16885) Fix TestHdfsConfigFields#testCompareConfigurationClassAgainstXml failed

2023-01-09 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-16885: -- Component/s: configuration namanode > Fix

[jira] [Resolved] (HDFS-16885) Fix TestHdfsConfigFields#testCompareConfigurationClassAgainstXml failed

2023-01-09 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-16885. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed The pull request is now

[jira] [Resolved] (HDFS-16881) Warn if AccessControlEnforcer runs for a long time to check permission

2023-01-04 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-16881. --- Fix Version/s: 1.3.0 Hadoop Flags: Reviewed Resolution: Fixed The pull request is now

[jira] [Updated] (HDFS-16881) Warn if AccessControlEnforcer runs for a long time to check permission

2023-01-03 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-16881: -- Summary: Warn if AccessControlEnforcer runs for a long time to check permission (was: Print a warning

[jira] [Created] (HDFS-16881) Print a warning if AccessControlEnforcer runs for a long time to check permission

2023-01-02 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-16881: - Summary: Print a warning if AccessControlEnforcer runs for a long time to check permission Key: HDFS-16881 URL: https://issues.apache.org/jira/browse/HDFS-16881 Project:

[jira] [Resolved] (HDFS-12006) Ozone: add TestDistributedOzoneVolumesRatis, TestOzoneRestWithMiniClusterRatis and TestOzoneWebAccessRatis

2022-10-15 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-12006. --- Resolution: Won't Do > Ozone: add TestDistributedOzoneVolumesRatis, >

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-16 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444979#comment-17444979 ] Tsz-wo Sze commented on HDFS-16322: --- [~Nsupyq], we are lucky to have you! Please let me know after you

[jira] [Updated] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-16 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-16322: -- Component/s: namanode [~Nsupyq], I agree that truncate should use RetryCache. Good catch! Could you

[jira] [Comment Edited] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-16 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1734#comment-1734 ] Tsz-wo Sze edited comment on HDFS-16322 at 11/16/21, 10:21 AM: --- [~Nsupyq],

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-16 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1734#comment-1734 ] Tsz-wo Sze commented on HDFS-16322: --- Do you have any suggestion fixing it? As [~shv] mentioned, other

[jira] [Comment Edited] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-16 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444348#comment-17444348 ] Tsz-wo Sze edited comment on HDFS-16322 at 11/16/21, 8:10 AM: -- bq. ... That

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-16 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444348#comment-17444348 ] Tsz-wo Sze commented on HDFS-16322: --- bq. ... That means we should change ClientProtocol.truncate to

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443570#comment-17443570 ] Tsz-wo Sze commented on HDFS-16322: --- > ... (NOTE: t0 t0. It is correct if c1 succeeds but c0 gets

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443566#comment-17443566 ] Tsz-wo Sze commented on HDFS-16322: --- [~hexiaoqiao], The given case is not data loss. As long as NN has

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

2021-11-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443527#comment-17443527 ] Tsz-wo Sze commented on HDFS-16322: --- > ... However, under concurrency, after the first execution of

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2021-04-29 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335172#comment-17335172 ] Tsz-wo Sze commented on HDFS-7285: -- Below is https://img-ask.csdnimg.cn/upload/1619363340018.png :

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2021-04-29 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-7285: - Attachment: 1619363340018.png > Erasure Coding Support inside HDFS > -- >

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

2020-12-11 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248010#comment-17248010 ] Tsz-wo Sze commented on HDFS-15725: --- > This change does not impact the normal "close file" path, which

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

2020-12-11 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247796#comment-17247796 ] Tsz-wo Sze commented on HDFS-15725: --- {code} - ". Committed blocks are waiting to be minimally

[jira] [Updated] (HDFS-7267) TestBalancer#testUnknownDatanode occasionally fails in trunk

2020-11-06 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-7267: - Component/s: test > TestBalancer#testUnknownDatanode occasionally fails in trunk >

[jira] [Updated] (HDFS-15500) In-order deletion of snapshots: Diff lists must be update only in the last snapshot

2020-08-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15500: -- Component/s: snapshots > In-order deletion of snapshots: Diff lists must be update only in the last >

[jira] [Resolved] (HDFS-15519) Check inaccessible INodes in FsImageValidation

2020-08-14 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-15519. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Thanks, [~shashikant] for

[jira] [Resolved] (HDFS-15523) Fix the findbugs warnings from HDFS-15520

2020-08-11 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-15523. --- Fix Version/s: 3.4.0 Resolution: Fixed Thanks [~liuml07] for reviewing the pull request. I

[jira] [Updated] (HDFS-15523) Fix the findbugs warnings from HDFS-15520

2020-08-11 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15523: -- Component/s: namenode > Fix the findbugs warnings from HDFS-15520 >

[jira] [Updated] (HDFS-15523) Fix the findbugs warnings from HDFS-15520

2020-08-11 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15523: -- Description: - Found reliance on default encoding in

[jira] [Created] (HDFS-15523) Fix the findbugs warnings from HDFS-15520

2020-08-11 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-15523: - Summary: Fix the findbugs warnings from HDFS-15520 Key: HDFS-15523 URL: https://issues.apache.org/jira/browse/HDFS-15523 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-15520) Use visitor pattern to visit namespace tree

2020-08-11 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17175875#comment-17175875 ] Tsz-wo Sze commented on HDFS-15520: --- Thanks for pointing out. Will fix it. > Use visitor pattern to

[jira] [Updated] (HDFS-15521) Remove INode.dumpTreeRecursively()

2020-08-11 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15521: -- Priority: Minor (was: Major) > Remove INode.dumpTreeRecursively() >

[jira] [Commented] (HDFS-15521) Remove INode.dumpTreeRecursively()

2020-08-10 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174390#comment-17174390 ] Tsz-wo Sze commented on HDFS-15521: --- Thanks. I already have a patch. Just waiting for HDFS-15520. >

[jira] [Created] (HDFS-15521) Remove INode.dumpTreeRecursively()

2020-08-07 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-15521: - Summary: Remove INode.dumpTreeRecursively() Key: HDFS-15521 URL: https://issues.apache.org/jira/browse/HDFS-15521 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-15519) Check inaccessible INodes in FsImageValidation

2020-08-07 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15519: -- Description: In some corrupted FSImage, there are inaccessible INodes, i.e. these INodes cannot be

[jira] [Updated] (HDFS-15519) Check inaccessible INodes in FsImageValidation

2020-08-07 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15519: -- Description: In some corrupted FSImage, there are inaccessible INodes, i.e. these INodes cannot be

[jira] [Updated] (HDFS-15519) Check inaccessible INodes in FsImageValidation

2020-08-07 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15519: -- Description: In some corrupted FSImage, there are inaccessible INodes. > Check inaccessible INodes

[jira] [Updated] (HDFS-15520) Use visitor pattern to visit namespace tree

2020-08-07 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15520: -- Description: In order to allow the FsImageValidation tool to verify the namespace structure, we use a

[jira] [Updated] (HDFS-15520) Use visitor pattern to visit namespace tree

2020-08-07 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15520: -- Description: In order to allow the FsImageValidation tool to verify the namespace structure, we use a

[jira] [Updated] (HDFS-15520) Use visitor pattern to visit namespace tree

2020-08-07 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15520: -- Description: In order to allow the FsImageValidation tool to verify the namespace, we use a > Use

[jira] [Created] (HDFS-15520) Use visitor pattern to visit namespace tree

2020-08-07 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-15520: - Summary: Use visitor pattern to visit namespace tree Key: HDFS-15520 URL: https://issues.apache.org/jira/browse/HDFS-15520 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-15519) Check inaccessible INodes in FsImageValidation

2020-08-07 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-15519: - Summary: Check inaccessible INodes in FsImageValidation Key: HDFS-15519 URL: https://issues.apache.org/jira/browse/HDFS-15519 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-15500) Add more assertions about ordered deletion of snapshot

2020-07-30 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze reassigned HDFS-15500: - Assignee: (was: Tsz-wo Sze) > Add more assertions about ordered deletion of snapshot >

[jira] [Commented] (HDFS-15479) Ordered snapshot deletion: make it a configurable feature

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164004#comment-17164004 ] Tsz-wo Sze commented on HDFS-15479: --- [~ayushtkn], I also notice the failure recently. I am going to

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Attachment: (was: h15481_20200723b.patch) > Ordered snapshot deletion: garbage collect deleted

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Attachment: h15481_20200723b.patch > Ordered snapshot deletion: garbage collect deleted snapshots >

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Attachment: h15481_20200723b.patch > Ordered snapshot deletion: garbage collect deleted snapshots >

[jira] [Commented] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163841#comment-17163841 ] Tsz-wo Sze commented on HDFS-15481: --- h15481_20200723b.patch: Fix checkstyle and move the private confs

[jira] [Commented] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163816#comment-17163816 ] Tsz-wo Sze commented on HDFS-15481: --- https://github.com/apache/hadoop/pull/2165 > Ordered snapshot

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Status: Patch Available (was: Open) h15481_20200723.patch: add a gc thread to check and gc

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Attachment: h15481_20200723.patch > Ordered snapshot deletion: garbage collect deleted snapshots >

[jira] [Updated] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2020-07-22 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15480: -- Fix Version/s: 1.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2020-07-22 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163130#comment-17163130 ] Tsz-wo Sze commented on HDFS-15480: --- +1 the 002 patch looks good. > Ordered snapshot deletion: record

[jira] [Commented] (HDFS-15482) Ordered snapshot deletion: hide the deleted snapshots from users

2020-07-22 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163128#comment-17163128 ] Tsz-wo Sze commented on HDFS-15482: --- Hi [~hemanthboyina], the marked-as-deleted snapshots will be hided

[jira] [Assigned] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-20 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze reassigned HDFS-15481: - Assignee: Tsz-wo Sze > Ordered snapshot deletion: garbage collect deleted snapshots >

[jira] [Commented] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2020-07-20 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161558#comment-17161558 ] Tsz-wo Sze commented on HDFS-15480: --- BTW, there are a few XAttr constants defined in

[jira] [Commented] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2020-07-20 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161553#comment-17161553 ] Tsz-wo Sze commented on HDFS-15480: --- [~shashikant], thanks for working on this. After marking the

[jira] [Comment Edited] (HDFS-15479) Ordered snapshot deletion: make it a configurable feature

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160772#comment-17160772 ] Tsz-wo Sze edited comment on HDFS-15479 at 7/19/20, 5:52 PM: -

[jira] [Updated] (HDFS-15479) Ordered snapshot deletion: make it a configurable feature

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15479: -- Attachment: h15479_20200719.patch > Ordered snapshot deletion: make it a configurable feature >

[jira] [Updated] (HDFS-15479) Ordered snapshot deletion: make it a configurable feature

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15479: -- Attachment: (was: h15479_20200719.patch) > Ordered snapshot deletion: make it a configurable

[jira] [Commented] (HDFS-15479) Ordered snapshot deletion: make it a configurable feature

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160772#comment-17160772 ] Tsz-wo Sze commented on HDFS-15479: --- h15479_20200719.patch: add a conf > Ordered snapshot deletion:

[jira] [Updated] (HDFS-15479) Ordered snapshot deletion: make it a configurable feature

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15479: -- Attachment: h15479_20200719.patch > Ordered snapshot deletion: make it a configurable feature >

[jira] [Created] (HDFS-15483) Ordered snapshot deletion: Disallow rename between two snapshottable directories

2020-07-19 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-15483: - Summary: Ordered snapshot deletion: Disallow rename between two snapshottable directories Key: HDFS-15483 URL: https://issues.apache.org/jira/browse/HDFS-15483 Project:

[jira] [Updated] (HDFS-15477) Enforce ordered snapshot deletion

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15477: -- Description: Snapshot deletion has caused a few bugs earlier such as HDFS-13101 and HDFS-15313. In

[jira] [Updated] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15480: -- Description: In this JIRA, the behavior of deleting the non-earliest snapshots will be changed to

[jira] [Updated] (HDFS-15482) Ordered snapshot deletion: hide the deleted snapshots from users

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15482: -- Component/s: snapshots > Ordered snapshot deletion: hide the deleted snapshots from users >

[jira] [Created] (HDFS-15482) Ordered snapshot deletion: hide the deleted snapshots from users

2020-07-19 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-15482: - Summary: Ordered snapshot deletion: hide the deleted snapshots from users Key: HDFS-15482 URL: https://issues.apache.org/jira/browse/HDFS-15482 Project: Hadoop HDFS

[jira] [Created] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-19 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-15481: - Summary: Ordered snapshot deletion: garbage collect deleted snapshots Key: HDFS-15481 URL: https://issues.apache.org/jira/browse/HDFS-15481 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15479) Ordered snapshot deletion: make it a configurable feature

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15479: -- Summary: Ordered snapshot deletion: make it a configurable feature (was: Add a conf for enforcing

[jira] [Updated] (HDFS-15479) Add a conf for enforcing ordered snapshot deletion

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15479: -- Description: Ordered snapshot deletion is a configurable feature. In this JIRA, a conf is added.

[jira] [Created] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2020-07-19 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-15480: - Summary: Ordered snapshot deletion: record snapshot deletion in XAttr Key: HDFS-15480 URL: https://issues.apache.org/jira/browse/HDFS-15480 Project: Hadoop HDFS

[jira] [Created] (HDFS-15479) Add a conf for enforcing ordered snapshot deletion

2020-07-19 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-15479: - Summary: Add a conf for enforcing ordered snapshot deletion Key: HDFS-15479 URL: https://issues.apache.org/jira/browse/HDFS-15479 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15477) Enforce ordered snapshot deletion

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15477: -- Description: Snapshot deletion has caused a few bugs earlier such as HDFS-13101 and HDFS-15313. In

[jira] [Updated] (HDFS-15477) Enforce ordered snapshot deletion

2020-07-19 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15477: -- Description: Snapshot deletion has caused a few bugs earlier such as HDFS-13101 and HDFS-15313. In

[jira] [Updated] (HDFS-15477) Enforce ordered snapshot deletion

2020-07-18 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15477: -- Description: Snapshot deletion has caused a few bugs earlier such as HDFS-13101 and HDFS-15313. In

  1   2   3   >