[jira] [Commented] (HDFS-16145) CopyListing fails with FNF exception with snapshot diff

2023-08-07 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751786#comment-17751786 ] Siyao Meng commented on HDFS-16145: --- [~sodonnell] Looks like branch-3.2 would need HDFS-14869 first.

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

2022-07-26 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571585#comment-17571585 ] Siyao Meng commented on HDFS-16645: --- Thanks [~xuzq_zander] for reporting this issue and posting the

[jira] [Updated] (HDFS-16055) Quota is not preserved in snapshot INode

2021-06-14 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-16055: -- Fix Version/s: (was: 3.3.2) 3.4.0 > Quota is not preserved in snapshot INode >

[jira] [Updated] (HDFS-16055) Quota is not preserved in snapshot INode

2021-06-14 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-16055: -- Fix Version/s: 3.3.2 Target Version/s: (was: 3.3.2) Resolution: Fixed

[jira] [Updated] (HDFS-16055) Quota is not preserved in snapshot INode

2021-06-04 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-16055: -- Status: Patch Available (was: Open) > Quota is not preserved in snapshot INode >

[jira] [Created] (HDFS-16055) Quota is not preserved in snapshot INode

2021-06-04 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-16055: - Summary: Quota is not preserved in snapshot INode Key: HDFS-16055 URL: https://issues.apache.org/jira/browse/HDFS-16055 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-15997) Implement dfsadmin -provisionSnapshotTrash -all

2021-05-10 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15997: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

2021-04-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15982: -- Component/s: hdfs-client > Deleted data using HTTP API should be saved to the trash >

[jira] [Updated] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

2021-04-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15982: -- Labels: pull-request-available (was: incompatibleChange pull-request-available) > Deleted data using

[jira] [Updated] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

2021-04-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15982: -- Labels: incompatibleChange pull-request-available (was: pull-request-available) > Deleted data using

[jira] [Updated] (HDFS-15997) Implement dfsadmin -provisionSnapshotTrash -all

2021-04-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15997: -- Description: Currently dfsadmin -provisionSnapshotTrash only supports creating trash root one by one.

[jira] [Updated] (HDFS-15997) Implement dfsadmin -provisionSnapshotTrash -all

2021-04-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15997: -- Description: Currently > Implement dfsadmin -provisionSnapshotTrash -all >

[jira] [Updated] (HDFS-15997) Implement dfsadmin -provisionSnapshotTrash -all

2021-04-26 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15997: -- Status: Patch Available (was: Open) > Implement dfsadmin -provisionSnapshotTrash -all >

[jira] [Created] (HDFS-15997) Implement dfsadmin -provisionSnapshotTrash -all

2021-04-26 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15997: - Summary: Implement dfsadmin -provisionSnapshotTrash -all Key: HDFS-15997 URL: https://issues.apache.org/jira/browse/HDFS-15997 Project: Hadoop HDFS Issue Type:

[jira] [Comment Edited] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2021-04-14 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320927#comment-17320927 ] Siyao Meng edited comment on HDFS-15614 at 4/14/21, 11:31 AM: -- Thanks for

[jira] [Commented] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2021-04-14 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320927#comment-17320927 ] Siyao Meng commented on HDFS-15614: --- Thanks for bringing this up [~ayushtkn]. {quote} And this fails,

[jira] [Updated] (HDFS-15820) Ensure snapshot root trash provisioning happens only post safe mode exit

2021-02-06 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15820: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-15820) Ensure snapshot root trash provisioning happens only post safe mode exit

2021-02-04 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15820: -- Status: Patch Available (was: Open) > Ensure snapshot root trash provisioning happens only post safe

[jira] [Commented] (HDFS-15820) Ensure snapshot root trash provisioning happens only post safe mode exit

2021-02-04 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279050#comment-17279050 ] Siyao Meng commented on HDFS-15820: --- [~shashikant] will do. > Ensure snapshot root trash provisioning

[jira] [Updated] (HDFS-15689) allow/disallowSnapshot on EZ roots shouldn't fail due to trash provisioning/emptiness check

2020-12-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15689: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-15689) allow/disallowSnapshot on EZ roots shouldn't fail due to trash provisioning/emptiness check

2020-11-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15689: -- Status: Patch Available (was: Open) > allow/disallowSnapshot on EZ roots shouldn't fail due to trash

[jira] [Updated] (HDFS-15689) allow/disallowSnapshot on EZ roots shouldn't fail due to trash provisioning/emptiness check

2020-11-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15689: -- Summary: allow/disallowSnapshot on EZ roots shouldn't fail due to trash provisioning/emptiness check

[jira] [Created] (HDFS-15689) allow/disallowSnapshot on EZ roots shouldn't fail due to trash root provisioning or emptiness check

2020-11-18 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15689: - Summary: allow/disallowSnapshot on EZ roots shouldn't fail due to trash root provisioning or emptiness check Key: HDFS-15689 URL: https://issues.apache.org/jira/browse/HDFS-15689

[jira] [Commented] (HDFS-15607) Create trash dir when allowing snapshottable dir

2020-11-10 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229496#comment-17229496 ] Siyao Meng commented on HDFS-15607: --- Note this jira has an addendum patch that fixes a small bug where

[jira] [Updated] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-13 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15614: -- Fix Version/s: 3.3.1 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-13 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15614: -- Fix Version/s: (was: 3.3.1) 3.4.0 > Initialize snapshot trash root during

[jira] [Updated] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-08 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15614: -- Status: Patch Available (was: In Progress) > Initialize snapshot trash root during NameNode startup

[jira] [Work started] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-08 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15614 started by Siyao Meng. - > Initialize snapshot trash root during NameNode startup if enabled >

[jira] [Updated] (HDFS-15611) Add list Snapshot command in WebHDFS

2020-10-06 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15611: -- Status: Patch Available (was: Open) > Add list Snapshot command in WebHDFS >

[jira] [Updated] (HDFS-15612) WebHDFS: Support provisionSnapshotTrash

2020-10-05 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15612: -- Parent: HDFS-15477 Issue Type: Sub-task (was: Improvement) > WebHDFS: Support

[jira] [Updated] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-05 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15614: -- Parent: HDFS-15477 Issue Type: Sub-task (was: Improvement) > Initialize snapshot trash root

[jira] [Assigned] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-05 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng reassigned HDFS-15614: - Assignee: Siyao Meng > Initialize snapshot trash root during NameNode startup if enabled >

[jira] [Created] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-05 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15614: - Summary: Initialize snapshot trash root during NameNode startup if enabled Key: HDFS-15614 URL: https://issues.apache.org/jira/browse/HDFS-15614 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15607) Create trash dir when allowing snapshottable dir

2020-10-05 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-15612) WebHDFS: Support provisionSnapshotTrash

2020-10-01 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15612: -- Description: In HDFS-15607 we are adding snapshot trash root provision command to help create the

[jira] [Created] (HDFS-15612) WebHDFS:

2020-10-01 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15612: - Summary: WebHDFS: Key: HDFS-15612 URL: https://issues.apache.org/jira/browse/HDFS-15612 Project: Hadoop HDFS Issue Type: Improvement Reporter: Siyao

[jira] [Updated] (HDFS-15612) WebHDFS: Support provisionSnapshotTrash

2020-10-01 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15612: -- Summary: WebHDFS: Support provisionSnapshotTrash (was: WebHDFS: ) > WebHDFS: Support

[jira] [Updated] (HDFS-15607) Create trash dir when allowing snapshottable dir

2020-09-30 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Status: Patch Available (was: In Progress) > Create trash dir when allowing snapshottable dir >

[jira] [Updated] (HDFS-15609) Implement hdfs getconf -serverDefaults

2020-09-30 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15609: -- Description: There doesn't seem to be an existing way to easily verify whether a Hadoop/HDFS client

[jira] [Created] (HDFS-15609) Implement hdfs getconf -serverDefaults

2020-09-30 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15609: - Summary: Implement hdfs getconf -serverDefaults Key: HDFS-15609 URL: https://issues.apache.org/jira/browse/HDFS-15609 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-15607) Create trash dir when allowing snapshottable dir

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Description: In {{TrashPolicyDefault}}, the {{.Trash}} directory will be created with permission 700

[jira] [Updated] (HDFS-15607) Create trash dir when allowing snapshottable dir

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Description: In {{TrashPolicyDefault}}, the {{.Trash}} directory will be created with permission 700

[jira] [Updated] (HDFS-15607) Create trash dir when allowing snapshottable dir

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Description: In {{TrashPolicyDefault}}, the {{.Trash}} directory will be created with permission 700

[jira] [Updated] (HDFS-15607) Create trash dir when allowing snapshottable dir

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Description: In {{TrashPolicyDefault}}, the {{.Trash}} directory will be created with permission 700

[jira] [Updated] (HDFS-15607) Create trash dir when allowing snapshottable dir

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Summary: Create trash dir when allowing snapshottable dir (was: Trash directory should be created in

[jira] [Updated] (HDFS-15607) Trash directory should be created in advance for snapshottable directory

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Parent: HDFS-15477 Issue Type: Sub-task (was: Bug) > Trash directory should be created in

[jira] [Updated] (HDFS-15607) Trash directory should be created in advance for snapshottable directory

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Affects Version/s: 3.4.0 > Trash directory should be created in advance for snapshottable directory >

[jira] [Updated] (HDFS-15607) Trash directory should be created in advance for snapshottable directory

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Target Version/s: 3.4.0 > Trash directory should be created in advance for snapshottable directory >

[jira] [Updated] (HDFS-15607) Trash directory should be created in advance for snapshottable directory

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Description: In {{TrashPolicyDefault}}, the {{.Trash}} directory will be created with permission 700

[jira] [Updated] (HDFS-15607) Trash directory should be created in advance for snapshottable directory

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Description: In {{TrashPolicyDefault}}, the {{.Trash}} directory will be created with permission 700

[jira] [Work started] (HDFS-15607) Trash directory should be created in advance for snapshottable directory

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15607 started by Siyao Meng. - > Trash directory should be created in advance for snapshottable directory >

[jira] [Updated] (HDFS-15607) Trash directory should be created in advance for snapshottable directory

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Description: In {{TrashPolicyDefault}}, the {{.Trash}} directory will be created with permission 700

[jira] [Created] (HDFS-15607) Trash directory should be created in advance for snapshottable directory

2020-09-29 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15607: - Summary: Trash directory should be created in advance for snapshottable directory Key: HDFS-15607 URL: https://issues.apache.org/jira/browse/HDFS-15607 Project: Hadoop

[jira] [Updated] (HDFS-15607) Trash directory should be created in advance for snapshottable directory

2020-09-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15607: -- Component/s: hdfs > Trash directory should be created in advance for snapshottable directory >

[jira] [Commented] (HDFS-15513) Allow client to query snapshot status on one directory

2020-09-22 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200250#comment-17200250 ] Siyao Meng commented on HDFS-15513: --- Hi [~jianghuazhu], thanks for the comment. The goal here is to

[jira] [Updated] (HDFS-15539) When disallowing snapshot on a dir, throw exception if its trash root is not empty

2020-09-15 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15539: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-15563) Incorrect getTrashRoot return value when a non-snapshottable dir prefix matches the path of a snapshottable dir

2020-09-09 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15563: -- Description: Note: Only impacts a user if {{dfs.namenode.snapshot.trashroot.enabled}} is enabled.

[jira] [Updated] (HDFS-15563) Incorrect getTrashRoot return value when a non-snapshottable dir prefix matches the path of a snapshottable dir

2020-09-09 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15563: -- Status: Patch Available (was: Open) > Incorrect getTrashRoot return value when a non-snapshottable

[jira] [Updated] (HDFS-15563) Incorrect getTrashRoot return value when a non-snapshottable dir prefix matches the path of a snapshottable dir

2020-09-09 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15563: -- Description: Note: Only impacts a user if {{dfs.namenode.snapshot.trashroot.enabled}} is enabled.

[jira] [Updated] (HDFS-15563) Incorrect getTrashRoot return value when a non-snapshottable dir prefix matches the path of a snapshottable dir

2020-09-09 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15563: -- Description: Note: Only impacts a user if {{dfs.namenode.snapshot.trashroot.enabled}} is enabled.

[jira] [Updated] (HDFS-15563) Incorrect getTrashRoot return value when a non-snapshottable dir prefix matches the path of a snapshottable dir

2020-09-09 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15563: -- Summary: Incorrect getTrashRoot return value when a non-snapshottable dir prefix matches the path of a

[jira] [Updated] (HDFS-15539) When disallowing snapshot on a dir, throw exception if its trash root is not empty

2020-08-28 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15539: -- Status: Patch Available (was: Open) > When disallowing snapshot on a dir, throw exception if its

[jira] [Updated] (HDFS-15539) When disallowing snapshot on a dir, throw exception if its trash root is not empty

2020-08-26 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15539: -- Parent: HDFS-15477 Issue Type: Sub-task (was: Improvement) > When disallowing snapshot on a

[jira] [Created] (HDFS-15539) When disallowing snapshot on a dir, throw exception if its snapshot root is not empty

2020-08-26 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15539: - Summary: When disallowing snapshot on a dir, throw exception if its snapshot root is not empty Key: HDFS-15539 URL: https://issues.apache.org/jira/browse/HDFS-15539

[jira] [Updated] (HDFS-15539) When disallowing snapshot on a dir, throw exception if its trash root is not empty

2020-08-26 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15539: -- Summary: When disallowing snapshot on a dir, throw exception if its trash root is not empty (was:

[jira] [Updated] (HDFS-15526) Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-12 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15526: -- Status: Patch Available (was: Open) > Tests in TestOzoneFileSystem should use the existing

[jira] [Created] (HDFS-15526) Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-12 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15526: - Summary: Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster Key: HDFS-15526 URL: https://issues.apache.org/jira/browse/HDFS-15526 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15525) Make trash root inside each snapshottable directory for WebHDFS

2020-08-12 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15525: -- Status: Patch Available (was: Open) > Make trash root inside each snapshottable directory for WebHDFS

[jira] [Created] (HDFS-15525) Make trash root inside each snapshottable directory for WebHDFS

2020-08-12 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15525: - Summary: Make trash root inside each snapshottable directory for WebHDFS Key: HDFS-15525 URL: https://issues.apache.org/jira/browse/HDFS-15525 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2020-08-11 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-15513) Allow client to query snapshot status on one directory

2020-08-05 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15513: -- Description: Alternatively, we can allow the client to query snapshot status on *a list of* given

[jira] [Created] (HDFS-15513) Allow client to query snapshot status on one directory

2020-08-05 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15513: - Summary: Allow client to query snapshot status on one directory Key: HDFS-15513 URL: https://issues.apache.org/jira/browse/HDFS-15513 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2020-08-04 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Status: Patch Available (was: In Progress) > Make trash root inside each snapshottable directory >

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Description: We have seen FSImage corruption cases (e.g. HDFS-13101) where files inside one

[jira] [Comment Edited] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

2020-07-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167526#comment-17167526 ] Siyao Meng edited comment on HDFS-15495 at 7/29/20, 10:20 PM: -- Awesome!

[jira] [Updated] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

2020-07-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15495: -- Description: Originally discovered in patched CDH 6.2.1 (with a bunch of EC fixes: HDFS-14699,

[jira] [Commented] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

2020-07-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167526#comment-17167526 ] Siyao Meng commented on HDFS-15495: --- Awesome! Thanks [~sodonnell] for the writeup and unit test. I

[jira] [Created] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

2020-07-27 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15495: - Summary: Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely Key: HDFS-15495 URL: https://issues.apache.org/jira/browse/HDFS-15495

[jira] [Work started] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15492 started by Siyao Meng. - > Make trash root inside each snapshottable directory >

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Affects Version/s: 3.2.1 > Make trash root inside each snapshottable directory >

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Target Version/s: 3.3.1 > Make trash root inside each snapshottable directory >

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Component/s: hdfs-client hdfs > Make trash root inside each snapshottable directory >

[jira] [Created] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-23 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15492: - Summary: Make trash root inside each snapshottable directory Key: HDFS-15492 URL: https://issues.apache.org/jira/browse/HDFS-15492 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-15462) Add fs.viewfs.overload.scheme.target.ofs.impl to core-default.xml

2020-07-09 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15462: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-15462) Add fs.viewfs.overload.scheme.target.ofs.impl to core-default.xml

2020-07-08 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15462: -- Component/s: viewfsOverloadScheme viewfs

[jira] [Updated] (HDFS-15462) Add fs.viewfs.overload.scheme.target.ofs.impl to core-default.xml

2020-07-08 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15462: -- Status: Patch Available (was: Open) > Add fs.viewfs.overload.scheme.target.ofs.impl to

[jira] [Created] (HDFS-15462) Add fs.viewfs.overload.scheme.target.ofs.impl to core-default.xml

2020-07-08 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15462: - Summary: Add fs.viewfs.overload.scheme.target.ofs.impl to core-default.xml Key: HDFS-15462 URL: https://issues.apache.org/jira/browse/HDFS-15462 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2020-06-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14920: -- Description: Decommission test hangs in our clusters. Have seen the messages as follow {quote}

[jira] [Commented] (HDFS-15236) Upgrade googletest to the latest version

2020-05-22 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114321#comment-17114321 ] Siyao Meng commented on HDFS-15236: --- No worries. Glad to help. Reinstalling protobuf 3.7.1 might solve

[jira] [Commented] (HDFS-15236) Upgrade googletest to the latest version

2020-05-21 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113645#comment-17113645 ] Siyao Meng commented on HDFS-15236: --- [~aajisaka] I am able to compile with {{mvn install -Pnative

[jira] [Updated] (HDFS-15262) Add fsck servlet to Secondary NameNode

2020-04-04 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15262: -- Description: Allows for running fsck on Secondary NameNode. The diff is one-line:

[jira] [Updated] (HDFS-15262) Add fsck servlet to Secondary NameNode

2020-04-04 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15262: -- Description: Allows for running fsck on Secondary NameNode.

[jira] [Resolved] (HDFS-15262) Add fsck servlet to Secondary NameNode

2020-04-04 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng resolved HDFS-15262. --- Resolution: Won't Fix After a second thought it doesn't really make sense to put fsck in Secondary

[jira] [Created] (HDFS-15262) Add fsck servlet to Secondary NameNode

2020-04-04 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15262: - Summary: Add fsck servlet to Secondary NameNode Key: HDFS-15262 URL: https://issues.apache.org/jira/browse/HDFS-15262 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-15262) Add fsck servlet to Secondary NameNode

2020-04-04 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15262: -- Priority: Minor (was: Major) > Add fsck servlet to Secondary NameNode >

[jira] [Updated] (HDFS-14978) In-place Erasure Coding Conversion

2020-04-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14978: -- Target Version/s: 3.4.0 > In-place Erasure Coding Conversion > -- > >

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff to support WebHDFS

2020-03-24 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13916: -- Target Version/s: 3.3.1, 3.4.0 > Distcp SnapshotDiff to support WebHDFS >

[jira] [Updated] (HDDS-1987) Fix listStatus API

2019-11-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1987: - Status: Patch Available (was: In Progress) > Fix listStatus API > -- > >

[jira] [Updated] (HDDS-2455) Implement MiniOzoneHAClusterImpl#getOMLeader

2019-11-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-2455: - Status: Patch Available (was: In Progress) > Implement MiniOzoneHAClusterImpl#getOMLeader >

[jira] [Updated] (HDDS-2105) Merge OzoneClientFactory#getRpcClient functions

2019-11-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-2105: - Status: Patch Available (was: In Progress) > Merge OzoneClientFactory#getRpcClient functions >

  1   2   3   4   5   6   7   8   >