[
https://issues.apache.org/jira/browse/HDFS-15492?focusedWorklogId=484223&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484223
]
ASF GitHub Bot logged work on HDFS-15492:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 14/Sep/20 22:07
Start Date: 14/Sep/20 22:07
Worklog Time Spent: 10m
Work Description: smengcl edited a comment on pull request #2176:
URL: https://github.com/apache/hadoop/pull/2176#issuecomment-692330196
> I'm late to this. But we should verify to make sure httpfs also behaves
the sames. Otherwise it'll break Hue.
hey @jojochuang, thanks for checking in!
I have written a simple test for verifying HttpFS (over WebHDFS). HttpFS
works as expected. But I haven't figured out how to add a config to the HDFS
cluster that `BaseTestHttpFSWith` launches. Currently the config change for
this test is a bit hacky. Ergo, I haven't submitted a patch for new jira to add
this test. I would file a new jira to add it once this little problem is solved.
[HDFS-15492.TestHttpFS.001.patch.txt](https://github.com/apache/hadoop/files/5221189/HDFS-15492.TestHttpFS.001.patch.txt)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 484223)
Time Spent: 0.5h (was: 20m)
> Make trash root inside each snapshottable directory
> ---------------------------------------------------
>
> Key: HDFS-15492
> URL: https://issues.apache.org/jira/browse/HDFS-15492
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs, hdfs-client
> Affects Versions: 3.2.1
> Reporter: Siyao Meng
> Assignee: Siyao Meng
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> We have seen FSImage corruption cases (e.g. HDFS-13101) where files inside
> one snapshottable directories are moved outside of it. The most common case
> of this is when trash is enabled and user deletes some file via the command
> line without skipTrash.
> This jira aims to make a trash root for each snapshottable directory, same as
> how encryption zone behaves at the moment.
> This will make trash cleanup a little bit more expensive on the NameNode as
> it will be to iterate all trash roots. But should be fine as long as there
> aren't many snapshottable directories.
> I could make this improvement as an option and disable it by default if
> needed, such as {{dfs.namenode.snapshot.trashroot.enabled}}
> One small caveat though, when disabling (disallowing) snapshot on the
> snapshottable directory when this improvement is in place. The client should
> merge the snapshottable directory's trash with that user's trash to ensure
> proper trash cleanup.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
