[
https://issues.apache.org/jira/browse/HDFS-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634060#comment-16634060
]
Wei-Chiu Chuang commented on HDFS-13052:
----------------------------------------
I'm late to review this (coming from HDFS-13877). While this Jira provides a
handy snapshotdiff api, in practice this is not usable in production.
See: HDFS-12594 and HDFS-12165. In extreme cases I've seen
getSnapshotDiffReport RPC sending 2GB protobuf message and failed. Even in
not-so-extreme cases, since webhdfs server side runs in NameNode process, NN
heap usage change like that can easily fail SLA or even lead to fail over.
Instead, we should implement something equivalent to
DistributedFileSystem#snapshotDiffReportListingRemoteIterator. Use the
interface implemented in HDFS-12594 and return an iterator.
> WebHDFS: Add support for snasphot diff
> --------------------------------------
>
> Key: HDFS-13052
> URL: https://issues.apache.org/jira/browse/HDFS-13052
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Lokesh Jain
> Assignee: Lokesh Jain
> Priority: Major
> Labels: snapshot, webhdfs
> Fix For: 3.1.0, 3.0.3
>
> Attachments: HDFS-13052.001.patch, HDFS-13052.002.patch,
> HDFS-13052.003.patch, HDFS-13052.004.patch, HDFS-13052.005.patch,
> HDFS-13052.006.patch, HDFS-13052.007.patch
>
>
> This Jira aims to implement snapshot diff operation for webHdfs filesystem.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
