[
https://issues.apache.org/jira/browse/HDFS-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17880356#comment-17880356
]
ASF GitHub Bot commented on HDFS-17381:
---------------------------------------
steveloughran commented on PR #6551:
URL: https://github.com/apache/hadoop/pull/6551#issuecomment-2338275838
> I don't see many usages of the createFile() api that returns the builder
object though and I see this jira
([HADOOP-14384](https://issues.apache.org/jira/browse/HADOOP-14384)) that
reduces usage of this API, I hope we can use it now.
that was before hadoop 3.0 shipped. it is now stable and while not used much
in those libraries that still want to run on on java2 -and because they're
confident we aren't going to cut the old ones.
The HDFS subclass provides many more options; S3A supports extra options
such as "fs.s3a.create.performance" which turns off the safety check of a LIST
for child objects.
We've just been working hard to make those same libraries able to use the
builder based openFile() API as it has tangible performance benefits.
> Distcp of EC files should not be limited to DFS.
> ------------------------------------------------
>
> Key: HDFS-17381
> URL: https://issues.apache.org/jira/browse/HDFS-17381
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: distcp
> Reporter: Sadanand Shenoy
> Assignee: Sadanand Shenoy
> Priority: Major
> Labels: pull-request-available
>
> Currently EC file support in distcp is limited to DFS and the code checks if
> the given FS instance is DistributedFileSystem, In Ozone, EC is supported
> now, and this limitation can be removed and a general contract for any
> filesystem that supports EC files should be allowed by implementing few
> interfaces/methods.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
