[
https://issues.apache.org/jira/browse/HADOOP-18337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566286#comment-17566286
]
Steve Loughran commented on HADOOP-18337:
-----------------------------------------
this is a really hard piece of code to do. i say this having done it more than
once.
for all the details, see
https://github.com/steveloughran/zero-rename-committer/releases/download/tag_release_2021-05-17/a_zero_rename_committer.pdf
i would recommend embracing apache iceberg. its committers will work, and you
will get faster query planning
> Supporting performant output committers for Aliyun
> --------------------------------------------------
>
> Key: HADOOP-18337
> URL: https://issues.apache.org/jira/browse/HADOOP-18337
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/oss
> Affects Versions: 3.3.3
> Reporter: Ujjawal Kumar
> Priority: Minor
>
> Due to the non-performant rename on OSS (similar to s3), zero-rename output
> committer (similar to HADOOP-13786 which provides this for S3) can be added
> for Aliyun as well. I see [similar output committer provided by Alibaba's E
> MapReduce
> platform|https://www.alibabacloud.com/help/en/e-mapreduce/latest/use-jindo-job-committer]
> but it's not available in open source
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
