[
https://issues.apache.org/jira/browse/HADOOP-18925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773970#comment-17773970
]
ASF GitHub Bot commented on HADOOP-18925:
-----------------------------------------
steveloughran commented on code in PR #6163:
URL: https://github.com/apache/hadoop/pull/6163#discussion_r1354492562
##########
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java:
##########
@@ -1309,4 +1309,17 @@ private Constants() {
* The bucket region header.
*/
public static final String BUCKET_REGION_HEADER = "x-amz-bucket-region";
+
+ /**
+ * Is the higher performance copy from local file to S3 enabled?
+ * This switch allows for it to be disabled if there are problems.
+ * Value: {@value}.
+ */
+ public static final String COPY_FROM_LOCAL_ENABLED =
"fs.s3a.copy.from.local.enabled";
Review Comment:
i see. maybe "optimized"
> S3A: add option "fs.s3a.copy.from.local.enabled" to enable/disable
> CopyFromLocalOperation
> -----------------------------------------------------------------------------------------
>
> Key: HADOOP-18925
> URL: https://issues.apache.org/jira/browse/HADOOP-18925
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 3.3.6
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> reported failure of CopyFromLocalOperation.getFinalPath() during job
> submission with s3a declared as cluster fs.
> add an emergency option to disable this optimised uploader and revert to the
> superclass implementation
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
