[
https://issues.apache.org/jira/browse/NIFI-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008051#comment-15008051
]
Joe Skora commented on NIFI-1107:
---------------------------------
[~tkurc],
Endpoint Override is incorporated in the pull request and should be a
non-breaking enhancement. If preferred, I can pull it out separately. The PR
includes updates AbstractAWSProcessor, FetchS3Object, and PutS3Object, but
DeleteS3Object and the SNS and SQS processors will still need to be updated.
The AWS SDK already supported use of an arbitrary endpoint, this just makes
that it possible for a NiFi user to supply that URL with is then provided to
the client on [line 195 in
AstractAWSProcessor|https://github.com/jskora/nifi/blob/NIFI-1107/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-processors/src/main/java/org/apache/nifi/processors/aws/AbstractAWSProcessor.java#L195].
In my experience, if not using the real Amazon endpoints, this is likely to be
a fixed URL, but it's possible that other providers may have multiple endpoints.
> Create new PutS3ObjectMultipart processor
> -----------------------------------------
>
> Key: NIFI-1107
> URL: https://issues.apache.org/jira/browse/NIFI-1107
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Core Framework
> Reporter: Joe Skora
> Assignee: Joe Skora
> Labels: s3
> Fix For: 0.5.0
>
>
> A new `PutS3ObjectMultipart` processor using the AWS S3 API to upload files
> larger than those supported by `PutS3Object` which has a [5GB
> limit|http://docs.aws.amazon.com/AmazonS3/latest/dev/UploadingObjects.html]
> limit.
> To support S3 compatible endpoints this will also add an `Endpoint Override
> URL` property to `AbstractAWSProcessor` to set the service
> [endpoint|http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/AmazonWebServiceClient.html#setEndpoint(java.lang.String)]
> to override the endpoint URL normally selected based on the the Amazon
> region.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)