[
https://issues.apache.org/jira/browse/NIFI-14384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18040642#comment-18040642
]
ASF subversion and git services commented on NIFI-14384:
--------------------------------------------------------
Commit 800063c30982fa2ddaaaac18756e8815225327be in nifi's branch
refs/heads/main from shubalex
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=800063c309 ]
NIFI-14384 Added Force Path Style option to S3 Persistence Provider (#10331)
Signed-off-by: David Handermann <[email protected]>
> NiFi Registry - S3BundlePersistenceProvider can't connect to a private MinIO
> ----------------------------------------------------------------------------
>
> Key: NIFI-14384
> URL: https://issues.apache.org/jira/browse/NIFI-14384
> Project: Apache NiFi
> Issue Type: Bug
> Components: NiFi Registry
> Affects Versions: 2.3.0
> Environment: S3 server implemented using MinIO
> Reporter: Hervé Barrault
> Priority: Major
> Attachments: S3BundlePersistenceProvider.java, diff.txt
>
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> My s3 provider is a private minio thus providing a *path style access* to
> bucket.
> I'm trying to configure the S3BundlePersistenceProvider.
> The configuration is like
> <extensionBundlePersistenceProvider>
> <class>org.apache.nifi.registry.aws.S3BundlePersistenceProvider</class>
> <propertyname="Region">us-east-1</property>
> <propertyname="Bucket Name">nifireg</property>
> <propertyname="Key Prefix"></property>
> <propertyname="Credentials Provider">STATIC</property>
> <propertyname="Access Key">MY_LOGIN</property>
> <propertyname="Secret Access Key">MY_PASSWORD</property>
> <propertyname="Endpoint
> URL">[http://s3.minio:9000|http://127.0.0.1:9000/]</property>
> </extensionBundlePersistenceProvider>
>
> without success as the client always use the domain style bucket management
> (which is the default). It seems the unit test does not fail due to 127.0.0.1
> IP usage.
>
> I checked on the code here (on main branch)
> [https://github.com/apache/nifi/blob/main/nifi-registry/nifi-registry-extensions/ni[…]a/org/apache/nifi/registry/aws/S3BundlePersistenceProvider.java|https://github.com/apache/nifi/blob/main/nifi-registry/nifi-registry-extensions/nifi-registry-aws/nifi-registry-aws-extensions/src/main/java/org/apache/nifi/registry/aws/S3BundlePersistenceProvider.java]
> there is no condition to allow path style usage.
> On s3 sdk, the api to call is here :
> [https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/s3/S3ClientOptions.Builder.html#setPathStyleAccess-boolean-]
>
> In order to allow such integration a new properties shall be introduced like
> "Path Style" which is false by default but configurable and trigger the
> pathstyleaccess configuration.
> I did a small successful test in patching the S3BundlePersistenceProvider,
> with the used API in your code, it is forcePathStyle configuration.
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
