[
https://issues.apache.org/jira/browse/NIFI-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271630#comment-16271630
]
ASF GitHub Bot commented on NIFI-4565:
--------------------------------------
Github user baank commented on the issue:
https://github.com/apache/nifi/pull/2293
@jfrazee .. The version of Hadoop-AWS you are referring to does not support
ANY S3 encryption which rules that solution out for many organisations. To
support S3 encryption you need hadoop-aws-2.8.1 as a minimum.
So unless I am mistaken the Additional Classpath Resources is not a
solution since it will result in JAR conflicts.
I am happy to look into upgrading all of the other processors to 2.8.1 as
we need encryption and really don't want to be running a fork of NiFi in
production.
> PutParquet doesn't support S3
> -----------------------------
>
> Key: NIFI-4565
> URL: https://issues.apache.org/jira/browse/NIFI-4565
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.4.0
> Reporter: Franco
> Assignee: Joey Frazee
>
> PutParquet doesn't support S3 targets due to the lack of the hadoop-aws
> dependency.
> To recreate it:
> 1) Modify core-site.xml to change fs.defaultName to one starting with s3://
> 2) Add a PutParquet
> 3) It will fail to run. The logs will show the missing hadoop-aws dependency.
> Simple fix is just to add hadoop-aws.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
