[
https://issues.apache.org/jira/browse/NIFI-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15369938#comment-15369938
]
Alex Tilcock commented on NIFI-1922:
------------------------------------
I've now created a new build based on the latest master and removed the patch.
After some more testing I discovered that there was no need for the
azure-storage dependency so I've removed it. Per earlier comment testing this
change is not straight forward due to the security model employed by Azure
HDInsight. If you replace the test core-site.xml with one from a HDInsight
cluster it will fail on the authorization process which requires a set of
python files that are present on the cluster. There is a workaround to resolve
this by copying these python files to your local machine and then editing the
path in core-site.xml.
One other observation is that the hadoop processors are now using a mix of the
2.6.x and 2.7.x hadoop libraries. It would be nice in the future to update
everything to use 2.7.x but it appears that doing this will require some
significant refactoring.
> Add support for WASB / Azure Blob Storage with HDFS processors
> --------------------------------------------------------------
>
> Key: NIFI-1922
> URL: https://issues.apache.org/jira/browse/NIFI-1922
> Project: Apache NiFi
> Issue Type: New Feature
> Reporter: Joseph Witt
>
> https://hadoop.apache.org/docs/stable2/hadoop-azure/index.html
> Received two mailing list questions on this in the past couple weeks.
> We should look at what things we'd need to do in the processors to make this
> possible. Adding the dependency is one, anything else?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
