Peter Turcsanyi created NIFI-12928:
--------------------------------------
Summary: Add Simple Write strategy in PutAzureDataLakeStorage
Key: NIFI-12928
URL: https://issues.apache.org/jira/browse/NIFI-12928
Project: Apache NiFi
Issue Type: Improvement
Reporter: Peter Turcsanyi
Assignee: Peter Turcsanyi
NIFI-8248 introduced temporary location for file uploads in
PutAzureDataLakeStorage. The file is uploaded into a temporary directory first
and then moved to the final location.
The motivation behind this was that the file upload with Azure client API is a
2-step process: first an empty file is created, then the content is uploaded.
The unfinished empty file would be available for listing / fetching. Also, if
the put processor is in 'replace' mode and the uploading fails, then old
content is lost as the file was already cleared.
However, this behaviour is not desired in all cases and writing the file
directly to its final location would be preferred. E.g. when ACL is used for
permission handling and the temporary folder would need extra administration
(and the files are not listed/read in parallel so there is no issue with the
partially written files).
Add 'Writing Strategy' property with 'Write and Rename' (current behaviour,
default) and 'Simple Write' options.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
