Paul Kelly created NIFI-14318:
---------------------------------
Summary: PutAzureBlobStorage_v12 cannot upload files larger than
200GB
Key: NIFI-14318
URL: https://issues.apache.org/jira/browse/NIFI-14318
Project: Apache NiFi
Issue Type: Bug
Affects Versions: 2.2.0, 1.28.1
Reporter: Paul Kelly
NIFI-11987 added a block size limit of 4MB. Azure Blob Storage has a maximum
number of blocks of 50,000 per blob. Therefore, the largest file that
PutAzureBlobStorage_v12 can currently upload is 4MB * 50,000 = 200GB. The
service supports blocks up to 100MB for a total of 100MB * 50,000 = 5TB per
blob. The block size should be calculated dynamically – or at least be
configurable – to allow uploading files larger than 200GB.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
