Tom-Newton commented on code in PR #45021:
URL: https://github.com/apache/arrow/pull/45021#discussion_r1885667543
##########
cpp/src/arrow/filesystem/azurefs.cc:
##########
@@ -3186,9 +3180,19 @@ class AzureFileSystem::Impl {
}
}
try {
- dest_blob_client.CopyFromUri(src_url);
+ // We use StartCopyFromUri instead of CopyFromUri because it supports
blobs larger
+ // than 256 MiB and it doesn't require generating a SAS token to
authenticate
+ // reading a source blob in the same storage account.
+ auto copy_operation = dest_blob_client.StartCopyFromUri(src_url);
Review Comment:
I was quite shocked to find the 256MiB limit, to the point where I initially
assumed the documentation was out of date, but I tried it and it really did
return an error. I guess its a policy to avoid a single slow API call.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
