georgew5656 commented on code in PR #15630:
URL: https://github.com/apache/druid/pull/15630#discussion_r1466617764
##########
extensions-core/azure-extensions/src/main/java/org/apache/druid/storage/azure/AzureCloudBlobIterator.java:
##########
@@ -91,8 +96,18 @@ public CloudBlobHolder next()
private void prepareNextRequest()
{
URI currentUri = prefixesIterator.next();
- currentContainer = currentUri.getAuthority();
- currentPrefix = AzureUtils.extractAzureKey(currentUri);
+
+ if (currentUri.getScheme().equals(AzureStorageAccountInputSource.SCHEME)) {
+ CloudObjectLocation cloudObjectLocation = new
CloudObjectLocation(currentUri);
+ Pair<String, String> containerInfo =
AzureStorageAccountInputSource.getContainerAndPathFromObjectLocation(cloudObjectLocation);
Review Comment:
i added a check in the function itself so it doesn't throw a index error on
a bad input spec now. basically what happens now is the task will eventually
fail b/c it fails to read the bad input file which i think is okay (the error
from azure is pretty clear)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
