kou commented on PR #40567:
URL: https://github.com/apache/arrow/pull/40567#issuecomment-2024448174
The generic filesystem tests are passed with Azurite but failed with
hierarchical name space enabled Azure account:
```text
[==========] Running 26 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 26 tests from TestAzureHierarchicalNSGeneric
[ RUN ] TestAzureHierarchicalNSGeneric.Empty
[ OK ] TestAzureHierarchicalNSGeneric.Empty (227 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.NormalizePath
[ OK ] TestAzureHierarchicalNSGeneric.NormalizePath (38 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.CreateDir
[ OK ] TestAzureHierarchicalNSGeneric.CreateDir (1657 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.DeleteDir
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/test_util.cc:277:
Failure
Failed
Expected 'fs->DeleteDir("AB/def")' to fail with IOError, but got OK
[ FAILED ] TestAzureHierarchicalNSGeneric.DeleteDir (1434 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.DeleteDirContents
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/test_util.cc:306:
Failure
Failed
Expected 'fs->DeleteDirContents("abc")' to fail with IOError, but got OK
[ FAILED ] TestAzureHierarchicalNSGeneric.DeleteDirContents (1535 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.DeleteRootDirContents
[ OK ] TestAzureHierarchicalNSGeneric.DeleteRootDirContents (574 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.DeleteFile
[ OK ] TestAzureHierarchicalNSGeneric.DeleteFile (977 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.DeleteFiles
[ OK ] TestAzureHierarchicalNSGeneric.DeleteFiles (1240 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.MoveFile
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/azurefs.cc:1371:
LeaseGuard::WaitUntilLatestKnownExpiryTime for 2794ms...
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/azurefs.cc:1371:
LeaseGuard::WaitUntilLatestKnownExpiryTime for 2790ms...
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/azurefs.cc:1371:
LeaseGuard::WaitUntilLatestKnownExpiryTime for 2774ms...
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/azurefs.cc:1371:
LeaseGuard::WaitUntilLatestKnownExpiryTime for 2618ms...
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/azurefs.cc:1371:
LeaseGuard::WaitUntilLatestKnownExpiryTime for 2734ms...
[ OK ] TestAzureHierarchicalNSGeneric.MoveFile (17419 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.MoveDir
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/test_util.cc:463:
Skipped
Filesystem doesn't allow moving directories
[ SKIPPED ] TestAzureHierarchicalNSGeneric.MoveDir (50 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.CopyFile
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/test_util.cc:531:
Failure
Failed
'fs->CopyFile("AB/abc", "def")' failed with IOError: Failed to copy a blob.
(https://XXX.blob.core.windows.net/a2giu5a9ij1szn7tsx4l0z6194h5zqww/AB/abc ->
https://clearcodearrow.blob.core.windows.net/a2giu5a9ij1szn7tsx4l0z6194h5zqww/def)
Azure Error: [CannotVerifyCopySource] 401 Server failed to authenticate the
request. Please refer to the information in the www-authenticate header.
Server failed to authenticate the request. Please refer to the information
in the www-authenticate header.
RequestId:2c08ee06-f01e-0062-12d2-807ca0000000
Time:2024-03-28T05:40:28.1650700Z
Request ID: 2c08ee06-f01e-0062-12d2-807ca0000000
[ FAILED ] TestAzureHierarchicalNSGeneric.CopyFile (1007 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.GetFileInfo
[ OK ] TestAzureHierarchicalNSGeneric.GetFileInfo (800 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.GetFileInfoVector
[ OK ] TestAzureHierarchicalNSGeneric.GetFileInfoVector (686 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.GetFileInfoSelector
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/test_util.cc:149:
Failure
Expected equality of these values:
info.mtime()
Which is: 8-byte object <00-8C 22-1E 29-D7 C0-17>
mtime
Which is: 8-byte object <FF-FF FF-FF FF-FF FF-FF>
For path 'AB'
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/test_util.cc:753:
Failure
Failed
Expected 'fs->GetFileInfo(s)' to fail with IOError, but got OK
[ FAILED ] TestAzureHierarchicalNSGeneric.GetFileInfoSelector (860 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.GetFileInfoSelectorWithRecursion
[ OK ] TestAzureHierarchicalNSGeneric.GetFileInfoSelectorWithRecursion
(1626 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.GetFileInfoAsync
[ OK ] TestAzureHierarchicalNSGeneric.GetFileInfoAsync (683 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.GetFileInfoGenerator
[ OK ] TestAzureHierarchicalNSGeneric.GetFileInfoGenerator (771 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.OpenOutputStream
[ OK ] TestAzureHierarchicalNSGeneric.OpenOutputStream (779 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.OpenAppendStream
[ OK ] TestAzureHierarchicalNSGeneric.OpenAppendStream (496 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.OpenInputStream
[ OK ] TestAzureHierarchicalNSGeneric.OpenInputStream (543 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.OpenInputStreamWithFileInfo
[ OK ] TestAzureHierarchicalNSGeneric.OpenInputStreamWithFileInfo (543
ms)
[ RUN ] TestAzureHierarchicalNSGeneric.OpenInputStreamAsync
[ OK ] TestAzureHierarchicalNSGeneric.OpenInputStreamAsync (419 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.OpenInputFile
[ OK ] TestAzureHierarchicalNSGeneric.OpenInputFile (509 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.OpenInputFileWithFileInfo
[ OK ] TestAzureHierarchicalNSGeneric.OpenInputFileWithFileInfo (549
ms)
[ RUN ] TestAzureHierarchicalNSGeneric.OpenInputFileAsync
[ OK ] TestAzureHierarchicalNSGeneric.OpenInputFileAsync (394 ms)
[ RUN ] TestAzureHierarchicalNSGeneric.SpecialChars
/home/kou/work/cpp/arrow.kou/cpp/src/arrow/filesystem/test_util.cc:1178:
Failure
Failed
'fs->CopyFile("Blank Char/Special%Char.txt", "Special and%different.txt")'
failed with IOError: Failed to copy a blob.
(https://XXX.blob.core.windows.net/armiaz82i30wliew7324v0l421a4uhop/Blank%20Char/Special%25Char.txt
->
https://XXX.blob.core.windows.net/armiaz82i30wliew7324v0l421a4uhop/Special%20and%25different.txt)
Azure Error: [CannotVerifyCopySource] 401 Server failed to authenticate the
request. Please refer to the information in the www-authenticate header.
Server failed to authenticate the request. Please refer to the information
in the www-authenticate header.
RequestId:dbfb99e1-801e-008c-4ad2-80d689000000
Time:2024-03-28T05:40:38.3406267Z
Request ID: dbfb99e1-801e-008c-4ad2-80d689000000
[ FAILED ] TestAzureHierarchicalNSGeneric.SpecialChars (475 ms)
[----------] 26 tests from TestAzureHierarchicalNSGeneric (36306 ms total)
[----------] Global test environment tear-down
[==========] 26 tests from 1 test suite ran. (36306 ms total)
[ PASSED ] 20 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] TestAzureHierarchicalNSGeneric.MoveDir
[ FAILED ] 5 tests, listed below:
[ FAILED ] TestAzureHierarchicalNSGeneric.DeleteDir
[ FAILED ] TestAzureHierarchicalNSGeneric.DeleteDirContents
[ FAILED ] TestAzureHierarchicalNSGeneric.CopyFile
[ FAILED ] TestAzureHierarchicalNSGeneric.GetFileInfoSelector
[ FAILED ] TestAzureHierarchicalNSGeneric.SpecialChars
5 FAILED TESTS
```
Can we work on this as a separated task?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
