On Sun, Mar 03, 2024 at 08:27:14PM +0900, Andrew Gaul wrote: > On Sun, Mar 03, 2024 at 05:10:29PM +0900, Andrew Gaul wrote: > > This thread is for discussion of the third release candidate for Apache > > jclouds 1.6.3. > > Sorry about the cut and paste -- this should be the first release > candidate of Apache jclouds 2.6.0.
I ran integration tests against a variety of providers. I found an issue with Backblaze B2 that succeeds with 2.5.0 and fails with 2.6.0 that I cannot explain. Given that S3Proxy works with 2.6.0 and B2 I assume that this is a test-only issue and will not block the release. AWS-S3 [ERROR] Failures: [ERROR] org.jclouds.aws.s3.AWSS3ClientLiveTest.AWSS3ClientLiveTest [ERROR] Run 4: AWSS3ClientLiveTest.testV4SignatureOps:147 » HttpResponse Server rejected operation connecting to PUT https://gaul-blobstore20eu.s3.amazonaws.com/test-blob?X-Amz-Security-Token=&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAITMZ4YFWHBLA4KMA/20240308/us-east-1/s3/aws4_request&X-Amz-Date=20240308T100912Z&X-Amz-Expires=900&X-Amz-SignedHeaders=host&X-Amz-Signature=e268055b61a87920c1ac0d55a10b45bf67db1d9deaee2d23c1e6975f9645d819 HTTP/1.1 [ERROR] Run 7: AWSS3ClientLiveTest>S3ClientLiveTest.testCopyCannedAccessPolicyPublic:174 » AWSResponse request PUT https://gaul-blobstore19.s3.amazonaws.com/pears HTTP/1.1 failed with code 400, error: AWSError{requestId='Q245TFG97DHGKSK5', requestToken='9/vRVlLtS/lLDuZ0WwGxf5jCbnVIkGTlRIEepH+gceXHXFYpnSK5JcIKCtCI4ToJdsVK9YHlDQk=', code='AccessControlListNotSupported', message='The bucket does not allow ACLs', context='{HostId=9/vRVlLtS/lLDuZ0WwGxf5jCbnVIkGTlRIEepH+gceXHXFYpnSK5JcIKCtCI4ToJdsVK9YHlDQk=}'} [ERROR] Run 22: AWSS3ClientLiveTest>S3ClientLiveTest.testPublicReadOnObject:301 » AWSResponse request PUT https://gaul-blobstore18.s3.amazonaws.com/public-read-acl HTTP/1.1 failed with code 400, error: AWSError{requestId='WVD74F6PW1JCHATK', requestToken='MBw3qk/pAw4T/mFGUEwO4QEf2Oio5wf+eMu6t2LFK2zFllPgl+e8Mzwv8o64oyqd4khYbjjyNdM=', code='AccessControlListNotSupported', message='The bucket does not allow ACLs', context='{HostId=MBw3qk/pAw4T/mFGUEwO4QEf2Oio5wf+eMu6t2LFK2zFllPgl+e8Mzwv8o64oyqd4khYbjjyNdM=}'} [ERROR] Run 23: AWSS3ClientLiveTest>S3ClientLiveTest.testPublicWriteOnObject:201 » AWSResponse request PUT https://gaul-blobstore19.s3.amazonaws.com/public-read-write-acl HTTP/1.1 failed with code 400, error: AWSError{requestId='VT84J0P44WB2P8WJ', requestToken='Ethy7OW4Zb65hWcOhmQAigV+VmM97t4w1iazfa2UKiP+X63YbcbYtoc+PEOozhpHoA2zgMsJWE8=', code='AccessControlListNotSupported', message='The bucket does not allow ACLs', context='{HostId=Ethy7OW4Zb65hWcOhmQAigV+VmM97t4w1iazfa2UKiP+X63YbcbYtoc+PEOozhpHoA2zgMsJWE8=}'} [ERROR] Run 24: AWSS3ClientLiveTest>S3ClientLiveTest.testPutCannedAccessPolicyPublic:154 » HttpResponse Server rejected operation connecting to PUT https://gaul-blobstore26.s3.amazonaws.com/hello HTTP/1.1 [ERROR] Run 26: AWSS3ClientLiveTest>S3ClientLiveTest.testUpdateBucketCannedACL:718 » Authorization Access Denied [ERROR] Run 27: AWSS3ClientLiveTest>S3ClientLiveTest.testUpdateObjectACL:245 » AWSResponse request PUT https://gaul-blobstore18.s3.amazonaws.com/private-acl?acl HTTP/1.1 failed with code 400, error: AWSError{requestId='0A93WEXJKAB7588G', requestToken='fYTh0JqlHSPcE+JKdGmcKP0ExLmmeaDYv9do/+nWPo7SI5j6/RXh1wzAU1NUB5Z2a5fchzAEXqo=', code='UnresolvableGrantByEmailAddress', message='The e-mail address you provided does not match any account on record.', context='{HostId=fYTh0JqlHSPcE+JKdGmcKP0ExLmmeaDYv9do/+nWPo7SI5j6/RXh1wzAU1NUB5Z2a5fchzAEXqo=, EmailAddress=ja...@misterm.org}'} [ERROR] Run 28: AWSS3ClientLiveTest>S3ClientLiveTest.testUpdateObjectCannedACL:739 » Authorization Access Denied [ERROR] Run 29: AWSS3ClientLiveTest>BaseBlobStoreIntegrationTest.destroyResources:118->BaseBlobStoreIntegrationTest.deleteEverything:210 » RejectedExecution Rejected execution of task [class com.google.common.util.concurrent.TrustedListenableFutureTask] since the executor is shutdown. [ERROR] org.jclouds.aws.s3.blobstore.integration.AWSS3BlobIntegrationLiveTest.AWSS3BlobIntegrationLiveTest [ERROR] Run 33: AWSS3BlobIntegrationLiveTest>BaseBlobIntegrationTest.testPutBlobAccess:770 » HttpResponse Server rejected operation connecting to PUT https://gaul-blobstore18.s3.amazonaws.com/put-access-blob-name-public HTTP/1.1 [ERROR] Run 34: AWSS3BlobIntegrationLiveTest>BaseBlobIntegrationTest.testPutBlobAccessMultipart:792 » AWSResponse request POST https://gaul-blobstore28.s3.amazonaws.com/put-access-blob-name-public?uploads HTTP/1.1 failed with code 400, error: AWSError{requestId='Q096EP8KHFQ2A9PP', requestToken='MJ/XQvC7jjoDp9fattu7jBc46nTQVDZXIA+NlFQvqUjKjEb7hQ2J+ApHJkP0EC5KAGXUnJap/cg6W8YDX6rimRAdkk0zv4AdAp9G1YJoYY8=', code='AccessControlListNotSupported', message='The bucket does not allow ACLs', context='{HostId=MJ/XQvC7jjoDp9fattu7jBc46nTQVDZXIA+NlFQvqUjKjEb7hQ2J+ApHJkP0EC5KAGXUnJap/cg6W8YDX6rimRAdkk0zv4AdAp9G1YJoYY8=}'} [ERROR] Run 49: AWSS3BlobIntegrationLiveTest>BaseBlobIntegrationTest.testPutMultipartInputStream:729->BaseBlobIntegrationTest.testPut:871 » Runtime java.io.EOFException: reached end of stream after skipping 1 bytes; 33554432 bytes expected [ERROR] Run 52: AWSS3BlobIntegrationLiveTest>BaseBlobIntegrationTest.testSetBlobAccess:742 » Authorization Access Denied [ERROR] org.jclouds.aws.s3.blobstore.integration.AWSS3ContainerIntegrationLiveTest.AWSS3ContainerIntegrationLiveTest [ERROR] Run 4: AWSS3ContainerIntegrationLiveTest>BaseContainerIntegrationTest.deleteContainerIfEmptyWithoutContents:538 expected [true] but found [false] [ERROR] Run 24: AWSS3ContainerIntegrationLiveTest>BaseContainerIntegrationTest.testSetContainerAccess:594 » Authorization Access Denied [ERROR] org.jclouds.aws.s3.blobstore.integration.AWSS3ContainerLiveTest.AWSS3ContainerLiveTest [ERROR] Run 1: AWSS3ContainerLiveTest>S3ContainerLiveTest.testPublicAccess:37->BaseContainerLiveTest.testPublicAccess:58 » AWSResponse request PUT https://gaul-blobstore11.s3.amazonaws.com/ HTTP/1.1 failed with code 400, error: AWSError{requestId='6H1HGB3JD7RJMZN6', requestToken='9YnuDu+wlPYhQT+tDBuFRG6SFvALquxN4Z4h4glkQlMdwowp4XH16lL3hU4KUliOn2DpP3CzQHQeioaV7GT2wksfCQwSO8Ps4HC3gTv24nI=', code='InvalidBucketAclWithObjectOwnership', message='Bucket cannot have ACLs set with ObjectOwnership's BucketOwnerEnforced setting', context='{HostId=9YnuDu+wlPYhQT+tDBuFRG6SFvALquxN4Z4h4glkQlMdwowp4XH16lL3hU4KUliOn2DpP3CzQHQeioaV7GT2wksfCQwSO8Ps4HC3gTv24nI=}'} [ERROR] org.jclouds.aws.s3.blobstore.integration.AWSS3ServiceIntegrationLiveTest.AWSS3ServiceIntegrationLiveTest [ERROR] Run 2: AWSS3ServiceIntegrationLiveTest>BaseServiceIntegrationTest.testAllLocations:53->BaseBlobStoreIntegrationTest.assertConsistencyAware:259->BaseBlobStoreIntegrationTest.assertConsistencyAware:246 container {scope=REGION, id=us-east-2, description=us-east-2, parent=aws-s3, iso3166Codes=[US-OH]}/gaul-blobstore13 not found in list marker: null elements: [{location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=gaul-s3ql, type=CONTAINER, userMetadata={}, creationDate=Tue Oct 27 21:48:05 JST 2020}, {location={scope=REGION, id=us-west-2, description=us-west-2, parent=aws-s3, iso3166Codes=[US-OR]}, name=gaultest, type=CONTAINER, userMetadata={}, creationDate=Thu Aug 03 09:41:25 JST 2017}, {location={scope=REGION, id=ap-northeast-1, description=ap-northeast-1, parent=aws-s3, iso3166Codes=[JP-13]}, name=s3fs-integration-test-ap2, type=CONTAINER, userMetadata={}, creationDate=Wed Feb 24 20:55:59 JST 2021}, {location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=gaul-blobstore1, type=CONTAINER, userMetadata={}, creationDate=Fri Mar 08 19:05:54 JST 2024}, {location={scope=REGION, id=us-west-2, description=us-west-2, parent=aws-s3, iso3166Codes=[US-OR]}, name=gaul-eu-west1, type=CONTAINER, userMetadata={}, creationDate=Tue Sep 03 19:35:52 JST 2019}, {location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=gaulyass, type=CONTAINER, userMetadata={}, creationDate=Fri May 19 09:41:32 JST 2017}, {location={scope=REGION, id=us-west-2, description=us-west-2, parent=aws-s3, iso3166Codes=[US-OR]}, name=gaul.with.dots, type=CONTAINER, userMetadata={}, creationDate=Thu Nov 26 20:35:18 JST 2020}, {location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=gaulwww, type=CONTAINER, userMetadata={}, creationDate=Fri Nov 18 11:56:17 JST 2016}, {location={scope=REGION, id=ap-northeast-1, description=ap-northeast-1, parent=aws-s3, iso3166Codes=[JP-13]}, name=s3fs-integration-test-jp, type=CONTAINER, userMetadata={}, creationDate=Sat Sep 26 13:38:45 JST 2020}, {location={scope=REGION, id=eu-west-1, description=eu-west-1, parent=aws-s3, iso3166Codes=[IE]}, name=gaul-eu-west1-2, type=CONTAINER, userMetadata={}, creationDate=Thu Sep 05 04:32:17 JST 2019}, {location={scope=REGION, id=us-west-2, description=us-west-2, parent=aws-s3, iso3166Codes=[US-OR]}, name=zappa-79287bsxw, type=CONTAINER, userMetadata={}, creationDate=Wed Aug 15 06:05:09 JST 2018}, {location={scope=REGION, id=us-west-2, description=us-west-2, parent=aws-s3, iso3166Codes=[US-OR]}, name=zappa-52kjcnl3p, type=CONTAINER, userMetadata={}, creationDate=Mon Aug 10 16:34:03 JST 2020}, {location={scope=REGION, id=ap-northeast-1, description=ap-northeast-1, parent=aws-s3, iso3166Codes=[JP-13]}, name=gaul-tokyo, type=CONTAINER, userMetadata={}, creationDate=Fri Mar 15 16:56:08 JST 2019}, {location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=gaultest2, type=CONTAINER, userMetadata={}, creationDate=Wed Feb 24 21:41:41 JST 2021}, {location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=gaul-lock, type=CONTAINER, userMetadata={}, creationDate=Fri Jul 02 19:38:55 JST 2021}, {name=gaul-blobstore8, type=CONTAINER, userMetadata={}, creationDate=Fri Mar 08 19:06:41 JST 2024}, {location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=gaulbackup, type=CONTAINER, userMetadata={}, creationDate=Sun Jun 19 12:56:55 JST 2011}, {location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=gaul-blobstore12, type=CONTAINER, userMetadata={}, creationDate=Fri Mar 08 19:06:53 JST 2024}, {location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=s3fs-integration-test, type=CONTAINER, userMetadata={}, creationDate=Mon Apr 08 20:53:15 JST 2019}, {location={scope=REGION, id=us-standard, description=us-standard, parent=aws-s3, iso3166Codes=[US]}, name=gaul-east, type=CONTAINER, userMetadata={}, creationDate=Tue Oct 16 08:00:31 JST 2018}, {name=gaul-blobstore13, type=CONTAINER, userMetadata={}, creationDate=Fri Mar 08 19:07:08 JST 2024}] [ERROR] org.jclouds.aws.s3.blobstore.integration.PathBasedContainerLiveTest.PathBasedContainerLiveTest [ERROR] Run 1: PathBasedContainerLiveTest>S3ContainerLiveTest.testPublicAccess:37->BaseContainerLiveTest.testPublicAccess:58 » AWSResponse request PUT https://s3.amazonaws.com/gaul-blobstore5 HTTP/1.1 failed with code 400, error: AWSError{requestId='GDPA88Q0EH06PJJP', requestToken='2xOTbq+c4/1qVULP7nQpf4DVd0FELAF1+ttdjwf/Lu9pes/NUf2sraBfkWZ8JyFvvMj6sh6uwoQ=', code='InvalidBucketAclWithObjectOwnership', message='Bucket cannot have ACLs set with ObjectOwnership's BucketOwnerEnforced setting', context='{HostId=2xOTbq+c4/1qVULP7nQpf4DVd0FELAF1+ttdjwf/Lu9pes/NUf2sraBfkWZ8JyFvvMj6sh6uwoQ=}'} [ERROR] org.jclouds.aws.s3.services.AWSBucketsLiveTest.AWSBucketsLiveTest [ERROR] Run 2: AWSBucketsLiveTest.testEu:56 » AWSResponse request PUT https://gaul-blobstore9eu.s3.amazonaws.com/ HTTP/1.1 failed with code 400, error: AWSError{requestId='JRRKZYTM9N99STB1', requestToken='A9EvYBHk0bhMxXwA7OB8wES/ODAEkU3NyysRqc6lT5WPtrz+xz9Te9Vrb8hmVufb6+OmeqNDSf4=', code='InvalidBucketAclWithObjectOwnership', message='Bucket cannot have ACLs set with ObjectOwnership's BucketOwnerEnforced setting', context='{HostId=A9EvYBHk0bhMxXwA7OB8wES/ODAEkU3NyysRqc6lT5WPtrz+xz9Te9Vrb8hmVufb6+OmeqNDSf4=}'} [ERROR] Run 5: AWSBucketsLiveTest>BucketsLiveTest.testBucketLogging:219->BucketsLiveTest.setupAclForBucketLoggingTarget:266 » AWSResponse request PUT https://gaul-blobstore14.s3.amazonaws.com/?acl HTTP/1.1 failed with code 400, error: AWSError{requestId='H0M2EVMCKXSKB0PN', requestToken='FBEL9KG+t1Xcpv0d8ZC20oa1gs+eGAeQcXPacpTeLZmwAD2T98+5XqJgZex1a6EPatv/yvX8MuA=', code='AccessControlListNotSupported', message='The bucket does not allow ACLs', context='{HostId=FBEL9KG+t1Xcpv0d8ZC20oa1gs+eGAeQcXPacpTeLZmwAD2T98+5XqJgZex1a6EPatv/yvX8MuA=}'} [ERROR] Run 13: AWSBucketsLiveTest>BucketsLiveTest.testPublicReadAccessPolicy:157 » AWSResponse request PUT https://gaul-blobstore24.s3.amazonaws.com/ HTTP/1.1 failed with code 400, error: AWSError{requestId='DVT5S329R7SJ0BG4', requestToken='mb7KjrtDri9DRGt+RGuUp3cP93FHqXe6i0nwT38HDXua237gh7MDTH+u/w/5TFA7hqVmZzPxH5Q=', code='InvalidBucketAclWithObjectOwnership', message='Bucket cannot have ACLs set with ObjectOwnership's BucketOwnerEnforced setting', context='{HostId=mb7KjrtDri9DRGt+RGuUp3cP93FHqXe6i0nwT38HDXua237gh7MDTH+u/w/5TFA7hqVmZzPxH5Q=}'} [ERROR] Run 14: AWSBucketsLiveTest>BucketsLiveTest.testUpdateBucketACL:124 » AWSResponse request PUT https://gaul-blobstore25.s3.amazonaws.com/?acl HTTP/1.1 failed with code 400, error: AWSError{requestId='94X9AMMJPXE2FWFS', requestToken='BhU3/9sAD5BdHklRTWfuhjrHHwZVT5Qd6M7H4J5N8oh2rK2ijvHDPHG7JWrwdU/ElijfY7PctnDVA6axRNEGflVIeT7WK9NSEXlsadiYaNQ=', code='UnresolvableGrantByEmailAddress', message='The e-mail address you provided does not match any account on record.', context='{HostId=BhU3/9sAD5BdHklRTWfuhjrHHwZVT5Qd6M7H4J5N8oh2rK2ijvHDPHG7JWrwdU/ElijfY7PctnDVA6axRNEGflVIeT7WK9NSEXlsadiYaNQ=, EmailAddress=ja...@misterm.org}'} [ERROR] Tests run: 41, Failures: 7, Errors: 0, Skipped: 0 -------------------------------------------------------------------------------- AZUREBLOB [ERROR] Failures: [ERROR] AzureBlobClientLiveTest.testCopyBlobIfModifiedSince:473 » HttpResponse command: PUT https://gaultest3.blob.core.windows.net/gaul-blobstoreunique-15/to-if-modified-since HTTP/1.1 failed with response: HTTP/1.1 304 The condition specified using HTTP conditional header(s) is not met.; content: [] [ERROR] AzureBlobClientLiveTest.testCopyBlobIfNoneMatch:556 » HttpResponse command: PUT https://gaultest3.blob.core.windows.net/gaul-blobstoreunique-15/to-if-none-match HTTP/1.1 failed with response: HTTP/1.1 304 The condition specified using HTTP conditional header(s) is not met.; content: [] [ERROR] AzureBlobContainerIntegrationLiveTest>BaseContainerIntegrationTest.testDelimiter:456 expected: null but was: "2!64!MDAwMDA0IWZpdmUhMDAwMDI4ITk5OTktMTItMzFUMjM6NTk6NTkuOTk5OTk5OVoh" [ERROR] AzureBlobIntegrationLiveTest>BaseBlobIntegrationTest.testCopyIfNoneMatchNegative:1194 expected: 412 but was: 304 [ERROR] AzureBlobIntegrationLiveTest>BaseBlobIntegrationTest.testPutMultipartInputStream:729->BaseBlobIntegrationTest.testPut:871 » Runtime java.io.EOFException: reached end of stream after skipping 4194305 bytes; 67108864 bytes expected [ERROR] Tests run: 140, Failures: 5, Errors: 0, Skipped: 9 -------------------------------------------------------------------------------- BACKBLAZE B2 [ERROR] Failures: [ERROR] B2BlobIntegrationLiveTest>BaseBlobStoreIntegrationTest.setUpResourcesForAllThreads:111->BaseBlobStoreIntegrationTest.createContainersSharedByAllThreads:158->BaseBlobStoreIntegrationTest.deleteEverything:210 » IllegalArgument endpoint.getHost() is null for /b2api/v2/b2_list_buckets [ERROR] Tests run: 151, Failures: 1, Errors: 0, Skipped: 150 -------------------------------------------------------------------------------- FILESYSTEM Test suite progress: tests succeeded: 104, failed: 0, skipped: 7. -------------------------------------------------------------------------------- GOOGLE-CLOUD-STORAGE [ERROR] GoogleCloudStorageBlobIntegrationLiveTest>BaseBlobIntegrationTest.testGetIfMatch:368 » IllegalState PreconditionFailed: At least one of the pre-conditions you specified did not hold. Precondition Failed [ERROR] GoogleCloudStorageBlobIntegrationLiveTest>BaseBlobIntegrationTest.testPutMultipartInputStream:729->BaseBlobIntegrationTest.testPut:871 » Runtime java.io.EOFException: reached end of stream after skipping 1 bytes; 33554432 bytes expected [ERROR] Tests run: 169, Failures: 6, Errors: 0, Skipped: 8 -------------------------------------------------------------------------------- RACKSPACE-CLOUDFILES-US (SWIFT) [ERROR] Failures: [ERROR] org.jclouds.rackspace.cloudfiles.us.blobstore.integration.CloudFilesUSContainerIntegrationLiveTest.CloudFilesUSContainerIntegrationLiveTest [ERROR] Run 11: CloudFilesUSContainerIntegrationLiveTest>BaseContainerIntegrationTest.testDelimiter:456 expected: null but was: "cquux/" [ERROR] org.jclouds.rackspace.cloudfiles.us.features.CloudFilesUSObjectApiLiveTest.CloudFilesUSObjectApiLiveTest [ERROR] Run 5: CloudFilesUSObjectApiLiveTest>ObjectApiLiveTest.testCreateWithSpacesAndSpecialCharacters:88->ObjectApiLiveTest.assertCanCreateReadUpdateDeleteList:75 » ArrayIndexOutOfBounds Index 0 out of bounds for length 0 [ERROR] Tests run: 97, Failures: 2, Errors: 0, Skipped: 1 -- Andrew Gaul http://gaul.org/
