I'm trying to build a list of who is running the object store tests against 
branch-2, trunk, anything else

s3a and wasb I know get regularly tested, myself included.

swift:// 's create tests are failing; I've got a fix for that. There's another 
test failure in AbstractContractMkdirTest.testMkdirSlashHandling which has 
probably been failing since HADOOP-14428 went in in June.

and the ADL tests are playing up for me this morning too


[INFO] Running org.apache.hadoop.fs.adl.live.TestAdlContractRenameLive
[ERROR] Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 19.043 
s <<< FAILURE! - in org.apache.hadoop.fs.adl.live.TestAdlContractRenameLive
[ERROR] 
testRenameFileUnderFile(org.apache.hadoop.fs.adl.live.TestAdlContractRenameLive)
  Time elapsed: 1.488 s  <<< ERROR!
org.apache.hadoop.security.AccessControlException: RENAME failed with error 
0x83090c88 (Forbidden. Parent path is not a folder.). 
[ffa78a03-0b41-42e1-9445-be91be804bd8][2017-12-19T07:49:04.5078309-08:00] 
[ServerRequestId:ffa78a03-0b41-42e1-9445-be91be804bd8]
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at 
com.microsoft.azure.datalake.store.ADLStoreClient.getRemoteException(ADLStoreClient.java:1167)
at 
com.microsoft.azure.datalake.store.ADLStoreClient.getExceptionFromResponse(ADLStoreClient.java:1132)
at 
com.microsoft.azure.datalake.store.ADLStoreClient.rename(ADLStoreClient.java:673)
at 
com.microsoft.azure.datalake.store.ADLStoreClient.rename(ADLStoreClient.java:642)
at org.apache.hadoop.fs.adl.AdlFileSystem.rename(AdlFileSystem.java:515)
at 
org.apache.hadoop.fs.contract.AbstractFSContractTestBase.rename(AbstractFSContractTestBase.java:372)
at 
org.apache.hadoop.fs.contract.AbstractContractRenameTest.expectRenameUnderFileFails(AbstractContractRenameTest.java:327)
at 
org.apache.hadoop.fs.contract.AbstractContractRenameTest.testRenameFileUnderFile(AbstractContractRenameTest.java:299)

Looks like ADL is now raising an AccessControlException in certain cirxumstances
. But it does show that ADL needs to move to parallel test runs so that more of 
us will actually run it.

FWIW, I now know enough about AWS's assumed role to be able to set up a Jenkins 
test run where session credentials are generated for the run only and 
restricted to the single bucket & DynamoDB table used for the tests. I might 
see about setting up a little jenkins container locally to do this against 
trunk a few times a day.

But I don't have anything similar for the others, and it's clear that things 
are getting neglected

Reply via email to