[jira] [Updated] (HADOOP-12696) Add Tests for S3FileSystem Contract
[ https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HADOOP-12696: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) > Add Tests for S3FileSystem Contract > --- > > Key: HADOOP-12696 > URL: https://issues.apache.org/jira/browse/HADOOP-12696 > Project: Hadoop Common > Issue Type: Test > Components: tools >Affects Versions: 2.7.0 >Reporter: Matthew Paduano >Assignee: Matthew Paduano > Labels: S3 > Fix For: 2.8.0 > > Attachments: HADOOP-12696.01.patch, HADOOP-12696.02.patch, log.fail2, > log.hdfs, log.patch02, log.s3a, log.s3n, log.succ > > > The regression fixed by HADOOP-12689 had no unit tests to expose the problem. > Add filesystem tests according to > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html > for the s3 scheme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12696) Add Tests for S3FileSystem Contract
[ https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Paduano updated HADOOP-12696: - Attachment: log.hdfs log.s3n log.s3a to copy. I dunno. maybe. maybe not. I did see ContractOptions.IS_BLOBSTORE in a few places in the test code when I was reviewing the failures. But it didn't seem like it would have fixed the test issues to me whichever way it pointed. But, it is easy enough to run the tests with various contracts. I removed all the forced skip @overrides from the test code and re-ran the tests with the original s3.xml (== hdfs.xml) and also with s3a.xml and s3n.xml. The same 10 tests still have issues, but the issues are different ;) I attached the output from all three test runs to this email. summary: hdfs Tests run: 47, Failures: 3, Errors: 7, Skipped: 0 s3n Tests run: 47, Failures: 2, Errors: 6, Skipped: 2 s3a Tests run: 47, Failures: 3, Errors: 7, Skipped: 2 the s3n case does seem to account for two of the errors and instead they are "auto skipped". testCreatedFileIsImmediatelyVisible (which is the atomic file option I think) and testOverwriteNonEmptyDirectory (not sure of the option). I am not sure I understand the skip code... it is sort of like a intermediate state between fail and pass... matt > Add Tests for S3FileSystem Contract > --- > > Key: HADOOP-12696 > URL: https://issues.apache.org/jira/browse/HADOOP-12696 > Project: Hadoop Common > Issue Type: Test > Components: tools >Affects Versions: 2.7.0 >Reporter: Matthew Paduano >Assignee: Matthew Paduano > Labels: S3 > Fix For: 2.8.0 > > Attachments: HADOOP-12696.01.patch, log.fail2, log.hdfs, log.s3a, > log.s3n, log.succ > > > The regression fixed by HADOOP-12689 had no unit tests to expose the problem. > Add filesystem tests according to > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html > for the s3 scheme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12696) Add Tests for S3FileSystem Contract
[ https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Paduano updated HADOOP-12696: - Attachment: log.patch02 log.patch02 is the output of running: mvn -l /tmp/log test -Ptests-on -Dtest=org.apache.hadoop.fs.contract.TestS3Contract* > Add Tests for S3FileSystem Contract > --- > > Key: HADOOP-12696 > URL: https://issues.apache.org/jira/browse/HADOOP-12696 > Project: Hadoop Common > Issue Type: Test > Components: tools >Affects Versions: 2.7.0 >Reporter: Matthew Paduano >Assignee: Matthew Paduano > Labels: S3 > Fix For: 2.8.0 > > Attachments: HADOOP-12696.01.patch, HADOOP-12696.02.patch, log.fail2, > log.hdfs, log.patch02, log.s3a, log.s3n, log.succ > > > The regression fixed by HADOOP-12689 had no unit tests to expose the problem. > Add filesystem tests according to > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html > for the s3 scheme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12696) Add Tests for S3FileSystem Contract
[ https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Paduano updated HADOOP-12696: - Attachment: HADOOP-12696.02.patch > Add Tests for S3FileSystem Contract > --- > > Key: HADOOP-12696 > URL: https://issues.apache.org/jira/browse/HADOOP-12696 > Project: Hadoop Common > Issue Type: Test > Components: tools >Affects Versions: 2.7.0 >Reporter: Matthew Paduano >Assignee: Matthew Paduano > Labels: S3 > Fix For: 2.8.0 > > Attachments: HADOOP-12696.01.patch, HADOOP-12696.02.patch, log.fail2, > log.hdfs, log.patch02, log.s3a, log.s3n, log.succ > > > The regression fixed by HADOOP-12689 had no unit tests to expose the problem. > Add filesystem tests according to > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html > for the s3 scheme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12696) Add Tests for S3FileSystem Contract
[ https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Paduano updated HADOOP-12696: - Fix Version/s: 2.8.0 > Add Tests for S3FileSystem Contract > --- > > Key: HADOOP-12696 > URL: https://issues.apache.org/jira/browse/HADOOP-12696 > Project: Hadoop Common > Issue Type: Test > Components: tools >Affects Versions: 2.7.0 >Reporter: Matthew Paduano >Assignee: Matthew Paduano > Labels: S3 > Fix For: 2.8.0 > > > The regression fixed by HADOOP-12689 had no unit tests to expose the problem. > Add filesystem tests according to > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html > for the s3 scheme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12696) Add Tests for S3FileSystem Contract
[ https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Paduano updated HADOOP-12696: - Labels: S3 (was: ) > Add Tests for S3FileSystem Contract > --- > > Key: HADOOP-12696 > URL: https://issues.apache.org/jira/browse/HADOOP-12696 > Project: Hadoop Common > Issue Type: Test > Components: tools >Affects Versions: 2.7.0 >Reporter: Matthew Paduano >Assignee: Matthew Paduano > Labels: S3 > Fix For: 2.8.0 > > > The regression fixed by HADOOP-12689 had no unit tests to expose the problem. > Add filesystem tests according to > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html > for the s3 scheme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12696) Add Tests for S3FileSystem Contract
[ https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Paduano updated HADOOP-12696: - Attachment: log.succ test log against current trunk - 47 tests run, 10 skipped, 37 passed > Add Tests for S3FileSystem Contract > --- > > Key: HADOOP-12696 > URL: https://issues.apache.org/jira/browse/HADOOP-12696 > Project: Hadoop Common > Issue Type: Test > Components: tools >Affects Versions: 2.7.0 >Reporter: Matthew Paduano >Assignee: Matthew Paduano > Labels: S3 > Fix For: 2.8.0 > > Attachments: HADOOP-12696.01.patch, log.fail2, log.succ > > > The regression fixed by HADOOP-12689 had no unit tests to expose the problem. > Add filesystem tests according to > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html > for the s3 scheme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12696) Add Tests for S3FileSystem Contract
[ https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Paduano updated HADOOP-12696: - Status: Patch Available (was: Open) > Add Tests for S3FileSystem Contract > --- > > Key: HADOOP-12696 > URL: https://issues.apache.org/jira/browse/HADOOP-12696 > Project: Hadoop Common > Issue Type: Test > Components: tools >Affects Versions: 2.7.0 >Reporter: Matthew Paduano >Assignee: Matthew Paduano > Labels: S3 > Fix For: 2.8.0 > > Attachments: HADOOP-12696.01.patch, log.fail2, log.succ > > > The regression fixed by HADOOP-12689 had no unit tests to expose the problem. > Add filesystem tests according to > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html > for the s3 scheme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12696) Add Tests for S3FileSystem Contract
[ https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Paduano updated HADOOP-12696: - Attachment: HADOOP-12696.01.patch > Add Tests for S3FileSystem Contract > --- > > Key: HADOOP-12696 > URL: https://issues.apache.org/jira/browse/HADOOP-12696 > Project: Hadoop Common > Issue Type: Test > Components: tools >Affects Versions: 2.7.0 >Reporter: Matthew Paduano >Assignee: Matthew Paduano > Labels: S3 > Fix For: 2.8.0 > > Attachments: HADOOP-12696.01.patch, log.fail2, log.succ > > > The regression fixed by HADOOP-12689 had no unit tests to expose the problem. > Add filesystem tests according to > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html > for the s3 scheme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
