[
https://issues.apache.org/jira/browse/HADOOP-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105667#comment-15105667
]
Ravi Prakash commented on HADOOP-12696:
---------------------------------------
Also for s3n
{code}
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3n.TestS3NContractRename
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 76.296 sec - in
org.apache.hadoop.fs.contract.s3n.TestS3NContractRename
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3n.TestS3NContractOpen
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.855 sec - in
org.apache.hadoop.fs.contract.s3n.TestS3NContractOpen
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3n.TestS3NContractRootDir
vi Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.537 sec -
in org.apache.hadoop.fs.contract.s3n.TestS3NContractRootDir
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3n.TestS3NContractDelete
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.402 sec - in
org.apache.hadoop.fs.contract.s3n.TestS3NContractDelete
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3n.TestS3NContractCreate
Tests run: 6, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 43.637 sec - in
org.apache.hadoop.fs.contract.s3n.TestS3NContractCreate
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3n.TestS3NContractSeek
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 95.472 sec -
in org.apache.hadoop.fs.contract.s3n.TestS3NContractSeek
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3n.TestS3NContractMkdir
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.469 sec - in
org.apache.hadoop.fs.contract.s3n.TestS3NContractMkdir
Results :
Tests run: 47, Failures: 0, Errors: 0, Skipped: 3
{code}
The skipped tests
{code}
2016-01-15 16:29:49,262 INFO contract.ContractTestUtils
(ContractTestUtils.java:skip(424)) - Skipping: Object store allows a file to
overwrite a directory
2016-01-15 16:29:55,553 INFO contract.ContractTestUtils
(ContractTestUtils.java:skip(424)) - Skipping: Filesystem is an object store
and newly created files are not immediately visible
2016-01-15 16:29:58,982 INFO contract.ContractTestUtils
(ContractTestUtils.java:skip(424)) - Skipping: blobstores can't distinguish
empty directories from files
{code}
For s3a
{code}
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3a.TestS3AContractMkdir
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.099 sec - in
org.apache.hadoop.fs.contract.s3a.TestS3AContractMkdir
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3a.TestS3AContractRootDir
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.163 sec - in
org.apache.hadoop.fs.contract.s3a.TestS3AContractRootDir
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3a.TestS3AContractDelete
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.361 sec - in
org.apache.hadoop.fs.contract.s3a.TestS3AContractDelete
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3a.TestS3AContractRename
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.973 sec - in
org.apache.hadoop.fs.contract.s3a.TestS3AContractRename
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3a.TestS3AContractOpen
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.859 sec - in
org.apache.hadoop.fs.contract.s3a.TestS3AContractOpen
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3a.TestS3AContractSeek
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.267 sec -
in org.apache.hadoop.fs.contract.s3a.TestS3AContractSeek
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.fs.contract.s3a.TestS3AContractCreate
Tests run: 6, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 30.839 sec - in
org.apache.hadoop.fs.contract.s3a.TestS3AContractCreate
Results :
Tests run: 47, Failures: 0, Errors: 0, Skipped: 3
{code}
The skipped tests
{code}
org.apache.hadoop.fs.contract.s3a.TestS3AContractCreate-output.txt:2016-01-18
10:57:59,559 INFO contract.ContractTestUtils
(ContractTestUtils.java:skip(424)) - Skipping: Object store allows a file to
overwrite a directory
org.apache.hadoop.fs.contract.s3a.TestS3AContractCreate-output.txt:2016-01-18
10:58:03,127 INFO contract.ContractTestUtils
(ContractTestUtils.java:skip(424)) - Skipping: Filesystem is an object store
and newly created files are not immediately visible
org.apache.hadoop.fs.contract.s3a.TestS3AContractCreate-output.txt:2016-01-18
10:58:06,419 INFO contract.ContractTestUtils
(ContractTestUtils.java:skip(424)) - Skipping: blobstores can't distinguish
empty directories from files
{code}
> Add Tests for S3FileSystem Contract
> -----------------------------------
>
> Key: HADOOP-12696
> URL: https://issues.apache.org/jira/browse/HADOOP-12696
> Project: Hadoop Common
> Issue Type: Test
> Components: tools
> Affects Versions: 2.7.0
> Reporter: Matthew Paduano
> Assignee: Matthew Paduano
> Labels: S3
> Attachments: HADOOP-12696.01.patch, HADOOP-12696.02.patch, log.fail2,
> log.hdfs, log.patch02, log.s3a, log.s3n, log.succ
>
>
> The regression fixed by HADOOP-12689 had no unit tests to expose the problem.
> Add filesystem tests according to
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/testing.html
> for the s3 scheme.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
