Gabor Bota created HADOOP-16027:
-----------------------------------
Summary: [DOC] Effective use of FS instances during S3A
integration tests
Key: HADOOP-16027
URL: https://issues.apache.org/jira/browse/HADOOP-16027
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3
Reporter: Gabor Bota
Assignee: Gabor Bota
While fixing HADOOP-15819 we found that a closed fs got into the static fs
cache during testing, which caused other tests to fail when the tests were
running sequentially.
We should document some best practices in the testing section on the s3 docs
with the following:
{panel}
Tests using FileSystems are fastest if they can recycle the existing FS
instance from the same JVM. If you do that, you MUST NOT close or do unique
configuration on them. If you want a guarantee of 100% isolation or an instance
with unique config, create a new instance
which you MUST close in the teardown to avoid leakage of resources.
Do not add FileSystem instances (with e.g
org.apache.hadoop.fs.FileSystem#addFileSystemForTesting) to the cache that will
be modified or closed during the test runs. This can cause other tests to fail
when using the same modified or closed FS instance. For more details see
HADOOP-15819.
{panel}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
