Juan Yu created HADOOP-11128:
--------------------------------

             Summary: abstracting out the scale tests for FileSystem Contract 
tests
                 Key: HADOOP-11128
                 URL: https://issues.apache.org/jira/browse/HADOOP-11128
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Juan Yu


Currently we have some scale tests for openstack and s3a. For now we'll just 
trust HDFS to handle files >5GB and delete thousands of file in a directory 
properly.
We should abstract out the scale tests so it can be applied to all FileSystems.

A few things to consider for scale tests:
scale tests rely on the tester having good/stable upload bandwidth, might need 
large disk space. It needs to be configurable or optional.
scale tests might need long time to finish, consider have test timeout 
configurable if possible



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to