Juan Yu created HADOOP-11128: -------------------------------- Summary: abstracting out the scale tests for FileSystem Contract tests Key: HADOOP-11128 URL: https://issues.apache.org/jira/browse/HADOOP-11128 Project: Hadoop Common Issue Type: Improvement Reporter: Juan Yu
Currently we have some scale tests for openstack and s3a. For now we'll just trust HDFS to handle files >5GB and delete thousands of file in a directory properly. We should abstract out the scale tests so it can be applied to all FileSystems. A few things to consider for scale tests: scale tests rely on the tester having good/stable upload bandwidth, might need large disk space. It needs to be configurable or optional. scale tests might need long time to finish, consider have test timeout configurable if possible -- This message was sent by Atlassian JIRA (v6.3.4#6332)