Steve Vaughan created HDFS-16740:
------------------------------------
Summary: Mini cluster test flakiness
Key: HDFS-16740
URL: https://issues.apache.org/jira/browse/HDFS-16740
Project: Hadoop HDFS
Issue Type: Improvement
Components: hdfs, test
Affects Versions: 3.4.0, 3.3.9
Reporter: Steve Vaughan
Assignee: Steve Vaughan
Mini clusters used during HDFS unit tests are reporting test failures that do
not appear to be directly related to submitted changes. The failures are the
result of either interactions between tests run in parallel, or tests which
share common disk space for tests. In all cases, the tests can be run
individually serially without any errors. Addressing this issue will simplify
future submissions by eliminating the confusion introduced by these unrelated
test failures.
We can apply lessons recently from TestRollingUpgrade, which was recently
patched to unblock a recent submission. The fixes involved changing the HDFS
configuration to use temporary disk space for each individual tests, and using
try-with-resources to ensure that clusters were shutdown cleanly.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
