Joe McDonnell created IMPALA-14634:
--------------------------------------
Summary: Organize log files for custom cluster tests into
subdirectories by test class / method
Key: IMPALA-14634
URL: https://issues.apache.org/jira/browse/IMPALA-14634
Project: IMPALA
Issue Type: Task
Components: Infrastructure
Affects Versions: Impala 5.0.0
Reporter: Joe McDonnell
Custom cluster tests put all impala log files in logs/custom_cluster_test. When
running many of the tests, it can be hard to tell which log files (and
minidumps, etc) belong to each test. If we used separate log directories for
each test, then it would be clear. For example, logs for
TestFooClass.test_method() could go to
logs/custom_cluster_test/TestFooClass/test_method/.
The downside of this is that all the logic that limits the space usage of log
files doesn't apply. Broadly, we want to hold on to those files anyway, so we
set IMPALA_MAX_LOG_FILES=0. Even so, this will hold onto more, so we should
double-check disk space usage.
Separately, when running custom cluster tests in a development environment
using impala-py.test, the logs usually go to /tmp. It would be better to detect
IMPALA_CUSTOM_CLUSTER_TEST_LOGS_DIR and put them there.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
