Joe McDonnell created IMPALA-9832:
-------------------------------------
Summary: Runaway disk usage for ASAN test run
Key: IMPALA-9832
URL: https://issues.apache.org/jira/browse/IMPALA-9832
Project: IMPALA
Issue Type: Bug
Components: Backend
Affects Versions: Impala 4.0
Reporter: Joe McDonnell
A recent ASAN run saw hundreds of test failures due to the HDFS NameNode going
into safe mode due to lack of disk space:
{noformat}
2020-06-05 01:03:36,366 WARN
org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker: Space available
on volume '/dev/nvme0n1p1' is 4419584, which is below the configured reserved
amount 104857600
2020-06-05 01:03:36,366 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: NameNode low on available
disk space. Entering safe mode.{noformat}
Metrics about diskspace usage at the time show the device (which had a capacity
of 300GB) getting to 99-100% disk usage. Previous runs on the same
configuration usually stayed in the 35-40% range. The core job with the same
commits also stayed in the 35-40% range.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)