Paul Rogers created DRILL-5012:
----------------------------------
Summary: External Sort Batch does not check free space before
writing
Key: DRILL-5012
URL: https://issues.apache.org/jira/browse/DRILL-5012
Project: Apache Drill
Issue Type: Bug
Affects Versions: 1.8.0
Reporter: Paul Rogers
Priority: Minor
The ExternalSortBatch operator sorts data and spills to disk to control memory
usage. The ESB accepts a configured set of output directories.
The ESB does not check if sufficient space is available in a directory before
writing to it; ESB requires that the admin ensure space is available.
Desired fix: skip a directory if it does not contain space to hold the target
spill file. (That is, write to the other directories if that have space.)
The fix is not fail-safe: two threads may both check and both write. However,
the fix reduces the chances of an out-of-disk error for the most obvious cases.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
