[
https://issues.apache.org/jira/browse/DRILL-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Paul Rogers updated DRILL-5012:
-------------------------------
Summary: External Sort Batch does not check free disk space before writing
(was: External Sort Batch does not check free space before writing)
> External Sort Batch does not check free disk space before writing
> -----------------------------------------------------------------
>
> Key: DRILL-5012
> URL: https://issues.apache.org/jira/browse/DRILL-5012
> Project: Apache Drill
> Issue Type: Bug
> Affects Versions: 1.8.0
> Reporter: Paul Rogers
> Priority: Minor
>
> The ExternalSortBatch operator sorts data and spills to disk to control
> memory usage. The ESB accepts a configured set of output directories.
> The ESB does not check if sufficient space is available in a directory before
> writing to it; ESB requires that the admin ensure space is available.
> Desired fix: skip a directory if it does not contain space to hold the target
> spill file. (That is, write to the other directories if that have space.)
> The fix is not fail-safe: two threads may both check and both write. However,
> the fix reduces the chances of an out-of-disk error for the most obvious
> cases.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)