[
https://issues.apache.org/jira/browse/DRILL-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Paul Rogers resolved DRILL-5163.
--------------------------------
Resolution: Fixed
Fix Version/s: 1.11.0
Fixed as part of DRILL-5325
> External sort on Mac creates a separate child process per spill via HDFS FS
> ---------------------------------------------------------------------------
>
> Key: DRILL-5163
> URL: https://issues.apache.org/jira/browse/DRILL-5163
> Project: Apache Drill
> Issue Type: Improvement
> Affects Versions: 1.8.0
> Reporter: Paul Rogers
> Assignee: Paul Rogers
> Priority: Minor
> Fix For: 1.11.0
>
>
> The external sort operator spills to disk. Spill files are created and
> written using the HDFS file system. For performance, HDFS uses native
> libraries to access the file system. These native libraries are not available
> on the Mac. As a result, some operations are implemented using a shower,
> Java-only path. One of these operations (need details) is implemented by
> forking a child process.
> When run in a debugger on the Mac, the behavior shows up as the furious
> creation and deletion of threads to manage the child processes: one per
> spill. Because of this behavior, performance of external sort is slow. Of
> course, no production code uses Drill on a Mac, so this is more of a nuisance
> than a real bug, which is why it is marked as an improvement.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
