[
https://issues.apache.org/jira/browse/DRILL-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boaz Ben-Zvi closed DRILL-4542.
-------------------------------
Resolution: Duplicate
Fix Version/s: 1.9.0
Exactly the same as DRILL-3898
> if external sort fails to spill to disk, memory is leaked and wrong error
> message is displayed
> ----------------------------------------------------------------------------------------------
>
> Key: DRILL-4542
> URL: https://issues.apache.org/jira/browse/DRILL-4542
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Relational Operators
> Affects Versions: 1.6.0
> Environment: When external sort fails spilling to disk, for example
> because there is no space left on disk, the query fails with an error like
> this:
> {noformat}
> SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory
> leaked: (376832)
> Allocator(op:1:0:6:ExternalSort) 20000000/376832/408432256/429496729
> (res/actual/peak/limit)
> {noformat}
> 2 problems here:
> 1. we are leaking memory
> 2. the "real" problem is not shown in the error message
> Looking at the logs we can find the real issue, generally right after the
> previous error (edited for the sake of clarity):
> {noformat}
> 2016-03-26 02:22:28,576 [drill-executor-119] ERROR
> o.a.d.exec.server.BootStrapContext -
> org.apache.drill.exec.work.WorkManager$WorkerBee$2.run() leaked an exception.
> org.apache.hadoop.fs.FSError: java.io.IOException: No space left on device
> at
> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.write(RawLocalFileSystem.java:249)
> ~[hadoop-common-2.7.0-mapr-1602.jar:na]
> [...]
> at
> org.apache.drill.exec.cache.VectorAccessibleSerializable.writeToStream(VectorAccessibleSerializable.java:172)
> ~[drill-java-exec-1.7.0-SNAPSHOT.jar:1.7.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.xsort.BatchGroup.addBatch(BatchGroup.java:96)
> ~[drill-java-exec-1.7.0-SNAPSHOT.jar:1.7.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.mergeAndSpill(ExternalSortBatch.java:562)
> ~[drill-java-exec-1.7.0-SNAPSHOT.jar:1.7.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.innerNext(ExternalSortBatch.java:394)
> ~[drill-java-exec-1.7.0-SNAPSHOT.jar:1.7.0-SNAPSHOT]
> [...]
> {noformat}
> Reporter: Deneche A. Hakim
> Assignee: Boaz Ben-Zvi
> Fix For: 1.9.0
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
