Abhishek Girish created DRILL-3365:
--------------------------------------
Summary: Query with window function on large dataset fails with
"IOException: Mkdirs failed to create spill directory"
Key: DRILL-3365
URL: https://issues.apache.org/jira/browse/DRILL-3365
Project: Apache Drill
Issue Type: Bug
Components: Execution - Flow
Affects Versions: 1.1.0
Reporter: Abhishek Girish
Assignee: Chris Westin
Priority: Minor
Dataset: TPC-DS SF100 Parquet
Query:
{code:sql}
SELECT sum(ss.ss_net_paid_inc_tax) OVER (PARTITION BY ss.ss_store_sk ORDER BY
ss.ss_customer_sk) AS PartialSum FROM store_sales ss GROUP BY
ss.ss_net_paid_inc_tax, ss.ss_store_sk, ss.ss_customer_sk LIMIT 20;
java.lang.RuntimeException: java.sql.SQLException: SYSTEM ERROR:
java.io.IOException: Mkdirs failed to create
/tmp/drill/spill/2a74ac18-0679-ab99-26c6-af41b9af7f4e/major_fragment_1/minor_fragment_17/operator_4
(exists=false, cwd=file:///opt/mapr/drill/drill-1.1.0/bin)
Fragment 1:17
[Error Id: 4905b400-fc0f-4287-beba-d1ca18359986 on abhi5.qa.lab:31010]
at sqlline.IncrementalRows.hasNext(IncrementalRows.java:73)
at
sqlline.TableOutputFormat$ResizingRowsProvider.next(TableOutputFormat.java:85)
at sqlline.TableOutputFormat.print(TableOutputFormat.java:116)
at sqlline.SqlLine.print(SqlLine.java:1583)
at sqlline.Commands.execute(Commands.java:852)
at sqlline.Commands.sql(Commands.java:751)
at sqlline.SqlLine.dispatch(SqlLine.java:738)
at sqlline.SqlLine.begin(SqlLine.java:612)
at sqlline.SqlLine.start(SqlLine.java:366)
at sqlline.SqlLine.main(SqlLine.java:259)
{code}
Was unable to find corresponding logs. This was consistently seen via JDBC
program and sqlline.
After I restarted Drillbits the issue seems to have been resolved. But wanted
to report this anyway. Possible explanation is DRILL-2917 (one or more
drillbits were in an inconsistent state)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
