[
https://issues.apache.org/jira/browse/DRILL-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901478#comment-14901478
]
Rahul Challapalli commented on DRILL-1162:
------------------------------------------
git.commit.id.abbrev=3c89b30
On the current master, surprisingly the same query resulted in an OOM error on
a 11 node drill cluster
{code}
0: jdbc:drill:zk=x.x.x.x:5181> select count(*) from `lineitem1.parquet` a
. . . . . . . . . . . . . . . . . > inner join `part.parquet` j on a.l_partkey
= j.p_partkey
. . . . . . . . . . . . . . . . . > inner join `orders.parquet` k on
a.l_orderkey = k.o_orderkey
. . . . . . . . . . . . . . . . . > inner join `supplier.parquet` l on
a.l_suppkey = l.s_suppkey
. . . . . . . . . . . . . . . . . > inner join `partsupp.parquet` m on
j.p_partkey = m.ps_partkey and l.s_suppkey = m.ps_suppkey
. . . . . . . . . . . . . . . . . > inner join `customer.parquet` n on
k.o_custkey = n.c_custkey
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` b on
a.l_orderkey = b.l_orderkey
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` c on
a.l_partkey = c.l_partkey
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` d on
a.l_suppkey = d.l_suppkey
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` e on
a.l_extendedprice = e.l_extendedprice
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` f on
a.l_comment = f.l_comment
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` g on
a.l_shipdate = g.l_shipdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` h on
a.l_commitdate = h.l_commitdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` i on
a.l_receiptdate = i.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` o on
a.l_receiptdate = o.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` p on
a.l_receiptdate = p.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` q on
a.l_receiptdate = q.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` r on
a.l_receiptdate = r.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` s on
a.l_receiptdate = s.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` t on
a.l_receiptdate = t.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` u on
a.l_receiptdate = u.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` v on
a.l_receiptdate = v.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` w on
a.l_receiptdate = w.l_receiptdate
. . . . . . . . . . . . . . . . . > inner join `lineitem2.parquet` x on
a.l_receiptdate = x.l_receiptdate;
java.lang.RuntimeException: java.sql.SQLException: RESOURCE ERROR: One or more
nodes ran out of memory while executing the query.
Fragment 0:0
[Error Id: 49e1b35d-a8a5-4243-a77d-058c2af81196 on pssc-69.qa.lab:31010]
at sqlline.IncrementalRows.hasNext(IncrementalRows.java:73)
at
sqlline.TableOutputFormat$ResizingRowsProvider.next(TableOutputFormat.java:87)
at sqlline.TableOutputFormat.print(TableOutputFormat.java:118)
at sqlline.SqlLine.print(SqlLine.java:1583)
at sqlline.Commands.execute(Commands.java:852)
at sqlline.Commands.sql(Commands.java:751)
at sqlline.SqlLine.dispatch(SqlLine.java:738)
at sqlline.SqlLine.begin(SqlLine.java:612)
at sqlline.SqlLine.start(SqlLine.java:366)
at sqlline.SqlLine.main(SqlLine.java:259)
{code}
OOM did not happen in the past on a 4 node cluster. This should still be
investigated. The data used is TPCH SF 0.01 data.
> 25 way join ended up in 0 results which is not expected
> -------------------------------------------------------
>
> Key: DRILL-1162
> URL: https://issues.apache.org/jira/browse/DRILL-1162
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow, Query Planning & Optimization
> Reporter: Rahul Challapalli
> Assignee: Rahul Challapalli
> Priority: Critical
> Fix For: 1.2.0
>
> Attachments: error.log
>
>
> git.commit.id.abbrev=e5c2da0
> The below query results in 0 results being returned
> select count(*) from `lineitem1.parquet` a
> inner join `part.parquet` j on a.l_partkey = j.p_partkey
> inner join `orders.parquet` k on a.l_orderkey = k.o_orderkey
> inner join `supplier.parquet` l on a.l_suppkey = l.s_suppkey
> inner join `partsupp.parquet` m on j.p_partkey = m.ps_partkey and l.s_suppkey
> = m.ps_suppkey
> inner join `customer.parquet` n on k.o_custkey = n.c_custkey
> inner join `lineitem2.parquet` b on a.l_orderkey = b.l_orderkey
> inner join `lineitem2.parquet` c on a.l_partkey = c.l_partkey
> inner join `lineitem2.parquet` d on a.l_suppkey = d.l_suppkey
> inner join `lineitem2.parquet` e on a.l_extendedprice = e.l_extendedprice
> inner join `lineitem2.parquet` f on a.l_comment = f.l_comment
> inner join `lineitem2.parquet` g on a.l_shipdate = g.l_shipdate
> inner join `lineitem2.parquet` h on a.l_commitdate = h.l_commitdate
> inner join `lineitem2.parquet` i on a.l_receiptdate = i.l_receiptdate
> inner join `lineitem2.parquet` o on a.l_receiptdate = o.l_receiptdate
> inner join `lineitem2.parquet` p on a.l_receiptdate = p.l_receiptdate
> inner join `lineitem2.parquet` q on a.l_receiptdate = q.l_receiptdate
> inner join `lineitem2.parquet` r on a.l_receiptdate = r.l_receiptdate
> inner join `lineitem2.parquet` s on a.l_receiptdate = s.l_receiptdate
> inner join `lineitem2.parquet` t on a.l_receiptdate = t.l_receiptdate
> inner join `lineitem2.parquet` u on a.l_receiptdate = u.l_receiptdate
> inner join `lineitem2.parquet` v on a.l_receiptdate = v.l_receiptdate
> inner join `lineitem2.parquet` w on a.l_receiptdate = w.l_receiptdate
> inner join `lineitem2.parquet` x on a.l_receiptdate = x.l_receiptdate;
> However when we remove the last 'inner join' and run the query it returns
> '716372534'. Since the last inner join is similar to the one's before it, it
> should match some records and return the data appropriately.
> The logs indicated that it actually returned 0 results. Attached the log file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
