[
https://issues.apache.org/jira/browse/DRILL-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728330#comment-14728330
]
Victoria Markman commented on DRILL-3691:
-----------------------------------------
Hakim,
I think DRILL-3673, DRILL-3684 and DRILL-3691 (this one) are all the same issue
that was fixed with your commit
(git.commit.id=b0e9e7c085a3106a612e400cd1732b6ec6267268)
You can resolve this one as well.
Vicky.
Verified that this case works with:
#Generated by Git-Commit-Id-Plugin
#Tue Sep 01 18:18:19 UTC 2015
git.commit.id.abbrev=b0e9e7c
[email protected]
git.commit.message.full=DRILL-3684\: CTAS \: Memory Leak when using CTAS with
tpch sf100\n\nThis closes \#141\n
git.commit.id=b0e9e7c085a3106a612e400cd1732b6ec6267268
Repro ran on a single node with 8GB direct memory with assertions disabled.
{code}
0: jdbc:drill:schema=dfs> select * from sys.options where status like
'%CHANGED%';
+-----------------------------------+----------+----------+----------+----------+-------------+-----------+------------+
| name | kind | type | status | num_val
| string_val | bool_val | float_val |
+-----------------------------------+----------+----------+----------+----------+-------------+-----------+------------+
| planner.enable_decimal_data_type | BOOLEAN | SYSTEM | CHANGED | null
| null | true | null |
| store.parquet.block-size | LONG | SYSTEM | CHANGED | 204800
| null | null | null |
| store.parquet.block-size | LONG | SESSION | CHANGED | 1030000
| null | null | null |
+-----------------------------------+----------+----------+----------+----------+-------------+-----------+------------+
3 rows selected (0.596 seconds)
n
0: jdbc:drill:schema=dfs> create table lineitem_x as select * from lineitem;
+-----------+----------------------------+
| Fragment | Number of records written |
+-----------+----------------------------+
| 1_15 | 9021944 |
| 1_18 | 19397748 |
| 1_21 | 19372179 |
| 1_22 | 24339845 |
| 1_19 | 24254278 |
| 1_20 | 24477920 |
| 1_16 | 24285361 |
| 1_17 | 24552607 |
| 1_8 | 25169766 |
| 1_12 | 25424111 |
| 1_6 | 25430604 |
| 1_1 | 25485077 |
| 1_5 | 25704889 |
| 1_11 | 28519960 |
| 1_3 | 30363826 |
| 1_2 | 30318160 |
| 1_0 | 30572103 |
| 1_13 | 30425261 |
| 1_9 | 30364369 |
| 1_7 | 30603123 |
| 1_10 | 30379358 |
| 1_4 | 30587344 |
| 1_14 | 30988069 |
+-----------+----------------------------+
23 rows selected (1888.63 seconds)
0: jdbc:drill:schema=dfs> select count(*) from lineitem_x;
+------------+
| EXPR$0 |
+------------+
| 600037902 |
+------------+
1 row selected (231.722 seconds)
0: jdbc:drill:schema=dfs> select count(*) from lineitem;
+------------+
| EXPR$0 |
+------------+
| 600037902 |
+------------+
1 row selected (1.245 seconds)
{code}
> CTAS Memory Leak : IllegalStateException
> ----------------------------------------
>
> Key: DRILL-3691
> URL: https://issues.apache.org/jira/browse/DRILL-3691
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Reporter: Rahul Challapalli
> Assignee: Deneche A. Hakim
> Attachments: error.log
>
>
> git.commit.id.abbrev=55dfd0e
> The below CTAS statement fails with a memory leak. The query runs on top of
> Tpch SF100 data.
> {code}
> create table lineitem as select * from dfs.`/drill/testdata/tpch100/lineitem`;
> java.sql.SQLException: SYSTEM ERROR: IllegalStateException: Failure while
> closing accountor. Expected private and shared pools to be set to initial
> values. However, one or more were not. Stats are
> zone init allocated delta
> private 1000000 1000000 0
> shared 9999000000 9998410176 589824.
> Fragment 1:19
> [Error Id: ba8fedf2-be40-4488-af2e-b6034527c943 on qa-node191.qa.lab:31010]
> Aborting command set because "force" is false and command failed: "create
> table lineitem as select * from dfs.`/drill/testdata/tpch100/lineitem`;"
> {code}
> I attached the log file. I am not uploading the data as it is too large
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
