[
https://issues.apache.org/jira/browse/HIVE-22710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chinna Rao Lalam updated HIVE-22710:
------------------------------------
Description:
When set hive.cbo.enable=true, and execute a SQL contains union all and join to
insert the result into three tables, OOM will appear in the compilation phase.
Attached error logs.
With attached SQL file OOM will come.
Same problem observed in HIVE master branch also.
{noformat}
Caused by: java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:3332) ~[?:1.8.0_201]
at
java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124)
~[?:1.8.0_201]
at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:448)
~[?:1.8.0_201]
at java.lang.StringBuilder.append(StringBuilder.java:136) ~[?:1.8.0_201]
at org.apache.calcite.rex.RexCall.computeDigest(RexCall.java:167)
~[calcite-core-1.19.0.jar:1.19.0]
at org.apache.calcite.rex.RexCall.toString(RexCall.java:183)
~[calcite-core-1.19.0.jar:1.19.0]
at java.lang.String.valueOf(String.java:2994) ~[?:1.8.0_201]
at java.lang.StringBuilder.append(StringBuilder.java:131) ~[?:1.8.0_201]
at org.apache.calcite.rex.RexCall.appendOperands(RexCall.java:109)
~[calcite-core-1.19.0.jar:1.19.0]
at org.apache.calcite.rex.RexCall.computeDigest(RexCall.java:166)
~[calcite-core-1.19.0.jar:1.19.0]
at org.apache.calcite.rex.RexCall.toString(RexCall.java:183)
~[calcite-core-1.19.0.jar:1.19.0]
at
org.apache.hadoop.hive.ql.optimizer.calcite.stats.HiveRelMdPredicates$JoinConditionBasedPredicateInference.<init>(HiveRelMdPredicates.java:349)
~[hive-exec-3.1.0.jar:3.1.0]
at
org.apache.hadoop.hive.ql.optimizer.calcite.stats.HiveRelMdPredicates$JoinConditionBasedPredicateInference.<init>(HiveRelMdPredicates.java:319)
~[hive-exec-3.1.0.jar:3.1.0]
at
org.apache.hadoop.hive.ql.optimizer.calcite.stats.HiveRelMdPredicates.getPredicates(HiveRelMdPredicates.java:183)
~[hive-exec-3.1.0.jar:3.1.0]
{noformat}
was:When set hive.cbo.enable=true, and execute a SQL contains union all and
join to insert the result into three tables. Outofmemoryerror will appear in
the compilation phase. For detailed SQL statements and error logs, please refer
to the attachment. The same problem exists in hive 4.0.0
> OOM Exception when enable CBO
> -----------------------------
>
> Key: HIVE-22710
> URL: https://issues.apache.org/jira/browse/HIVE-22710
> Project: Hive
> Issue Type: Bug
> Affects Versions: 3.1.0, 3.1.2
> Reporter: LuGuangMing
> Priority: Major
> Attachments: error_stack.log, sample.sql
>
>
> When set hive.cbo.enable=true, and execute a SQL contains union all and join
> to insert the result into three tables, OOM will appear in the compilation
> phase. Attached error logs.
> With attached SQL file OOM will come.
> Same problem observed in HIVE master branch also.
> {noformat}
> Caused by: java.lang.OutOfMemoryError: Java heap space
> at java.util.Arrays.copyOf(Arrays.java:3332) ~[?:1.8.0_201]
> at
> java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124)
> ~[?:1.8.0_201]
> at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:448)
> ~[?:1.8.0_201]
> at java.lang.StringBuilder.append(StringBuilder.java:136) ~[?:1.8.0_201]
> at org.apache.calcite.rex.RexCall.computeDigest(RexCall.java:167)
> ~[calcite-core-1.19.0.jar:1.19.0]
> at org.apache.calcite.rex.RexCall.toString(RexCall.java:183)
> ~[calcite-core-1.19.0.jar:1.19.0]
> at java.lang.String.valueOf(String.java:2994) ~[?:1.8.0_201]
> at java.lang.StringBuilder.append(StringBuilder.java:131) ~[?:1.8.0_201]
> at org.apache.calcite.rex.RexCall.appendOperands(RexCall.java:109)
> ~[calcite-core-1.19.0.jar:1.19.0]
> at org.apache.calcite.rex.RexCall.computeDigest(RexCall.java:166)
> ~[calcite-core-1.19.0.jar:1.19.0]
> at org.apache.calcite.rex.RexCall.toString(RexCall.java:183)
> ~[calcite-core-1.19.0.jar:1.19.0]
> at
> org.apache.hadoop.hive.ql.optimizer.calcite.stats.HiveRelMdPredicates$JoinConditionBasedPredicateInference.<init>(HiveRelMdPredicates.java:349)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at
> org.apache.hadoop.hive.ql.optimizer.calcite.stats.HiveRelMdPredicates$JoinConditionBasedPredicateInference.<init>(HiveRelMdPredicates.java:319)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at
> org.apache.hadoop.hive.ql.optimizer.calcite.stats.HiveRelMdPredicates.getPredicates(HiveRelMdPredicates.java:183)
> ~[hive-exec-3.1.0.jar:3.1.0]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
