[
https://issues.apache.org/jira/browse/HIVE-26833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Taraka Rama Rao Lethavadla updated HIVE-26833:
----------------------------------------------
Description:
We see below error message as part of insert query where Dynamic Partition is
expected to happen
{noformat}
Caused by: org.apache.hadoop.hive.ql.metadata.HiveFatalException: [Error
20004]: Fatal error occurred when node tried to create too many dynamic
partitions. The maximum number of dynamic partitions is controlled by
hive.exec.max.dynamic.partitions and hive.exec.max.dynamic.partitions.pernode.
Maximum was set to 2000 partitions per node, number of dynamic partitions on
this node: 2001{noformat}
As part of this jira, planning to add another workaround like splitting the
query into multiple queries based on a filter condition to the above error
message
was:
We see below error message as part of insert query where Dynamic Partition is
expected to happen
{noformat}
Caused by: org.apache.hadoop.hive.ql.metadata.HiveFatalException: [Error
20004]: Fatal error occurred when node tried to create too many dynamic
partitions. The maximum number of dynamic partitions is controlled by
hive.exec.max.dynamic.partitions and hive.exec.max.dynamic.partitions.pernode.
Maximum was set to 2000 partitions per node, number of dynamic partitions on
this node: 2001{noformat}
As part of this jira, planning to add another workaround like splitting the
query into multiple queries based on a filter condition
> Update error message related to dynamic partitioning with workaround
> --------------------------------------------------------------------
>
> Key: HIVE-26833
> URL: https://issues.apache.org/jira/browse/HIVE-26833
> Project: Hive
> Issue Type: Improvement
> Reporter: Taraka Rama Rao Lethavadla
> Assignee: Taraka Rama Rao Lethavadla
> Priority: Minor
>
> We see below error message as part of insert query where Dynamic Partition is
> expected to happen
> {noformat}
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveFatalException: [Error
> 20004]: Fatal error occurred when node tried to create too many dynamic
> partitions. The maximum number of dynamic partitions is controlled by
> hive.exec.max.dynamic.partitions and
> hive.exec.max.dynamic.partitions.pernode. Maximum was set to 2000 partitions
> per node, number of dynamic partitions on this node: 2001{noformat}
> As part of this jira, planning to add another workaround like splitting the
> query into multiple queries based on a filter condition to the above error
> message
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
