[
https://issues.apache.org/jira/browse/IMPALA-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Sherman updated IMPALA-10743:
------------------------------------
Priority: Critical (was: Major)
> Dataload flakynes "too many dynamic partitions"
> -----------------------------------------------
>
> Key: IMPALA-10743
> URL: https://issues.apache.org/jira/browse/IMPALA-10743
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Reporter: Csaba Ringhofer
> Priority: Critical
>
> The following INSERT failed:
> {code}
> INSERT OVERWRITE TABLE tpcds_seq_snap.s
> tore_sales PARTITION (ss_sold_date_sk)
> . . . . . . . . . . . . . . . . . . . .> SELECT ss_sold_time_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_item_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_customer_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_cdemo_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_hdemo_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_addr_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_store_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_promo_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_ticket_number,
> . . . . . . . . . . . . . . . . . . . .> ss_quantity,
> . . . . . . . . . . . . . . . . . . . .> ss_wholesale_cost,
> . . . . . . . . . . . . . . . . . . . .> ss_list_price,
> . . . . . . . . . . . . . . . . . . . .> ss_sales_price,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_discount_amt,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_sales_price,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_wholesale_cost,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_list_price,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_tax,
> . . . . . . . . . . . . . . . . . . . .> ss_coupon_amt,
> . . . . . . . . . . . . . . . . . . . .> ss_net_paid,
> . . . . . . . . . . . . . . . . . . . .> ss_net_paid_inc_tax,
> . . . . . . . . . . . . . . . . . . . .> ss_net_profit,
> . . . . . . . . . . . . . . . . . . . .> ss_sold_date_sk
> . . . . . . . . . . . . . . . . . . . .> FROM tpcds.store_sales
> . . . . . . . . . . . . . . . . . . . .> WHERE ss_sold_date_sk < 2451272;
> {code}
> with error
> {code}
> ERROR : Vertex failed, vertexName=Map 1,
> vertexId=vertex_1623135064866_0012_19_00, diagnostics=[Task failed,
> taskId=task_1623135064866_0012_19_00_000001, diagnostics=[TaskAttempt 0
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1623135064866_0012_19_00_000001_0:java.lang.RuntimeException:
> java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveFatalException: [Error 20004]: Fatal
> error occurred when node tried to create too many dynamic partitions. The
> maximum number of dynamic partitions is controlled by
> hive.exec.max.dynamic.partitions and
> hive.exec.max.dynamic.partitions.pernode. Maximum was set to 100 partitions
> per node, number of dynamic partitions on this node: 101
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
