[GitHub] [incubator-dolphinscheduler] zosimer opened a new issue #3855: dolphinscheduler 连接spark-thriftserver执行sql时，动态分区没有成功，不提示任何错误，任务瞬间执行完成

Tue, 29 Sep 2020 03:24:40 -0700 


zosimer opened a new issue #3855:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3855


   以下是sql语句：
   set hive.exec.dynamic.partition=true;
   set hive.exec.dynamic.partition.mode=nonstrict;
   set hive.exec.max.dynamic.partitions.pernode=600000;
   set hive.exec.max.dynamic.partitions=6000000;
   set hive.exec.max.created.files=6000000;
   INSERT overwrite TABLE ods.ods_app_report_vo PARTITION(month,day) as
   select  a.*,substr(a.`date`,1,7) as month,substr(a.`date`,1,10) as day from 
ods.ods_app_report_vo_np as a    where substr(a.`date`,1,10) = '2020-09-28'
   
   下面是日志：
   [INFO] 2020-09-29 18:13:13.171  - [taskAppId=TASK-9-26-189]:[176] - SQL 
title : 测试动态分区
   [INFO] 2020-09-29 18:13:13.172  - [taskAppId=TASK-9-26-189]:[499] - after 
replace sql , preparing : set hive.exec.dynamic.partition=true;
   set hive.exec.dynamic.partition.mode=nonstrict;
   set hive.exec.max.dynamic.partitions.pernode=600000;
   set hive.exec.max.dynamic.partitions=6000000;
   set hive.exec.max.created.files=6000000;
   INSERT overwrite TABLE ods.ods_app_report_vo PARTITION(month,day) as
   select  a.*,substr(a.`date`,1,7) as month,substr(a.`date`,1,10) as day from 
ods.ods_app_report_vo_np as a    where substr(a.`date`,1,10) = '2020-09-28'
   
   
   [INFO] 2020-09-29 18:13:13.172  - [taskAppId=TASK-9-26-189]:[504] - Sql 
Params are replaced sql , parameters:
   [INFO] 2020-09-29 18:13:13.172  - [taskAppId=TASK-9-26-189]:[52] - can't 
find udf function resource
   [INFO] 2020-09-29 18:13:13.236  - [taskAppId=TASK-9-26-189]:[418] - prepare 
statement replace sql : org.apache.hive.jdbc.HivePreparedStatement@30cc6d1e 
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to