lslone commented on issue #2445: shell调度hive脚本,调度界面显示失败但是yarn是执行成功的
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/2445#issuecomment-614573649
 
 
   #!/bin/bash
    
   # 定义变量方便修改
   APP=gmall
   hive=/bin/hive
    
   # 如果是输入的日期按照取输入日期;如果没输入日期取当前时间的前一天
   if [ -n "$1" ] ;then
      do_date=$1
   else 
      do_date=`date -d "-1 day" +%F`  
   fi 
   
   sql="
   set hive.exec.dynamic.partition.mode=nonstrict;
    
   insert overwrite table "$APP".dwd_start_log
   PARTITION (dt='$do_date')
   select 
       get_json_object(data,'$.mid') mid_id,
       get_json_object(data,'$.uid') user_id,
       get_json_object(data,'$.vc') version_code,
       get_json_object(data,'$.vn') version_name,
       get_json_object(data,'$.l') lang,
       get_json_object(data,'$.sr') source,
       get_json_object(data,'$.os') os,
       get_json_object(data,'$.ar') area,
       get_json_object(data,'$.md') model,
       get_json_object(data,'$.ba') brand,
       get_json_object(data,'$.sv') sdk_version,
       get_json_object(data,'$.g') gmail,
       get_json_object(data,'$.hw') height_width,
       get_json_object(data,'$.t') app_time,
       get_json_object(data,'$.nw') network,
       get_json_object(data,'$.ln') lng,
       get_json_object(data,'$.la') lat,
       get_json_object(data,'$.entry') entry,
       get_json_object(data,'$.open_ad_type') open_ad_type,
       get_json_object(data,'$.action') action,
       get_json_object(data,'$.loading_time') loading_time,
       get_json_object(data,'$.detail') detail,
       get_json_object(data,'$.extend1') extend1
   from "$APP".ods_start_log 
   where dt='$do_date';
   "
    
   $hive -e "$sql"

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to