lslone commented on issue #2445: shell调度hive脚本,调度界面显示失败但是yarn是执行成功的
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/2445#issuecomment-614574036
 
 
   #!/bin/bash
    
   APP=gmall
   hive=/bin/hive
    
   if [ -n "$1" ] ;then
      do_date=$1
   else 
      do_date=`date -d "-1 day" +%F`  
   fi 
   
   sql="
   set hive.exec.dynamic.partition.mode=nonstrict;
    
   insert overwrite table "$APP".dwd_start_log
   PARTITION (dt='$do_date')
   select 
       get_json_object(data,'$.mid') mid_id,
       get_json_object(data,'$.uid') user_id,
       get_json_object(data,'$.vc') version_code,
       get_json_object(data,'$.vn') version_name,
       get_json_object(data,'$.l') lang,
       get_json_object(data,'$.sr') source,
       get_json_object(data,'$.os') os,
       get_json_object(data,'$.ar') area,
       get_json_object(data,'$.md') model,
       get_json_object(data,'$.ba') brand,
       get_json_object(data,'$.sv') sdk_version,
       get_json_object(data,'$.g') gmail,
       get_json_object(data,'$.hw') height_width,
       get_json_object(data,'$.t') app_time,
       get_json_object(data,'$.nw') network,
       get_json_object(data,'$.ln') lng,
       get_json_object(data,'$.la') lat,
       get_json_object(data,'$.entry') entry,
       get_json_object(data,'$.open_ad_type') open_ad_type,
       get_json_object(data,'$.action') action,
       get_json_object(data,'$.loading_time') loading_time,
       get_json_object(data,'$.detail') detail,
       get_json_object(data,'$.extend1') extend1
   from "$APP".ods_start_log 
   where dt='$do_date';
   "
    
   $hive -e "$sql"

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to