lyn916 opened a new issue #5672:
URL: https://github.com/apache/dolphinscheduler/issues/5672
**Which version of DolphinScheduler:**
-[1.3.6]
**Additional context**
org.apache.hadoop.hive.ql.exec.DDLTask. No such file or directory
**Requirement or improvement**
- when i use shell merge the hive orc partitions, FAILED: Execution Error,
return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. No such file or
directory
```
2021-06-22 01:00:00.858 INFO - [taskAppId=TASK-10-168-172]:[160] - raw
script : #!/bin/bash
source /etc/profile
date=`date -d "-2 days" +%Y%m%d`
hive -e "
ALTER TABLE monitor_data_1 PARTITION(level='0',day='${date}') CONCATENATE;
ALTER TABLE monitor_data_1 PARTITION(level='1',day='${date}') CONCATENATE;
"
2021-06-22 01:00:00.858 INFO - [taskAppId=TASK-10-168-172]:[161] - task
execute path : /var/lib/dolphinscheduler/exec/process/1/10/168/172
2021-06-22 01:00:00.858 INFO - [taskAppId=TASK-10-168-172]:[87] -
tenantCode user:bde, task dir:10_168_172
2021-06-22 01:00:00.859 INFO - [taskAppId=TASK-10-168-172]:[92] - create
command
file:/var/lib/dolphinscheduler/exec/process/1/10/168/172/10_168_172.command
2021-06-22 01:00:00.859 INFO - [taskAppId=TASK-10-168-172]:[111] - command
: #!/bin/sh
BASEDIR=$(cd `dirname $0`; pwd)
cd $BASEDIR
source
/usr/local/apache-dolphinscheduler-1.3.6-bin/conf/env/dolphinscheduler_env.sh
/var/lib/dolphinscheduler/exec/process/1/10/168/172/10_168_172_node.sh
2021-06-22 01:00:00.861 INFO - [taskAppId=TASK-10-168-172]:[327] - task run
command:
sudo -u bde sh
/var/lib/dolphinscheduler/exec/process/1/10/168/172/10_168_172.command
2021-06-22 01:00:00.861 INFO - [taskAppId=TASK-10-168-172]:[208] - process
start, process id is: 6988
2021-06-22 01:00:10.935 INFO - [taskAppId=TASK-10-168-172]:[129] - ->
Logging initialized using configuration in
file:/usr/local/apache-hive-2.3.7-bin/conf/hive-log4j2.properties Async: true
2021-06-22 01:00:18.981 INFO - [taskAppId=TASK-10-168-172]:[129] - -> Job
Submission failed with exception
'org.apache.hadoop.io.nativeio.NativeIOException(No such file or directory)'
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask. No such file or directory
2021-06-22 01:00:19.187 INFO - [taskAppId=TASK-10-168-172]:[217] - process
has exited, execute path:/var/lib/dolphinscheduler/exec/process/1/10/168/172,
processId:6988 ,exitStatusCode:0
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
