lyn916 commented on issue #5672:
URL:
https://github.com/apache/dolphinscheduler/issues/5672#issuecomment-865614767
```2021-06-22 11:50:09.919 WARN
[org.apache.hadoop.mapreduce.JobResourceUploader] - Hadoop command-line option
parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
2021-06-22 11:50:09.926 INFO [org.apache.hadoop.mapreduce.JobSubmitter] -
Cleaning up the staging area
file:/var/lib/hdfs/tmp/mapred/staging/bde808230759/.staging/job_local808230759_0001
2021-06-22 11:50:09.929 ERROR [org.apache.hadoop.hive.ql.exec.Task] - Job
Submission failed with exception
'org.apache.hadoop.io.nativeio.NativeIOException(No such file or directory)'
ENOENT: No such file or directory
at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmodImpl(Native
Method)
at
org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmod(NativeIO.java:230)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:729)
at
org.apache.hadoop.fs.ChecksumFileSystem$1.apply(ChecksumFileSystem.java:505)
at
org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:486)
at
org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:508)
at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:601)
at
org.apache.hadoop.mapreduce.JobResourceUploader.uploadFiles(JobResourceUploader.java:94)
at
org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:95)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:190)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:575)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:570)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:570)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:561)
at
org.apache.hadoop.hive.ql.io.merge.MergeFileTask.execute(MergeFileTask.java:156)
at
org.apache.hadoop.hive.ql.exec.DDLTask.mergeFiles(DDLTask.java:754)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:553)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:199)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2183)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1839)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1526)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233)
at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184)
at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:787)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:686)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:226)
at org.apache.hadoop.util.RunJar.main(RunJar.java:141)
2021-06-22 11:50:09.936 ERROR [org.apache.hadoop.hive.ql.Driver] - FAILED:
Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. No
such file or directory
2021-06-22 11:50:09.936 INFO [org.apache.hadoop.hive.ql.Driver] - Completed
executing
command(queryId=bde_20210622115005_532b5d24-6e19-4f5a-9f5a-427c7ad0914d); Time
taken: 0.64 seconds
2021-06-22 11:50:10.011 INFO [org.apache.hadoop.hive.conf.HiveConf] - Using
the default value passed in for log id: faed4357-6e4d-4cf6-a2b2-0b5ac225ad3f
2021-06-22 11:50:10.011 INFO
[org.apache.hadoop.hive.ql.session.SessionState] - Resetting thread name to
main
2021-06-22 11:50:10.012 INFO [org.apache.hadoop.hive.conf.HiveConf] - Using
the default value passed in for log id: faed4357-6e4d-4cf6-a2b2-0b5ac225ad3f
2021-06-22 11:50:10.022 INFO
[org.apache.hadoop.hive.ql.session.SessionState] - Deleted directory:
/tmp/hive/bde/faed4357-6e4d-4cf6-a2b2-0b5ac225ad3f on fs with scheme hdfs
2021-06-22 11:50:10.023 INFO
[org.apache.hadoop.hive.ql.session.SessionState] - Deleted directory:
/tmp/bde/faed4357-6e4d-4cf6-a2b2-0b5ac225ad3f on fs with scheme file
2021-06-22 11:50:10.023 INFO [hive.metastore] - Closed a connection to
metastore, current connections: 2
2021-06-22 11:50:10.261 INFO [org.apache.zookeeper.ZooKeeper] - Session:
0xab7a1fb342aa0058 closed
2021-06-22 11:50:10.261 INFO [org.apache.zookeeper.ClientCnxn] -
EventThread shut down for session: 0xab7a1fb342aa0058
2021-06-22 11:50:10.262 INFO [CuratorFrameworkSingleton] - Closing
ZooKeeper client.```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
