[
https://issues.apache.org/jira/browse/FLINK-25049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450217#comment-17450217
]
Jark Wu commented on FLINK-25049:
---------------------------------
[~macdoor615], could you share the DDL of the tables used in your DMLs?
cc [~lzljs3620320]
> sql-client.sh execute batch job in async mode failed with
> java.io.FileNotFoundException
> ---------------------------------------------------------------------------------------
>
> Key: FLINK-25049
> URL: https://issues.apache.org/jira/browse/FLINK-25049
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem, Table SQL / Ecosystem
> Affects Versions: 1.14.0
> Reporter: macdoor615
> Priority: Major
>
> execute multi simple sql in a sql file, like
>
> {code:java}
> insert overwrite bnpmp.p_biz_hcd_5m select * from bnpmp.p_biz_hcd_5m where
> dt='2021-11-22';
> insert overwrite bnpmp.p_biz_hjr_5m select * from bnpmp.p_biz_hjr_5m where
> dt='2021-11-22';
> insert overwrite bnpmp.p_biz_hswtv_5m select * from bnpmp.p_biz_hswtv_5m
> where dt='2021-11-22';
> ...
> {code}
>
> if
> {code:java}
> SET table.dml-sync = true;{code}
> execute properly.
> if
> {code:java}
> SET table.dml-sync = false;{code}
> some SQL Job failed with the following error
>
> {code:java}
> Caused by: java.lang.Exception: Failed to finalize execution on master ...
> 37 more Caused by: org.apache.flink.table.api.TableException: Exception in
> finalizeGlobal at
> org.apache.flink.table.filesystem.FileSystemOutputFormat.finalizeGlobal(FileSystemOutputFormat.java:91)
> at
> org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.finalizeOnMaster(InputOutputFormatVertex.java:148)
> at
> org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.vertexFinished(DefaultExecutionGraph.java:1086)
> ... 36 more Caused by: java.io.FileNotFoundException: File
> hdfs://service1/user/hive/warehouse/bnpmp.db/p_snmp_f5_traffic_5m/.staging_1637821441497
> does not exist. at
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:901)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:112)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:961)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:958)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:958)
> at
> org.apache.flink.hive.shaded.fs.hdfs.HadoopFileSystem.listStatus(HadoopFileSystem.java:170)
> at
> org.apache.flink.table.filesystem.PartitionTempFileManager.listTaskTemporaryPaths(PartitionTempFileManager.java:104)
> at
> org.apache.flink.table.filesystem.FileSystemCommitter.commitPartitions(FileSystemCommitter.java:77)
> at
> org.apache.flink.table.filesystem.FileSystemOutputFormat.finalizeGlobal(FileSystemOutputFormat.java:89)
> ... 38 more
>
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
