mcdull_zhang created SPARK-31459:
------------------------------------
Summary: When using the insert overwrite directory syntax, if the
target path is an existing file, the final run result is incorrect
Key: SPARK-31459
URL: https://issues.apache.org/jira/browse/SPARK-31459
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.4.5, 3
Environment: spark2.4.5
Reporter: mcdull_zhang
When using the insert overwrite directory syntax, if the target path is an
existing file, the final operation result is incorrect.
At present, Spark will not delete the existing files. After the calculation is
completed, one of the result files will be renamed to the result path.
This is different from hive's behavior. Hive will delete the existing target
file.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
