Talat UYARER created SPARK-21036:
------------------------------------
Summary: Truncate action and writes should be in one transaction.
Key: SPARK-21036
URL: https://issues.apache.org/jira/browse/SPARK-21036
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.1.1, 2.1.0
Reporter: Talat UYARER
Priority: Minor
When I use truncate option like this:
spark.range(10).write.mode("overwrite").option("truncate", true).jdbc(url,
"table_with_index", prop)
First table is truncated in a transaction later it will start write another
transaction. This effects the data lost and found for a moment.
This actions should be in same transaction.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
