Cheng Lian created SPARK-16033:
----------------------------------
Summary: DataFrameWriter.partitionBy() can't be used together with
DataFrameWriter.insertInto()
Key: SPARK-16033
URL: https://issues.apache.org/jira/browse/SPARK-16033
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.0.0
Reporter: Cheng Lian
Assignee: Cheng Lian
When inserting into an existing partitioned table, partitioning columns should
always be determined by catalog metadata of the existing table to be inserted.
Extra {{partitionBy()}} calls don't make sense, and mess up existing data
because newly inserted data may have wrong partitioning directory layout.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
