Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19941#discussion_r156811247
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -490,20 +489,19 @@ case class DataSource(
}
/**
- * Writes the given [[LogicalPlan]] out to this [[DataSource]] and
returns a [[BaseRelation]] for
- * the following reading.
+ * Returns a [[BaseRelation]] for creating table after `planForWriting`.
Only use
+ * in `CreateDataSourceTableAsSelectCommand` while saving data to
non-existing table.
*/
- def writeAndRead(mode: SaveMode, data: LogicalPlan): BaseRelation = {
+ def getRelation(mode: SaveMode, data: LogicalPlan): BaseRelation = {
if
(data.schema.map(_.dataType).exists(_.isInstanceOf[CalendarIntervalType])) {
throw new AnalysisException("Cannot save interval data type into
external storage.")
}
providingClass.newInstance() match {
- case dataSource: CreatableRelationProvider =>
+ case dataSource: RelationProvider =>
--- End diff --
Yes, it will write to the destination, but `InsertIntoDataSourceDirCommand`
only supports `FileFormat`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]