Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20386#discussion_r164680081
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2.scala
---
@@ -54,10 +54,6 @@ case class WriteToDataSourceV2Exec(writer:
DataSourceV2Writer, query: SparkPlan)
}
val rdd = query.execute()
- val messages = new Array[WriterCommitMessage](rdd.partitions.length)
-
- logInfo(s"Start processing data source writer: $writer. " +
- s"The input RDD has ${messages.length} partitions.")
--- End diff --
might be good to keep this log.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
