Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19124#discussion_r137103061
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFileFormat.scala ---
@@ -83,6 +83,8 @@ class OrcFileFormat extends FileFormat with
DataSourceRegister with Serializable
classOf[MapRedOutputFormat[_, _]])
}
+
org.apache.spark.sql.execution.datasources.orc.OrcFileFormat.checkFieldNames(dataSchema)
--- End diff --
Do we still need this when we move the check to `DataSourceAnalysis `?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
