Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19124#discussion_r137107658
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFileFormat.scala ---
@@ -83,6 +83,8 @@ class OrcFileFormat extends FileFormat with
DataSourceRegister with Serializable
classOf[MapRedOutputFormat[_, _]])
}
+
org.apache.spark.sql.execution.datasources.orc.OrcFileFormat.checkFieldNames(dataSchema)
--- End diff --
I see. I'll check this and remove it. Maybe, we can remove the similar
logic from ParquetFileFormat, too.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
