Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19571#discussion_r146958510
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFileFormat.scala ---
@@ -73,6 +70,10 @@ class OrcFileFormat extends FileFormat with
DataSourceRegister with Serializable
val configuration = job.getConfiguration
+ configuration.set(
+ MAPRED_OUTPUT_SCHEMA.getAttribute,
+
org.apache.spark.sql.execution.datasources.orc.OrcFileFormat.getSchemaString(dataSchema))
--- End diff --
Yes. This is the correct schema to be written.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
