Github user Huamei-17 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19779#discussion_r151890487
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveFileFormat.scala
---
@@ -89,6 +90,8 @@ class HiveFileFormat(fileSinkConf: FileSinkDesc)
val fileSinkConfSer = fileSinkConf
new OutputWriterFactory {
private val jobConf = new SerializableJobConf(new JobConf(conf))
+ private val broadcastHadoopConf =
sparkSession.sparkContext.broadcast(
--- End diff --
Is it possible to use jobConf as hive serde initialize param directly?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
