Github user vinodkc commented on a diff in the pull request:
https://github.com/apache/spark/pull/19779#discussion_r151902033
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveFileFormat.scala
---
@@ -89,6 +90,8 @@ class HiveFileFormat(fileSinkConf: FileSinkDesc)
val fileSinkConfSer = fileSinkConf
new OutputWriterFactory {
private val jobConf = new SerializableJobConf(new JobConf(conf))
+ private val broadcastHadoopConf =
sparkSession.sparkContext.broadcast(
--- End diff --
Thanks for the comment, I'll change code to use jobConf
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
