cloud-fan commented on code in PR #52980:
URL: https://github.com/apache/spark/pull/52980#discussion_r2524271614
##########
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala:
##########
@@ -196,6 +196,7 @@ private[spark] abstract class BasePythonRunner[IN, OUT](
conf.get(PYTHON_WORKER_TRACEBACK_DUMP_INTERVAL_SECONDS)
protected val hideTraceback: Boolean = false
protected val simplifiedTraceback: Boolean = false
+ protected val sessionLocalTimeZone =
conf.getOption("spark.sql.session.timeZone")
Review Comment:
yea and session conf is dynamic, I think every UDF execution (not per row,
but per query) should pass the session conf to the python worker.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
