HyukjinKwon commented on PR #52980: URL: https://github.com/apache/spark/pull/52980#issuecomment-3529115068
For now, we have been using naive datetimes so far, which matches with `TimestampType` concept without a timezone. I think we should probably just focus on fixing the perf issue in this PR instead of fixing other bugs together. Another thing is that `spark.sql.session.timeZone` takes care about the timestamp diff only in Spark operators - it doesn't affect UDF executions. The same applies to Scala/Java UDF executions as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
