Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/18664
Thanks all for the discussion. I think there are a lot of subtleties at
play here, and what may or may not be considered a bug can depend on the users
intent. Regardless, I agree that there needs to be user facing documentation
that will address these details, such as the questions posed by @gatorsmile
above. I can create a JIRA for this if @icexelloss hasn't already.
> I am okay with proceeding separately for dealing with timezone, and
matching the behaviour with Arrow to the existing behaviour without Arrow here
with respect to timezone.
@HyukjinKwon so you are suggesting to not use a timezone for Arrow
timestamps? We discussed that earlier in this PR, but maybe that is the best
solution for now
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
