MaxGekk opened a new pull request #33838:
URL: https://github.com/apache/spark/pull/33838


   ### What changes were proposed in this pull request?
   In the PR, I propose to use the session time zone ( see the SQL config 
`spark.sql.session.timeZone`) instead of JVM default time zone while converting 
of special timestamp_ntz strings such as "today", "tomorrow" and so on.
   
   ### Why are the changes needed?
   Current implementation is based on the system time zone, and it controverses 
to other functions/classes that use the session time zone. For example, Spark 
doesn't respects user's settings:
   ```sql
   $ export TZ="Europe/Amsterdam"
   $ ./bin/spark-sql -S
   spark-sql> select timestamp_ntz'now';
   2021-08-25 18:12:36.233
   
   spark-sql> set spark.sql.session.timeZone=America/Los_Angeles;
   spark.sql.session.timeZone   America/Los_Angeles
   spark-sql> select timestamp_ntz'now';
   2021-08-25 18:14:40.547
   ```
   
   ### Does this PR introduce _any_ user-facing change?
   Yes. For the example above, after the changes:
   ```sql
   spark-sql> select timestamp_ntz'now';
   2021-08-25 18:47:46.832
   
   spark-sql> set spark.sql.session.timeZone=America/Los_Angeles;
   spark.sql.session.timeZone   America/Los_Angeles
   spark-sql> select timestamp_ntz'now';
   2021-08-25 09:48:05.211
   ```
   
   ### How was this patch tested?
   By running the affected test suites:
   ```
   $ build/sbt "test:testOnly *DateTimeUtilsSuite"
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to