Maxim Gekk created SPARK-31802:
----------------------------------

             Summary: Format Java date-time types in Row.jsonValue directly
                 Key: SPARK-31802
                 URL: https://issues.apache.org/jira/browse/SPARK-31802
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 3.0.0, 3.1.0
            Reporter: Maxim Gekk
            Assignee: Maxim Gekk
             Fix For: 3.0.0


HiveResult.toHiveString has to convert incoming Java date/timestamps types to 
days/microseconds because existing API of DateFormatter/TimestampFormatter 
don't accept java.sql.Timestamp/java.util.Date and 
java.time.Instant/java.time.LocalDate. Internally, the formatters perform 
conversions to Java types again. This badly impacts on the performance. The 
ticket aims to add new APIs to DateFormatter and TimestampFormatter that should 
accept Java types.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to