[ 
https://issues.apache.org/jira/browse/SPARK-31802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Maxim Gekk updated SPARK-31802:
-------------------------------
    Description: Row.jsonValue has to convert incoming Java date/timestamps 
types to days/microseconds because  DateFormatter/TimestampFormatter APIs 
didn't accept java.sql.Timestamp/java.util.Date and 
java.time.Instant/java.time.LocalDate before 
https://issues.apache.org/jira/browse/SPARK-31762. Internally, the formatters 
perform conversions to Java types again. This badly impacts on the performance. 
The ticket aims to add new APIs to DateFormatter and TimestampFormatter that 
should accept Java types.  (was: Row.jsonValue has to convert incoming Java 
date/timestamps types to days/microseconds because  
DateFormatter/TimestampFormatter APIs didn't accept 
java.sql.Timestamp/java.util.Date and java.time.Instant/java.time.LocalDate 
before . Internally, the formatters perform conversions to Java types again. 
This badly impacts on the performance. The ticket aims to add new APIs to 
DateFormatter and TimestampFormatter that should accept Java types.)

> Format Java date-time types in Row.jsonValue directly
> -----------------------------------------------------
>
>                 Key: SPARK-31802
>                 URL: https://issues.apache.org/jira/browse/SPARK-31802
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.0.0, 3.1.0
>            Reporter: Maxim Gekk
>            Assignee: Maxim Gekk
>            Priority: Major
>             Fix For: 3.0.0
>
>
> Row.jsonValue has to convert incoming Java date/timestamps types to 
> days/microseconds because  DateFormatter/TimestampFormatter APIs didn't 
> accept java.sql.Timestamp/java.util.Date and 
> java.time.Instant/java.time.LocalDate before 
> https://issues.apache.org/jira/browse/SPARK-31762. Internally, the formatters 
> perform conversions to Java types again. This badly impacts on the 
> performance. The ticket aims to add new APIs to DateFormatter and 
> TimestampFormatter that should accept Java types.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to