Maxim Gekk created SPARK-31445:
----------------------------------
Summary: Avoid floating-point division in millisToDays
Key: SPARK-31445
URL: https://issues.apache.org/jira/browse/SPARK-31445
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.4.5
Reporter: Maxim Gekk
As the benchmark https://github.com/MaxGekk/spark/pull/27, and comparison to
Spark 3.0+an optimisation of fromJavaDate in
https://github.com/apache/spark/pull/28205 show that floating-point ops in
millisToDays badly impact on the performance of conversion java.sql.Date to
Catalyst's date values. The ticket aims to replace double ops by int/long ops.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
