Jonathan Albrecht created SPARK-51042:
-----------------------------------------
Summary: Read and write CalendarIntervals using one call to
get/putLong consistently
Key: SPARK-51042
URL: https://issues.apache.org/jira/browse/SPARK-51042
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.5.4, 4.0.0
Reporter: Jonathan Albrecht
In commit ac07cea234f4fb687442aafa8b6d411695110a4e there was a performance
improvement to reading a writing CalendarIntervals in UnsafeRow. This same
change can be applied to UnsafeArrayData and UnsafeWriter.
This would also fix big endian platforms where the current and proposed methods
of reading and writing CalendarIntervals do not order the bytes in the same
way. Currently CalendarInterval related tests in Catalyst and SQL are failing
on big endian platforms.
There would be no effect on little endian platforms (byte order is not
affected) except for performance improvement.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
