Jonathan Albrecht created SPARK-51069:
-----------------------------------------
Summary: UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl
does not work on big endian platforms
Key: SPARK-51069
URL: https://issues.apache.org/jira/browse/SPARK-51069
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.5.4, 4.0.0, 3.5.5, 4.1.0
Reporter: Jonathan Albrecht
In validateStructuralIntegrityWithReasonImpl when checking if the unused bits
in the field are all zeros for fixed length fields, the checks only work on
little endian platforms.
It should be possible to add implementations for big endian platforms.
On big endian platforms, many tests in the SQL projects fail because of this.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]