Jonathan Albrecht created SPARK-51069:
-----------------------------------------

             Summary: UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl 
does not work on big endian platforms
                 Key: SPARK-51069
                 URL: https://issues.apache.org/jira/browse/SPARK-51069
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.5.4, 4.0.0, 3.5.5, 4.1.0
            Reporter: Jonathan Albrecht


In validateStructuralIntegrityWithReasonImpl when checking if the unused bits 
in the field are all zeros for fixed length fields, the checks only work on 
little endian platforms.
It should be possible to add implementations for big endian platforms.
 
On big endian platforms, many tests in the SQL projects fail because of this.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to