Jinesh Patel created SPARK-31172:
------------------------------------
Summary: RecordBinaryComparator Tests failing on Big Endian
Platform (s390x)
Key: SPARK-31172
URL: https://issues.apache.org/jira/browse/SPARK-31172
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.4.5
Environment: Architecture: Big Endian s390x
Operating Systems:
* RHEL 7.x
* RHEL 8.x
* Ubuntu 16.04
* Ubuntu 18.04
* Ubuntu 19.10
* SLES 12 SP4 and SLES 12 SP5
* SLES 15 SP1
Reporter: Jinesh Patel
Fix For: 3.0.0, 3.1.0, 2.4.6
Failing Test Cases in the RecordBinaryComparatorSuite:
* testBinaryComparatorWhenSubtractionIsDivisibleByMaxIntValue
* testBinaryComparatorWhenSubtractionCanOverflowLongValue
Test cases failed after the change related to:
[Github Pull Request
#26548|https://github.com/apache/spark/pull/26548#issuecomment-554645859]
Test Case: testBinaryComparatorWhenSubtractionIsDivisibleByMaxIntValue
* Fails due to changing the compare from `<` to `>` as the test condition (In
little endian this is valid when the bytes are reversed, but not for big endian)
Test Case:Â testBinaryComparatorWhenSubtractionCanOverflowLongValue
* Fails due to using Long.compareUnsigned
* Possible Fix: Use signed compare for big endian platforms.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
