GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/15265
[SPARK-17618] Guard against invalid comparisons between UnsafeRow and other
formats
This patch ports changes from #15185 to Spark 2.x. In that patch, a
correctness bug in Spark 1.6.x which was caused by an invalid `equals()`
comparison between an `UnsafeRow` and another row of a different format. Spark
2.x is not affected by that specific correctness bug but it can still reap the
error-prevention benefits of that patch's changes, which modify
``UnsafeRow.equals()` to throw an IllegalArgumentException if it is called with
an object that is not an `UnsafeRow`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark SPARK-17618-master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15265.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15265
----
commit f4de93fa70bb66c1f9d1135ec45d31861e950a8b
Author: Josh Rosen <[email protected]>
Date: 2016-09-27T17:57:15Z
[SPARK-17618] Guard against invalid comparisons between UnsafeRow and other
row formats
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
