GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/20630
[SPARK-23381][CORE] Murmur3 hash generates a different value from other
implementations
## What changes were proposed in this pull request?
Murmur3 hash generates a different value from the original and other
implementations (like Scala standard library and Guava or so) when the length
of a bytes array is not multiple of 4.
## How was this patch tested?
Added a unit test.
**Note:** When we merge this PR, please give all the credits to Shintaro
Murakami.
Author: Shintaro Murakami <[email protected]>
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark pr-20568
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20630.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20630
----
commit c20cd97d7ce5690993b4490bb7cca955e7703d90
Author: Shintaro Murakami <mrkm4ntr@...>
Date: 2018-02-10T14:29:48Z
[SPARK-23381][CORE] Fix Murmur3 for byte arrays whose byte length is not a
multiple of 4
commit 5fcd994554a82d809ac8547378776e2b95c37d93
Author: gatorsmile <gatorsmile@...>
Date: 2018-02-16T21:05:32Z
fix.
commit c406f9846f81ddf8030803cb918bb51506d4ae6b
Author: gatorsmile <gatorsmile@...>
Date: 2018-02-16T21:19:28Z
fix.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
