dongjoon-hyun edited a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-532381953 Hi, All. I'd recommend to use the old one for `XORShiftRandom`. @wangyum . Please add `MurmurHash3.arraySeed` like the following. - core/src/main/scala/org/apache/spark/util/random/XORShiftRandom.scala ```scala private[random] def hashSeed(seed: Long): Long = { val bytes = ByteBuffer.allocate(java.lang.Long.BYTES).putLong(seed).array() - val lowBits = MurmurHash3.bytesHash(bytes) + val lowBits = MurmurHash3.bytesHash(bytes, MurmurHash3.arraySeed) val highBits = MurmurHash3.bytesHash(bytes, lowBits) (highBits.toLong << 32) | (lowBits.toLong & 0xFFFFFFFFL) } ``` This recover `JavaAPISuite.sample`. I also believe this will solve the other failures, too. Let see Jenkins result. If the test pass, please update the PR description with this changes with https://github.com/apache/spark/pull/25404#issuecomment-532354030. cc @gatorsmile , @cloud-fan , @HyukjinKwon additionally.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
