carloea2 opened a new issue, #8185:
URL: https://github.com/apache/texera/issues/8185

   ### Root cause
   
   Python tuple hashing has no mapping for `LARGE_BINARY`. A hash shuffle using 
a large-binary field reaches `Tuple.__hash__` and raises `KeyError` before 
selecting a downstream worker.
   
   ### Reproduction
   
   Create a hash partition with two receivers and use a `LARGE_BINARY` key 
containing `s3://bucket/object`.
   
   Before: partitioning raises `KeyError: AttributeType.LARGE_BINARY`
   After: the tuple hashes to the JDK-verified value -46745592 and selects 
worker 0
   
   ASCII URI, supplementary Unicode URI, and null values are covered.
   
   ### Expected behavior
   
   Python hashes `LARGE_BINARY` values from their URI using the same UTF-16 and 
`Objects.hash` semantics as Scala.
   
   ### Version
   
   Current `main` at 70c21145887920528d7d5540e3fb790b43e8b759.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to