Github user juliuszsompolski commented on the issue:
https://github.com/apache/spark/pull/20152
If the serialized form change is a problem, that part can probably be
reverted - it's far less likely that a single compressed stats chunk will
overflow Int.
The bug I hit was in the global rank counter part, and I changed the other
part just by reviewing the code around for other places that could conceivably
use a Long instead of Int.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
