Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/21312
> Not sure why, but previously calling ListVector.clear, I must change the
reset order to reset element writer first to pass the test
@viirya I looked into this and found it to be a bug in Arrow when clearing,
then reusing a vector. I filed
https://issues.apache.org/jira/browse/ARROW-2594. Changing the order of the
elements only masked the problem, because otherwise it would reuse a buffer
with incorrect values.
This won't happen with the change here using the manual reset, so we should
be good.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
