Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20395#discussion_r164047732
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/vectorized/ArrowColumnVector.java
---
@@ -433,10 +418,14 @@ final long getLong(int rowId) {
private static class ArrayAccessor extends ArrowVectorAccessor {
private final ListVector accessor;
+ private final ArrowBuf offsets;
+ private final ArrowColumnVector arrayData;
ArrayAccessor(ListVector vector) {
super(vector);
this.accessor = vector;
+ this.offsets = vector.getOffsetBuffer();
--- End diff --
Maybe `vector.getOffsetBuffer()` will change when loading the next batch so
we can't reuse the `ArrowBuf`.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
