wForget opened a new issue, #2457:
URL: https://github.com/apache/datafusion-comet/issues/2457
### Describe the bug
In the failed test case of #2444, I found that the struct type with
duplicate keys will be deduplicated when converted to arrowType, which causes
`RowToColumanr` to lose some columns.
error:
```
Job aborted due to stage failure: Task 0 in stage 7.0 failed 1 times, most
recent failure: Lost task 0.0 in stage 7.0 (TID 9) (10.5.155.10 executor
driver): java.lang.IndexOutOfBoundsException: Index 2 out of bounds for length 2
at
java.base/jdk.internal.util.Preconditions.outOfBounds(Preconditions.java:64)
at
java.base/jdk.internal.util.Preconditions.outOfBoundsCheckIndex(Preconditions.java:70)
at
java.base/jdk.internal.util.Preconditions.checkIndex(Preconditions.java:266)
at java.base/java.util.Objects.checkIndex(Objects.java:361)
at java.base/java.util.ArrayList.get(ArrayList.java:427)
at
org.apache.comet.vector.CometStructVector.getChild(CometStructVector.java:55)
at
org.apache.spark.sql.vectorized.ColumnarRow.isNullAt(ColumnarRow.java:101)
```
### Steps to reproduce
_No response_
### Expected behavior
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
