novemberkilo commented on issue #1036:
URL: https://github.com/apache/arrow-rs/issues/1036#issuecomment-997521410
@nevi-me @alamb I started with `json2parquet` and found the shape of the
RecordBatch that corresponded to `{"emptylist": []}`. This then guided me to
writing the test that I've committed for now. I get the same panic and error
message so I think I am on the right track. Any suggestions for where the
actual fix might be? I'm spelunking around but if either of you (or anyone else
familiar with the code here) can help orient me, that would help.
The `dbg!` output from running `json2parquet` on the emptylist appears below:
```
[src/main.rs:182] &batch = Ok(
RecordBatch {
schema: Schema {
fields: [
Field {
name: "emptylist",
data_type: List(
Field {
name: "item",
data_type: Null,
nullable: true,
dict_id: 0,
dict_is_ordered: false,
metadata: None,
},
),
nullable: true,
dict_id: 0,
dict_is_ordered: false,
metadata: None,
},
],
metadata: {},
},
columns: [
ListArray
[
NullArray(0),
],
],
},
)
thread 'main' panicked at 'Cannot filter indices on a non-primitive array,
found List(true)',
/home/navin/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-6.3.0/src/arrow/levels.rs:757:18
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
