zhuqi-lucas opened a new issue, #18560:
URL: https://github.com/apache/datafusion/issues/18560
### Is your feature request related to a problem or challenge?
Now we don't support pushdown nested datatype pushdown to parquet:
```rust
fn check_single_column(&mut self, column_name: &str) ->
Option<TreeNodeRecursion> {
if let Ok(idx) = self.table_schema.index_of(column_name) {
self.required_columns.insert(idx);
if DataType::is_nested(self.table_schema.field(idx).data_type())
{
self.non_primitive_columns = true;
return Some(TreeNodeRecursion::Jump);
}
} else {
// If the column does not exist in the (un-projected) table
schema then
// it must be a projected column.
self.projected_columns = true;
return Some(TreeNodeRecursion::Jump);
}
None
}
```
But i think, some nest datatypes will be useful if we support pushdown, for
example, the list column a, here is the case:
```rust
array_has_all(a, ['c'])
```
We can pushdown to parquet, so arrow-rs side can filter it? But i am not
sure if arrow-rs support it.
### Describe the solution you'd like
_No response_
### Describe alternatives you've considered
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
