ravlio commented on issue #9011:
URL:
https://github.com/apache/arrow-datafusion/issues/9011#issuecomment-1924563114
@alamb Pivot and Unpivot do not affect projection. I disabled them and got
the same result. I also added expression to `PartitionedAggregateNode`
```
fn expressions(&self) -> Vec<Expr> {
vec![Expr::Column(Column {
relation: None,
name: "project_id".to_string(),
})]
}
```
but it didn't help for some reason. Parquet keeps reading all the columns. I
tried to remove everything except PartitionedAggregateNode to debug it but the
result is the same. I'm trying to satisfy the requirements, but I did not find
any other way to tell to optimizer about the fields that the node needs except
`fn expressions() -> Vec<Expr>`
@mustafasrepo Thanks! Sort works now!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
