alamb commented on PR #10141:
URL: https://github.com/apache/arrow-rs/pull/10141#issuecomment-5258799414
> he leaf kernel is fast — 2.6x–4.6x against stock get_batch_with_dict +
arrow::compute::filter on captured low-survival pages — but I never established
a query-level benefit. My two fully-covered queries ran at 100% coverage over
65M rows each and showed no reproducible direction across two rounds. And for
sizing: the paper's 3.1x on Q6 is against a 2023 C++ baseline, while modern
arrow-rs's full-decode path has already absorbed most of that headroom, so the
residual against today's main should be expected to be much smaller.
I guess what I was thinking was that I didn't think the parquet reader
supports reading some subset of struct column (which is a group type in
parquet) and applying a filter to two of its fields
So like data
```json
{
"a": "foo",
"b": "bar",
"c": "baz"
}
...
```
Then a query that is like
```sql
select struct.c where struct.a = 'f' and struct.b = 'b'
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
