adriangb commented on issue #11234:
URL: https://github.com/apache/arrow-rs/issues/11234#issuecomment-6097375160
# PR stack for batch-granular decode
```text
main ──┬── 11484 fix ──────┐
└── 11485 tests ────┴── 11238 batch mode ── 11487 skip empty decode
── 11240 batch-mode optimizations
```
| Order | PR | Content | Size of the PR alone | Depends on | State |
|---|---|---|---:|---|---|
| 1 | https://github.com/apache/arrow-rs/pull/11484 | Fix: an offset index
page past its column chunk gives an error, not a panic | +68 | `main` | Ready
for review |
| 1 | https://github.com/apache/arrow-rs/pull/11485 | Tests only: the push
decoder against the sync reader, with fuzz tests | +709 | `main` | Ready for
review |
| 2 | https://github.com/apache/arrow-rs/pull/11238 |
`FetchGranularity::Batch`: the first batch of a row group as soon as its pages
are pushed |
[+2,354](https://github.com/pydantic/arrow-rs/compare/fe5a3f59d8...29553db415)
(about 1,100 are tests) | 11484, 11485 | Draft |
| 3 | https://github.com/apache/arrow-rs/pull/11487 | Batch mode: no empty
decode after each batch |
[+70](https://github.com/pydantic/arrow-rs/compare/29553db415...5b6b92d38a) |
11238 | Draft |
| 4 | https://github.com/apache/arrow-rs/pull/11240 | Batch mode: predicate
cache, page release, configured selection policy |
[+690](https://github.com/pydantic/arrow-rs/compare/5b6b92d38a...0f5ce5b793) |
11487 | Draft |
The two PRs of order 1 do not depend on each other. Each draft PR contains
the commits of the PRs that it depends on, because a PR against this repository
must have `main` as its base. The size links show the diff of that PR alone.
Already merged: https://github.com/apache/arrow-rs/pull/11218,
https://github.com/apache/arrow-rs/pull/11235,
https://github.com/apache/arrow-rs/pull/11237.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
