hubgeter opened a new pull request, #69682:
URL: https://github.com/apache/doris/pull/69682
### What problem does this PR solve?
Issue Number: N/A
Related PR: #69512
Problem Summary:
Backport the validation logic from #69512 to branch-4.2 without a mechanical
cherry-pick. Propagate the actual PBlock buffer end through block decoding,
validate HLL and nullable HLL internal lengths, validate StreamVByte-compressed
nullable null maps, and reject inconsistent Arrow column row counts. Also
release exchange queue accounting and invoke the deferred completion callback
when block deserialization fails.
The branch-4.2 adaptation covers both the current const-aware serialization
layout and the legacy serialization layout still supported by this branch.
### Release note
Improve validation of serialized HLL payloads and exchange error cleanup.
### Check List (For Author)
- Test
- [ ] Regression test
- [x] Unit Test
- 55 focused BE unit tests passed: HLL bounds, legacy and current
nullable HLL round trips, HLL sparse/full malformed payloads, exchange
rejected-block cleanup, and Arrow row-count validation.
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
- Behavior changed:
- [ ] No.
- [x] Yes.
- Invalid or truncated serialized HLL values and compressed nullable
null maps are rejected. Exchange accounting and completion callbacks are
released when deserialization fails. Arrow conversion rejects columns whose row
counts disagree with the block.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
