lzydmxy opened a new pull request, #64626:
URL: https://github.com/apache/doris/pull/64626
### What problem does this PR solve?
Problem Summary:
When executing INSERT SELECT on a non-master FE, the statement is
forwarded to the master
FE via ForwardWithSync. During forwarding, only session variables
annotated with
needForward=true are propagated. Two session variables used during LOAD
execution were
missing this annotation, causing them to always use default values on the
master FE:
1. `parallel_exchange_instance_num` — controls Fragment 0
(OLAP_TABLE_SINK) instance count.
UnassignedShuffleJob.degreeOfParallelism() reads this from
statementContext.getConnectContext() during planning on the master FE.
Without needForward,
Fragment 0 always defaults to 100 instances regardless of SET value.
2. `load_stream_per_node` — controls per-BE load stream concurrency for
OLAP_TABLE_SINK.
ThriftPlansBuilder.setParamsForOlapTableSink() reads this on the master
FE during LOAD
execution. Without needForward, it always defaults to 2.
The root cause pattern is that these variables are used during FE-side
planning/execution
on the master FE node (after forwarding), not just on the original client
FE. The
ForwardWithSync mechanism only propagates variables marked
needForward=true, so the
master FE never sees the user-configured values.
### Release note
None
### Check List (For Author)
- Test
- [ ] Regression test
- [x] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
- Behavior changed:
- [x] No.
- [ ] Yes.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
