JNSimba opened a new pull request, #690:
URL: https://github.com/apache/doris-flink-connector/pull/690

   # Proposed changes
   
   Issue Number: DORIS-28133
   
   ## Problem Summary:
   
   Initial snapshot splits are always read through Flight SQL but currently 
retain the Thrift query plan. Large tables repeat this unused plan in every 
pending split, causing the source checkpoint payload to exceed Java's array 
limit.
   
   Drop the unused plan only for INITIAL snapshot splits. SNAPSHOT mode keeps 
the plan for Thrift reads and fallback.
   
   ## Checklist(Required)
   
   1. Does it affect the original behavior: Yes
   2. Has unit tests been added: Yes
   3. Has document been added or modified: No Need
   4. Does it need to update dependencies: No
   5. Are there any changes that cannot be rolled back: No
   
   ## Further comments
   
   Validation: `mvn -Pflink1 -pl flink-doris-connector-base clean test` (386 
tests, 0 failures).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to