discivigour opened a new pull request, #6691:
URL: https://github.com/apache/paimon/pull/6691

   <!-- Please specify the module before the PR name: [core] ... or [flink] ... 
-->
   
   ### Purpose
   
   - The current code has the following issue: When the blob data is too large 
and causes rolling, it will be impossible to match the data file and the blob 
file for shard. This PR fixes the with_shard feature for blob data
   - Divide the data more evenly to avoid the problem of excessive data volume 
in the last shard
   
   ### Tests
   
   - test_blob_write_read_large_data_with_rolling_with_shard
   - test_with_shard_uniform_division
   
   ### API and Format
   
   <!-- Does this change affect API or storage format -->
   
   ### Documentation
   
   <!-- Does this change introduce a new feature -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to