wangzhigang1999 opened a new issue, #9947:
URL: https://github.com/apache/paimon/issues/9947

   ### Search before asking
   
   - [x] I searched in the issues and found nothing similar.
   
   ### Motivation
   
   `DataVectorWriter` and `DedicatedFormatWriter` both coordinate normal data 
files with separate blob/vector files. They duplicate normal-file output, 
rolling checks, prepare/close handling, and parts of the metadata handoff and 
abort cleanup logic.
   
   Maintainers need to keep these paths consistent when changing failure 
handling or file metadata. Some composite-only state, such as 
`_pending_normal_meta`, also lives in `DataWriter`, although ordinary append 
and primary-key writers do not use it.
   
   ### Solution
   
   Introduce `CompositeDataWriter` for the shared lifecycle and its state. Keep 
column splitting, child-writer management, consistency checks, and 
blob/video-specific rules in the concrete writers.
   
   Reuse physical format dispatch through `DataWriter`. Preserve existing 
metadata ordering, retry behavior, and file ownership during abort, including 
the cleanup from #9917.
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to