taowenjun commented on issue #10129:
URL: https://github.com/apache/seatunnel/issues/10129#issuecomment-7001048840

   Thanks @DanielLeens for the detailed guidance above. We'd like to move the 
ORC follow-up forward along that agreed direction, building on @chl-wxp's work 
in #10325 and crediting the original contribution.
   
   The proposed scope is:
   - Add stripe-aligned ORC splitting through the current shared 
FileSplitStrategyFactory, so LocalFile, HdfsFile and S3File use the same 
implementation, with stripe metadata read through HadoopFileSystemProxy and the 
connector's HadoopConf.
   - Preserve the projected schema when adding the split range in 
OrcReadStrategy, and leave FileSourceSplit serialization and legacy checkpoint 
handling unchanged.
   - Add focused stripe-boundary and split/non-split projection correctness 
tests, plus an existing-style LocalFile E2E with parallelism > 1 and exact 
row-count assertions; update both English and Chinese docs.
   
   We plan to open a fresh follow-up PR against current dev rather than revive 
the outdated branch. @chl-wxp, please let us know if you are already continuing 
this work or would like to collaborate. @DanielLeens and maintainers, are there 
any additional requirements or changes to the earlier guidance we should 
account for before preparing the PR? We will keep this scoped to ORC read 
splitting and link the follow-up PR here.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to