dwsmith1983 opened a new issue, #5657:
URL: https://github.com/apache/datafusion-comet/issues/5657

   ### What is the problem the feature request solves?
   
   Follow-up from the native Delta Lake scan review (#5365). For on-disk 
deletion vectors, the DV bitmap read and the Parquet footer read are 
independent, but preparation currently completes bitmap fetch, decode, and 
validation before starting the footer read. Overlapping them could reduce 
remote-storage preparation latency.
   
   Any change should retain bounded concurrency across files, preserve 
cancellation, error handling, and memory reservations, and measure peak memory 
alongside latency since overlap raises concurrent resource use. Inline DVs have 
no bitmap network read to overlap.
   
   ### Describe the potential solution
   
   No response
   
   ### Additional context
   
   Raised in the #5365 review discussion.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to