torgebo opened a new issue, #8650:
URL: https://github.com/apache/arrow-rs/issues/8650

   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   <!--
   If some process creates a large number of parquet files, it would be nice to 
be able to run `parquet-concat` on these (location: 
`parquet/src/bin/parquet-concat.rs`). The current script will however open up 
too many file descriptors on most systems in a situation of many files.
   -->
   
   **Describe the solution you'd like**
   <!--
   Make the implementation streaming based: files are opened, read and written 
from in order. The current implementation starts by opening all file 
descriptors.
   -->
   
   **Describe alternatives you've considered**
   <!--
   
   -->
   
   **Additional context**
   <!--
   
   -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to