wjones127 opened a new issue, #4897:
URL: https://github.com/apache/arrow-rs/issues/4897

   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   
   Right now, concat only pre-allocates for string, binary, dictionary and 
primitive arrays (IIUC):
   
   
https://github.com/apache/arrow-rs/blob/208da03979b2903c3182c20ef382b2895756380a/arrow-select/src/concat.rs#L129-L139
   
   We use `FixedSizeList<{FloatType}>` as a storage type for tensor arrays, and 
not pre-allocating can get very expensive in plans. 
https://github.com/lancedb/lance/issues/1360
   
   **Describe the solution you'd like**
   
   Should provide capacities for fixed size list array. We likely need to add 
an entry to this enum:
   
   
https://github.com/apache/arrow-rs/blob/b46ea46aa65149fac763671b0adcb9c4e406ec11/arrow-data/src/transform/mod.rs#L323-L344
   
   **Describe alternatives you've considered**
   <!--
   A clear and concise description of any alternative solutions or features 
you've considered.
   -->
   
   **Additional context**
   <!--
   Add any other context or screenshots about the feature request here.
   -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to