alamb commented on issue #208: URL: https://github.com/apache/arrow-rs/issues/208#issuecomment-916422638
Hi @matthewmturner -- thanks! Some additional context is that we encountered this issue while working on IOx -- see details https://github.com/influxdata/influxdb_iox/issues/1133 @mkmik worked around the issue in IOx via a heuristic in https://github.com/influxdata/influxdb_iox/commit/82ed5d1708458ec9438406ce1fd19aa0c7d23204 Namely there is code that deep clones the array prior to serialization if some guestimate of buffer size is hit. Fixing the underlying problem (and only serializing the part of the data that is needed) would be great -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
