alamb commented on issue #10800: URL: https://github.com/apache/arrow-rs/issues/10800#issuecomment-5442717959
Sorry -- what problem are you trying to solve @yongster ? I think if you could explain that a bit more (perhaps following the template in this repo) we could offer some more useful guidance It is not clear to me why we would want to change filter/take/coalesce They each have their own sets of heuristics baked in, but changing the heuristics will likely result in some workloads getting faster and some getting slower, which is hard to justify Your specific usecase could probably help us give you useful guideance. For example, do you have some specific operation / query you are running where you see the need for this? If the goal is to minimize the size of data transferred over IPC I would recommend always calling StringView::gc() before sending it If you wanted to trade off CPU for some small IPC overhead, you could implement some sort of heuristics -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
