cloud-fan commented on issue #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#issuecomment-507252494 Generally looks good, but I'm wondering if it's better to use Apache Arrow as the exchange format instead of the internal `ColumnarBatch`. I understand that this is a developer API so stability is not a concern here. I'm just afraid people may find `ColumnarBatch` hard to use when doing high-perf columnar operations, but they can't change it as it's in Spark.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
