Sorry I've been busy, I'll try and take a look tomorrow, excited to see this progress though :)
On Wed, Nov 10, 2021 at 9:01 PM Hyukjin Kwon <gurwls...@gmail.com> wrote: > Last reminder: I plan to merge this in a few more days. Any feedback and > review would be very appreciated. > > On Tue, 9 Nov 2021 at 21:51, Hyukjin Kwon <gurwls...@gmail.com> wrote: > >> Hi dev, >> >> I proposed DataFrame.mapInArrow ( >> https://github.com/apache/spark/pull/34505) which allows users to >> directly leverage Arrow batch to plug in other external systems easily. >> >> I would like to make sure this design of API covers most use cases, and >> would like to know if there is other feedback or opinion on this. >> >> I would appreciate any feedback on this. >> >> Thanks. >> > -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
