Hi dev, I proposed DataFrame.mapInArrow (https://github.com/apache/spark/pull/34505) which allows users to directly leverage Arrow batch to plug in other external systems easily.
I would like to make sure this design of API covers most use cases, and would like to know if there is other feedback or opinion on this. I would appreciate any feedback on this. Thanks.
