o merge this in a few more days. Any feedback and
>> review would be very appreciated.
>>
>> On Tue, 9 Nov 2021 at 21:51, Hyukjin Kwon wrote:
>>
>>> Hi dev,
>>>
>>> I proposed DataFrame.mapInArrow (
>>> https://github.com/apache/spark/pu
e, 9 Nov 2021 at 21:51, Hyukjin Kwon wrote:
>
>> Hi dev,
>>
>> I proposed DataFrame.mapInArrow (
>> https://github.com/apache/spark/pull/34505) which allows users to
>> directly leverage Arrow batch to plug in other external systems easily.
>>
>> I wo
Last reminder: I plan to merge this in a few more days. Any feedback and
review would be very appreciated.
On Tue, 9 Nov 2021 at 21:51, Hyukjin Kwon wrote:
> Hi dev,
>
> I proposed DataFrame.mapInArrow (
> https://github.com/apache/spark/pull/34505) which allows users to
> di
Hi dev,
I proposed DataFrame.mapInArrow (https://github.com/apache/spark/pull/34505)
which allows users to directly leverage Arrow batch to plug in other
external systems easily.
I would like to make sure this design of API covers most use cases, and
would like to know if there is other feedback
