[pyspark] dataframe map_partition

[peng yu]

There is a nice map_partition function in R `dapply`.  so that user can
pass a row to udf.

I'm wondering why we don't have that in python?

I'm trying to have a map_partition function with pandas_udf supported

thanks!