On Wed, Jan 31, 2018 at 1:15 AM, Ruifeng Zheng wrote:
> HI all:
>
>
>
>1, Dataset API supports operation “sortWithinPartitions”, but in RDD
> API there is no counterpart (I know there is
> “repartitionAndSortWithinPartitions”, but I don’t want to repartition the
>
>
主题: Re: [Core][Suggestion] sortWithinPartitions and aggregateWithinPartitions
for RDD
You can just do that with mapPartitions pretty easily can’t you?
On Wed, Jan 31, 2018 at 11:08 PM Ruifeng Zheng <ruife...@foxmail.com> wrote:
HI all:
1, Dataset API supports operati
You can just do that with mapPartitions pretty easily can’t you?
On Wed, Jan 31, 2018 at 11:08 PM Ruifeng Zheng wrote:
> HI all:
>
>
>
>1, Dataset API supports operation “sortWithinPartitions”, but in
> RDD API there is no counterpart (I know there is
>
HI all:
1, Dataset API supports operation “sortWithinPartitions”, but in RDD API
there is no counterpart (I know there is “repartitionAndSortWithinPartitions”,
but I don’t want to repartition the RDD), I have to convert RDD to Dataset for
this function. Would it make sense to add a