We have custom join's that leverage it.
It is used to get to direct shuffle'ed iterator - without needing
sort/aggregate/etc.

IIRC the only way to get to it from ShuffleHandle is via shuffle manager.


Regards,
Mridul

On Wed, Mar 16, 2016 at 3:36 PM, Reynold Xin <[email protected]> wrote:
>
> On Wed, Mar 16, 2016 at 3:29 PM, Mridul Muralidharan <[email protected]>
> wrote:
>>
>> b) Shuffle manager (to get shuffle reader)
>
>
> What's the use case for shuffle manager/reader? This seems like using super
> internal APIs in applications.
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to