Hi, Does groupByKey has intelligence associated with it, such that if all the keys resides in the same partition, it should not do the shuffle?
Or user should write mapPartitions( scala groupBy code). Which would be more efficient and what are the memory considerations? Thanks