> > Have you done comparison between uniffle and celeborn..? > We did not compare the performance of Uniffle and Celeborn (because Hive-MR3-Celeborn has been released but Hive-MR3-Uniffle is not complete yet). Much of the code in Hive-MR3-Celeborn is currently reused in Hive-MR3-Uniffle, so we think there are many architectural similarities between the two systems.
We implemented our Celeborn extension first because a user of Hive-MR3 wanted to use Celeborn which was already running in production. If any industrial user of Hive-MR3 wants to use Uniffle in production, please let us know. BTW, if you are using Hive-on-MapReduce or Hive-on-Tez, consider switching to Hive-on-Tez. You will see a huge increase (x3 to x10) in throughput. Regards, --- Sungwoo
