On Thu, Nov 2, 2023 at 1:43 PM Sungwoo Park <glap...@gmail.com> wrote:
> Have you done comparison between uniffle and celeborn..? >> > > We did not compare the performance of Uniffle and Celeborn (because > Hive-MR3-Celeborn has been released but Hive-MR3-Uniffle is not complete > yet). Much of the code in Hive-MR3-Celeborn is currently reused in > Hive-MR3-Uniffle, so we think there are many architectural similarities > between the two systems. > > We implemented our Celeborn extension first because a user of Hive-MR3 > wanted to use Celeborn which was already running in production. If any > industrial user of Hive-MR3 wants to use Uniffle in production, please let > us know. > > BTW, if you are using Hive-on-MapReduce or Hive-on-Tez, consider switching > to Hive-on-Tez. You will see a huge increase (x3 to x10) in throughput. > Ooops, I meant switching to Hive-on-MR3 :-) > Regards, > > --- Sungwoo > >
