Re: [Announce] Hive-MR3: Hive running on top of MR3

2018-04-05 Thread Sungwoo Park
Yes, the idea is almost the same -- LLAP daemons can accept tasks from different Tez AMs, whereas MR3 containers can accept tasks from different DAGs. A minor difference is that in the case of MR3, a single shared AM can manage multiple concurrent DAGs. As a result, there is no need to start a new

Re: [Announce] Hive-MR3: Hive running on top of MR3

2018-04-04 Thread Thai Bui
It would be interesting to see how this compares to Hive LLAP on Tez. Since the llap daemons contain a queue of tasks that is shared amongst many Tez AMs, it could have similar characteristics to the way MR3 is sharing the containers between the AMs. On Wed, Apr 4, 2018 at 10:06 AM Sungwoo Park

[Announce] Hive-MR3: Hive running on top of MR3

2018-04-04 Thread Sungwoo Park
Hello Hive users, I am pleased to announce MR3 and Hive-MR3. Please visit the following webpage for everything on MR3 and Hive-MR3: https://mr3.postech.ac.kr/ http://datamonad.com Here is a description of MR3 and Hive-MR3 from the webpage: MR3 is a new execution engine for Hadoop. Similar in