[
https://issues.apache.org/jira/browse/HIVE-29411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated HIVE-29411:
--------------------------------
Description:
Currently, Hive has a generic Docker image for HS2 + full execution as
implemented in HIVE-26400 and for HMS as implemented in HIVE-27275.
These images are wonderful for testing purposes and showcase, however, for real
distributed execution, we need to introduce further improvements, 2 ways to
achieve this:
1) LLAP execution - in a docker image, implemented here
HS2 -> TezAM -> Daemon
2) Tez container execution - in a docker image, implemented under TEZ-4662
HS2 -> TezAM -> TezContainer
Both 1) and 2) need TezAM container to be implemented under TEZ-4682, but 1) is
easier from Hive perspective, becuase for the Tez TezContainer docker mode, we
need TEZ-4665 also
Assuming that this jira and TEZ-4682 is resolved, one should able to deploy a
fully distributed hive warehouse with the components: HS2, HMS, TezAM,
LlapDaemon
was:
Currently, Hive has a generic Docker image for HS2 + full execution as
implemented in HIVE-26400 and for HMS as implemented in HIVE-27275.
These images are wonderful for testing purposes and showcase, however, for real
distributed execution, we need to introduce further improvements, 2 ways to
achieve this:
1. LLAP execution - in a docker image, implemented here
2. Tez container execution - in a docker image, implemented under TEZ-4662
> Provide docker image for LLAP
> -----------------------------
>
> Key: HIVE-29411
> URL: https://issues.apache.org/jira/browse/HIVE-29411
> Project: Hive
> Issue Type: Sub-task
> Reporter: László Bodor
> Priority: Major
>
> Currently, Hive has a generic Docker image for HS2 + full execution as
> implemented in HIVE-26400 and for HMS as implemented in HIVE-27275.
> These images are wonderful for testing purposes and showcase, however, for
> real distributed execution, we need to introduce further improvements, 2 ways
> to achieve this:
> 1) LLAP execution - in a docker image, implemented here
> HS2 -> TezAM -> Daemon
> 2) Tez container execution - in a docker image, implemented under TEZ-4662
> HS2 -> TezAM -> TezContainer
> Both 1) and 2) need TezAM container to be implemented under TEZ-4682, but 1)
> is easier from Hive perspective, becuase for the Tez TezContainer docker
> mode, we need TEZ-4665 also
> Assuming that this jira and TEZ-4682 is resolved, one should able to deploy a
> fully distributed hive warehouse with the components: HS2, HMS, TezAM,
> LlapDaemon
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
