[
https://issues.apache.org/jira/browse/HIVE-28683?focusedWorklogId=950598&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-950598
]
ASF GitHub Bot logged work on HIVE-28683:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 01/Jan/25 10:55
Start Date: 01/Jan/25 10:55
Worklog Time Spent: 10m
Work Description: BsoBird commented on code in PR #24:
URL: https://github.com/apache/hive-site/pull/24#discussion_r1900372758
##########
content/docs/latest/manual-installation_283118363.md:
##########
@@ -378,6 +379,76 @@ That directory should contain all the files necessary to
run Hive. You can run i
From now, you can follow the steps described in the section Installing Hive
from a Tarball
+## Installing with old version hadoop(>=3.1.0)
+
+Although we normally require hive4 to rely on a
+hadoop 3.3.6+ cluster environment.
+However, in practice, in an ON YARN environment,
+we can package all the hadoop related dependencies into
+tez&hive so that they do not need to rely on the lib
+of the original hadoop cluster environment at runtime.
+In this way, we can run HIVE4 in a lower version of hadoop,
+provided that the base APIs of the hadoop 3.x series are common to
+each other.
+
+The steps are as follows:
+
+1.Download the high version of the Hadoop package, unzip it, and then set the
hadoop_home finger of the env script in HIVE4 to the path where the high
version of hadoop is unzipped.
+
+2.Compile TEZ to get tez.tar.gz which contains all hadoop related
dependencies(not tez minimal tarball),
Review Comment:
> You can add more about how to` Compile TEZ to get tez.tar.gz which
contains all hadoop related dependencies`. Such as what mvn command can be used
to compile?
@done
##########
content/docs/latest/manual-installation_283118363.md:
##########
@@ -378,6 +379,76 @@ That directory should contain all the files necessary to
run Hive. You can run i
From now, you can follow the steps described in the section Installing Hive
from a Tarball
+## Installing with old version hadoop(>=3.1.0)
+
+Although we normally require hive4 to rely on a
+hadoop 3.3.6+ cluster environment.
+However, in practice, in an ON YARN environment,
+we can package all the hadoop related dependencies into
+tez&hive so that they do not need to rely on the lib
+of the original hadoop cluster environment at runtime.
+In this way, we can run HIVE4 in a lower version of hadoop,
+provided that the base APIs of the hadoop 3.x series are common to
+each other.
+
+The steps are as follows:
+
+1.Download the high version of the Hadoop package, unzip it, and then set the
hadoop_home finger of the env script in HIVE4 to the path where the high
version of hadoop is unzipped.
+
+2.Compile TEZ to get tez.tar.gz which contains all hadoop related
dependencies(not tez minimal tarball),
Review Comment:
> You can add more about how to` Compile TEZ to get tez.tar.gz which
contains all hadoop related dependencies`. Such as what mvn command can be used
to compile?
@zhangbutao done
Issue Time Tracking
-------------------
Worklog Id: (was: 950598)
Time Spent: 3h 10m (was: 3h)
> Add doc for install hive4 with old version hadoop
> -------------------------------------------------
>
> Key: HIVE-28683
> URL: https://issues.apache.org/jira/browse/HIVE-28683
> Project: Hive
> Issue Type: Task
> Reporter: yongzhi.shao
> Priority: Major
> Labels: pull-request-available
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> Currently, many users want to upgrade to HIVE4, but they are often limited by
> the fact that the version of their existing HADOOP cluster is too low to
> upgrade to HIVE4. But in fact, HIVE4 can work with lower versions of
> HADOOP.We should improve the documentation to show these users how to upgrade
> to HIVE4.
>
> see [Running Hive4 in low-version Hadoop environments.-Apache Mail
> Archives|https://lists.apache.org/thread/f6j6jnk9qnbgywj4c24lql0l7x1p1yv4]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
