[
https://issues.apache.org/jira/browse/IMPALA-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17796525#comment-17796525
]
ASF subversion and git services commented on IMPALA-11157:
----------------------------------------------------------
Commit 9bc4d38eb9a746a379bd650256487ecef3e8eeaa in impala's branch
refs/heads/master from Michael Smith
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=9bc4d38eb ]
IMPALA-11157: Switch to hadoop-client build
The hadoop build only produces client binaries, not a full hadoop build.
The name was therefore misleading, and could not replace the full build
of hadoop required by Impala. Impala's toolchain bootstrap process would
then fail if we tried to include two packages named "hadoop" when
overriding the download URL via IMPALA_HADOOP_URL.
Renames hadoop to hadoop-client to clarify its contents and avoid
conflicts with a full hadoop build.
Change-Id: Ia50b5151e5339b06ae2b623a4b2090ae6708491f
Reviewed-on: http://gerrit.cloudera.org:8080/20779
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Joe McDonnell <[email protected]>
Reviewed-by: Quanlong Huang <[email protected]>
> Build native Hadoop libraries for aarch64
> -----------------------------------------
>
> Key: IMPALA-11157
> URL: https://issues.apache.org/jira/browse/IMPALA-11157
> Project: IMPALA
> Issue Type: Task
> Affects Versions: Impala 4.0.0
> Reporter: Quanlong Huang
> Assignee: Michael Smith
> Priority: Major
> Labels: arm
> Fix For: Impala 4.4.0
>
>
> When building on aarch64, the build script downloads some libs from a
> personal github repo:
> [https://github.com/apache/impala/blob/374783c55ebdb07fbf669c2c5d80c4b01eb39d2b/buildall.sh#L411-L412]
> {code:bash}
> # Create soft link to locally builded native-toolchain on aarch64
> if [[ "$(uname -p)" = "aarch64" ]]; then
> mkdir -p $IMPALA_TOOLCHAIN_PACKAGES_HOME
> cd "$IMPALA_TOOLCHAIN_PACKAGES_HOME"
> ln -f -s ${NATIVE_TOOLCHAIN_HOME}/build/* .
> cd -
> if ! [[ -d "$IMPALA_HOME/../hadoopAarch64NativeLibs" ]]; then
> git clone https://github.com/zhaorenhai/hadoopAarch64NativeLibs \
> "$IMPALA_HOME/../hadoopAarch64NativeLibs"
> fi
> cp $IMPALA_HOME/../hadoopAarch64NativeLibs/lib*
> $HADOOP_HOME/lib/native/
> fi{code}
> We should download those libs using offical URLs.
> CC [~RenhaiZhao], [~huangtianhua]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
