Quanlong Huang has posted comments on this change. ( http://gerrit.cloudera.org:8080/18977 )
Change subject: IMPALA-10408: Support build using Apache components ...................................................................... Patch Set 24: (1 comment) > Patch Set 24: Verified-1 > > Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/10862/ I think the failure is unrelated to this patch: https://jenkins.impala.io/job/ubuntu-20.04-from-scratch/3166/testReport/junit/query_test.test_mem_usage_scaling/TestTpchPrimitivesMemLimitError/test_low_mem_limit_orderby_all_mem_limit__100___protocol__beeswax___exec_option____test_replan___1___batch_size___0___num_nodes___0___disable_codegen_rows_threshold___0___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__parquet_none_/ We can rerun the job. But it'd be nice to also fix the hbase issue. http://gerrit.cloudera.org:8080/#/c/18977/24/bin/bootstrap_toolchain.py File bin/bootstrap_toolchain.py: http://gerrit.cloudera.org:8080/#/c/18977/24/bin/bootstrap_toolchain.py@520 PS24, Line 520: hbase = ApacheComponent("hbase", : component_path_tmpl="${name}/${version}/", : archive_basename_tmpl="${name}-${version}-bin", : unpack_directory_tmpl="${name}-${version}") I found the same issue of HBASE-26734 that I can't use HBase though testdata/bin/run-hbase.sh succeeds. The reason is HMaster can't become active due to incompatibilty with Hadoop 3.3.6 we used in the minicluster. The tarball distributed by the HBase website is compiled with Hadoop 2.10.0. When I recompile HBase 2.4.17 with Hadoop 3.3.6, the issue is resolved. The command to compile HBase is (run in hbase repo): mvn -Dhadoop.profile=3.0 -Dhadoop-three.version=3.3.6 -DskipTests package assembly:single To be convenient, I also uploaded the tarballs to the native-toolchain bucket: https://native-toolchain.s3.amazonaws.com/build/apache_components/tarballs/hbase-2.4.17-hadoop-3.3.6-bin.tar.gz The client tarball hbase-2.4.17-hadoop-3.3.6-client-bin.tar.gz is also uploaded in the same folder but maybe we don't need it. Let's use the HBase 2.4.17 tarball from the native-toolchain bucket. -- To view, visit http://gerrit.cloudera.org:8080/18977 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I8730dd182b367c9daa94303937ad249db72b1399 Gerrit-Change-Number: 18977 Gerrit-PatchSet: 24 Gerrit-Owner: Anonymous Coward <[email protected]> Gerrit-Reviewer: Anonymous Coward <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Comment-Date: Thu, 15 Aug 2024 12:33:58 +0000 Gerrit-HasComments: Yes
