This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 7bb9ca91c87 [branch-2.1](fix) adjust data download url about hive
docker (#40846)
7bb9ca91c87 is described below
commit 7bb9ca91c8706e681a3f8062c5e317039153cf0f
Author: Socrates <[email protected]>
AuthorDate: Sat Sep 14 23:19:54 2024 +0800
[branch-2.1](fix) adjust data download url about hive docker (#40846)
## Proposed changes
fix paimon regression test
Co-authored-by: Dongyang Li <[email protected]>
Co-authored-by: stephen <[email protected]>
---
.../docker-compose/hive/scripts/hive-metastore.sh | 21 +++++++++------------
1 file changed, 9 insertions(+), 12 deletions(-)
diff --git a/docker/thirdparties/docker-compose/hive/scripts/hive-metastore.sh
b/docker/thirdparties/docker-compose/hive/scripts/hive-metastore.sh
index 8338f467952..aa27516164e 100755
--- a/docker/thirdparties/docker-compose/hive/scripts/hive-metastore.sh
+++ b/docker/thirdparties/docker-compose/hive/scripts/hive-metastore.sh
@@ -40,7 +40,7 @@ find "${DATA_DIR}" -type f -name "run.sh" -print0 | xargs -0
-n 1 -P 10 -I {} sh
if [[ ! -d "/mnt/scripts/tpch1.db" ]]; then
echo "/mnt/scripts/tpch1.db does not exist"
cd /mnt/scripts/
- curl -O
https://doris-build-hk-1308700295.cos.ap-hongkong.myqcloud.com/regression/datalake/pipeline_data/tpch1.db.tar.gz
+ curl -O
https://doris-regression-hk.oss-cn-hongkong.aliyuncs.com/regression/datalake/pipeline_data/tpch1.db.tar.gz
tar -zxf tpch1.db.tar.gz
rm -rf tpch1.db.tar.gz
cd -
@@ -53,17 +53,14 @@ fi
hadoop fs -mkdir -p /user/doris/
hadoop fs -put /mnt/scripts/tpch1.db /user/doris/
-# if you test in your local，better use # to annotation section about paimon
-if [[ ! -d "/mnt/scripts/paimon1" ]]; then
- echo "/mnt/scripts/paimon1 does not exist"
- cd /mnt/scripts/
- curl -O
https://doris-build-hk-1308700295.cos.ap-hongkong.myqcloud.com/regression/datalake/pipeline_data/paimon1.tar.gz
- tar -zxf paimon1.tar.gz
- rm -rf paimon1.tar.gz
- cd -
-else
- echo "/mnt/scripts/paimon1 exist, continue !"
-fi
+# paimon data file is small and update frequently, so we download it every time
+rm -rf "/mnt/scripts/paimon1"
+echo "/mnt/scripts/paimon1 does not exist"
+cd /mnt/scripts/
+curl -O
https://doris-regression-hk.oss-cn-hongkong.aliyuncs.com/regression/datalake/pipeline_data/paimon1.tar.gz
+tar -zxf paimon1.tar.gz
+rm -rf paimon1.tar.gz
+cd -
## put paimon1
hadoop fs -put /mnt/scripts/paimon1 /user/doris/
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
