This is an automated email from the ASF dual-hosted git repository.
karan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/druid.git
The following commit(s) were added to refs/heads/master by this push:
new 7c13c5256ed Modify hadoop IT copy_hadoop_resources script to force an
hdfs put operation (#17926)
7c13c5256ed is described below
commit 7c13c5256edf7e429342492936c316d370800d75
Author: Lucas Capistrant <[email protected]>
AuthorDate: Tue Apr 15 23:29:49 2025 -0500
Modify hadoop IT copy_hadoop_resources script to force an hdfs put
operation (#17926)
This avoids the script failing if the file already exists which solves some
potential CI issues
---
integration-tests/script/copy_hadoop_resources.sh | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/integration-tests/script/copy_hadoop_resources.sh
b/integration-tests/script/copy_hadoop_resources.sh
index fcd97b1d9bb..ff2754a09ae 100755
--- a/integration-tests/script/copy_hadoop_resources.sh
+++ b/integration-tests/script/copy_hadoop_resources.sh
@@ -51,7 +51,7 @@ docker exec -t druid-it-hadoop sh -c
"./usr/local/hadoop/bin/hdfs dfs -chmod 777
docker exec -t druid-it-hadoop sh -c "./usr/local/hadoop/bin/hdfs dfs -chmod
-R 777 /tmp"
docker exec -t druid-it-hadoop sh -c "./usr/local/hadoop/bin/hdfs dfs -chmod
-R 777 /user"
# Copy data files to Hadoop container
-docker exec -t druid-it-hadoop sh -c "./usr/local/hadoop/bin/hdfs dfs -put
/shared/wikiticker-it/wikiticker-2015-09-12-sampled.json.gz
/quickstart/wikiticker-2015-09-12-sampled.json.gz"
+docker exec -t druid-it-hadoop sh -c "./usr/local/hadoop/bin/hdfs dfs -put -f
/shared/wikiticker-it/wikiticker-2015-09-12-sampled.json.gz
/quickstart/wikiticker-2015-09-12-sampled.json.gz"
docker exec -t druid-it-hadoop sh -c "./usr/local/hadoop/bin/hdfs dfs -put
/resources/data/batch_index /batch_index"
echo "Finished setting up druid hadoop dirs"
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
