maytasm commented on a change in pull request #9714: More Hadoop integration 
tests
URL: https://github.com/apache/druid/pull/9714#discussion_r409913930
 
 

 ##########
 File path: integration-tests/run_cluster.sh
 ##########
 @@ -74,17 +74,18 @@
   # For druid-kinesis-indexing-service
   mkdir -p $SHARED_DIR/docker/extensions/druid-kinesis-indexing-service
   mv $SHARED_DIR/docker/lib/druid-kinesis-indexing-service-* 
$SHARED_DIR/docker/extensions/druid-kinesis-indexing-service
-  $ For druid-parquet-extensions
+  # For druid-parquet-extensions
   mkdir -p $SHARED_DIR/docker/extensions/druid-parquet-extensions
   mv $SHARED_DIR/docker/lib/druid-parquet-extensions-* 
$SHARED_DIR/docker/extensions/druid-parquet-extensions
-  $ For druid-orc-extensions
+  # For druid-orc-extensions
   mkdir -p $SHARED_DIR/docker/extensions/druid-orc-extensions
   mv $SHARED_DIR/docker/lib/druid-orc-extensions-* 
$SHARED_DIR/docker/extensions/druid-orc-extensions
 
   # Pull Hadoop dependency if needed
   if [ -n "$DRUID_INTEGRATION_TEST_START_HADOOP_DOCKER" ] && [ 
"$DRUID_INTEGRATION_TEST_START_HADOOP_DOCKER" == true ]
   then
-    java -cp "$SHARED_DIR/docker/lib/*" 
-Ddruid.extensions.hadoopDependenciesDir="$SHARED_DIR/hadoop-dependencies" 
org.apache.druid.cli.Main tools pull-deps -h 
org.apache.hadoop:hadoop-client:2.8.5 -h org.apache.hadoop:hadoop-aws:2.8.5
+    java -cp "$SHARED_DIR/docker/lib/*" 
-Ddruid.extensions.hadoopDependenciesDir="$SHARED_DIR/hadoop-dependencies" 
org.apache.druid.cli.Main tools pull-deps -h 
org.apache.hadoop:hadoop-client:2.8.5 -h org.apache.hadoop:hadoop-aws:2.8.5 -h 
org.apache.hadoop:hadoop-azure:2.8.5
+    curl 
https://storage.googleapis.com/hadoop-lib/gcs/gcs-connector-hadoop2-latest.jar 
--output $SHARED_DIR/docker/lib/gcs-connector-hadoop2-latest.jar
 
 Review comment:
   Can we not get gcs-connector-hadoop from pull-deps too?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to