[
https://issues.apache.org/jira/browse/HIVE-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15533893#comment-15533893
]
Matt McCline commented on HIVE-14735:
-------------------------------------
{code}
...
[exec] arget/spark
[exec] + [[ ! -f ./../thirdparty/spark-1.6.0-bin-hadoop2-without-hive.tgz
]]
[exec] + local md5File=spark-1.6.0-bin-hadoop2-without-hive.tgz.md5sum
[exec] + curl -Sso
./../thirdparty/spark-1.6.0-bin-hadoop2-without-hive.tgz.md5sum
http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.6.0-bin-hadoop2-without-hive.tgz.md5sum
[exec] + cd ./../thirdparty
[exec] + md5sum -c spark-1.6.0-bin-hadoop2-without-hive.tgz.md5sum
[exec] ../target/download.sh: line 18: md5sum: command not found
[exec] + curl -Sso
./../thirdparty/spark-1.6.0-bin-hadoop2-without-hive.tgz
http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.6.0-bin-hadoop2-without-hive.tgz
[exec] + cd -
[exec] + tar -zxf ./../thirdparty/spark-1.6.0-bin-hadoop2-without-hive.tgz
-C ./target
[exec] /Users/mmccline/VecDetail/itests/qtest-spark
[exec] + mv ./target/spark-1.6.0-bin-hadoop2-without-hive ./target/spark
[exec] + cp -f ./target/../../..//data/conf/spark/log4j2.properties
./target/spark/conf/
{code}
After the "./target/download.sh: line 18: md5sum: command not found" line, the
download of "+ curl -Sso
./../thirdparty/spark-1.6.0-bin-hadoop2-without-hive.tgz " takes a very long
time and happens everytime. I tried downloading a version of md5sum and that
seems to make it worse -- the build went off and hung.
> Build Infra: Spark artifacts download takes a long time
> -------------------------------------------------------
>
> Key: HIVE-14735
> URL: https://issues.apache.org/jira/browse/HIVE-14735
> Project: Hive
> Issue Type: Bug
> Components: Build Infrastructure
> Reporter: Vaibhav Gumashta
>
> In particular this command:
> {{curl -Sso ./../thirdparty/spark-1.6.0-bin-hadoop2-without-hive.tgz
> http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.6.0-bin-hadoop2-without-hive.tgz}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
