[ 
https://issues.apache.org/jira/browse/HIVE-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15614347#comment-15614347
 ] 

Zoltan Haindrich commented on HIVE-14735:
-----------------------------------------

I think it would be better (and possibly more portable) to load this custom 
artifact by utilizing maven to download it from a maven repository..
This would also enable maven to cache this file in the local maven repo...which 
is not affected by {{git clean -dfx}}, and may reduce unneccessary network load.

Any problems with this?  - i can't put this this spark artifact into maven 
central (at least not under org.apache.spark) - someone would be intrested in 
putting it there - the best would be inside the spark project? ...or it doesn't 
matter where it comes from as long as it works ;)
hmm..i've just started wondering....how those cloudfront artifacts are deployed?

> Build Infra: Spark artifacts download takes a long time
> -------------------------------------------------------
>
>                 Key: HIVE-14735
>                 URL: https://issues.apache.org/jira/browse/HIVE-14735
>             Project: Hive
>          Issue Type: Bug
>          Components: Build Infrastructure
>            Reporter: Vaibhav Gumashta
>
> In particular this command:
> {{curl -Sso ./../thirdparty/spark-1.6.0-bin-hadoop2-without-hive.tgz 
> http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.6.0-bin-hadoop2-without-hive.tgz}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to