GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/22333
[SPARK-25335][BUILD] Skip Zinc downloading if it's installed in the system
## What changes were proposed in this pull request?
Zinc is 23.5MB.
```
$ curl -LO https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
% Total % Received % Xferd Average Speed Time Time Time
Current
Dload Upload Total Spent Left
Speed
100 23.5M 100 23.5M 0 0 35.4M 0 --:--:-- --:--:-- --:--:--
35.3M
```
Currently, Spark downloads Zinc once. However, this PR aims to skip Zinc
downloading when the system already has it.
```
$ build/mvn clean
exec: curl --progress-bar -L
https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
########################################################################
100.0%
########################################################################
```
This will reduce many resources(CPU/Networks/DISK) at least in Mac and
Docker-based build system.
## How was this patch tested?
Pass the Jenkins.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dongjoon-hyun/spark SPARK-25335
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22333.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22333
----
commit ca9963477cb7cc1b9ff012222bc8adcd4a482a88
Author: Dongjoon Hyun <dongjoon@...>
Date: 2018-09-04T20:59:31Z
[SPARK-25335][BUILD] Skip Zinc downloading if it's installed in the system
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
