This is an automated email from the ASF dual-hosted git repository.
uwe pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/master by this push:
new 29f744f ARROW-2350: Consolidated RUN step in spark_integration
Dockerfile
29f744f is described below
commit 29f744f59d5907cebab07e9dd678e41e7f03e393
Author: James Lamb <[email protected]>
AuthorDate: Sun Mar 25 12:21:24 2018 +0200
ARROW-2350: Consolidated RUN step in spark_integration Dockerfile
I am a big fan of this project! In this PR, I propose a small change to the
`spark_integration` Dockerfile. See
[ARROW-2350](https://issues.apache.org/jira/browse/ARROW-2350) for a full
description of what I'm proposing here.
This change cuts the size of the `spark_integration` container from **2.65
GB** to **2.26 GB**.
Author: James Lamb <[email protected]>
Closes #1787 from jameslamb/smaller_docker and squashes the following
commits:
7343d8d <James Lamb> ARROW-2350: Consolidated RUN step in spark_integration
Dockerfile
---
dev/spark_integration/Dockerfile | 34 ++++++++++++++++++----------------
1 file changed, 18 insertions(+), 16 deletions(-)
diff --git a/dev/spark_integration/Dockerfile b/dev/spark_integration/Dockerfile
index d1b3cf8..f96ee35 100644
--- a/dev/spark_integration/Dockerfile
+++ b/dev/spark_integration/Dockerfile
@@ -17,24 +17,23 @@
FROM maven:3.5.2-jdk-8-slim
# Basic OS utilities
-RUN apt-get update && apt-get install -y \
+RUN apt-get update && \
+ apt-get install -y \
wget \
- git build-essential \
- software-properties-common
-
-# This will install conda in /home/ubuntu/miniconda
-RUN wget -O /tmp/miniconda.sh \
+ git \
+ build-essential \
+ software-properties-common && \
+ apt-get clean && \
+ # install conda in /home/ubuntu/miniconda
+ wget -O /tmp/miniconda.sh \
https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh && \
bash /tmp/miniconda.sh -b -p /home/ubuntu/miniconda && \
- rm /tmp/miniconda.sh
-
-# Python dependencies
-RUN apt-get install -y \
- pkg-config
-
-# Create Conda environment
-ENV PATH="/home/ubuntu/miniconda/bin:${PATH}"
-RUN conda create -y -q -n pyarrow-dev \
+ rm /tmp/miniconda.sh && \
+ # Python dependencies
+ apt-get install -y \
+ pkg-config && \
+ # Create Conda environment
+ /home/ubuntu/miniconda/bin/conda create -y -q -n pyarrow-dev \
# Python
python=2.7 \
numpy \
@@ -59,7 +58,10 @@ RUN conda create -y -q -n pyarrow-dev \
jemalloc \
lz4-c \
zstd \
- -c conda-forge
+ -c conda-forge && \
+ /home/ubuntu/miniconda/bin/conda clean --all
+
+ENV PATH="/home/ubuntu/miniconda/bin:${PATH}"
ADD . /apache-arrow
WORKDIR /apache-arrow
--
To stop receiving notification emails like this one, please contact
[email protected].
