Repository: arrow Updated Branches: refs/heads/master 6e5f7be10 -> a9a80fef7
ARROW-941: Add "cold start" instructions for running integration tests This is helpful for users who do not regularly use Python. Author: Wes McKinney <[email protected]> Closes #1061 from wesm/ARROW-941 and squashes the following commits: 5f18cd7 [Wes McKinney] Add environment setup instruction for integration tests for users without any Python environment already Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow/commit/a9a80fef Tree: http://git-wip-us.apache.org/repos/asf/arrow/tree/a9a80fef Diff: http://git-wip-us.apache.org/repos/asf/arrow/diff/a9a80fef Branch: refs/heads/master Commit: a9a80fef7f930ac7141f3c02f2b1dfbb98dfdd1d Parents: 6e5f7be Author: Wes McKinney <[email protected]> Authored: Thu Sep 7 18:40:48 2017 +0200 Committer: Uwe L. Korn <[email protected]> Committed: Thu Sep 7 18:40:48 2017 +0200 ---------------------------------------------------------------------- integration/README.md | 31 +++++++++++++++++++++++++++++-- 1 file changed, 29 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/arrow/blob/a9a80fef/integration/README.md ---------------------------------------------------------------------- diff --git a/integration/README.md b/integration/README.md index 5b6ea45..6e5a6c1 100644 --- a/integration/README.md +++ b/integration/README.md @@ -30,6 +30,31 @@ Our strategy for integration testing between Arrow implementations is as follows * The test executable is also capable of validating the contents of a binary file against a corresponding JSON file +## Environment setup + +The integration test data generator and runner is written in Python and +currently requires Python 3.5 or higher. You can create a standalone Python +distribution and environment for running the tests by using [miniconda][1]. On +Linux this is: + +```shell +MINICONDA_URL=https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh +wget -O miniconda.sh $MINICONDA_URL +bash miniconda.sh -b -p miniconda +export PATH=`pwd`/miniconda/bin:$PATH + +conda create -n arrow-integration python=3.6 nomkl numpy six +source activate arrow-integration +``` + +If you are on macOS, instead use the URL: + +```shell +MINICONDA_URL=https://repo.continuum.io/miniconda/Miniconda3-latest-MacOSX-x86_64.sh +``` + +After this, you can follow the instructions in the next section. + ## Running the existing integration tests First, build the Java and C++ projects. For Java, you must run @@ -43,7 +68,7 @@ Java `arrow-tool` JAR and the build path for the C++ executables: ```bash JAVA_DIR=$ARROW_HOME/java -CPP_BUILD_DIR=$ARROW_HOME/cpp/test-build +CPP_BUILD_DIR=$ARROW_HOME/cpp/build VERSION=0.1.1-SNAPSHOT export ARROW_JAVA_INTEGRATION_JAR=$JAVA_DIR/tools/target/arrow-tools-$VERSION-jar-with-dependencies.jar @@ -61,4 +86,6 @@ for additional output) python integration_test.py python integration_test.py --debug # additional output -``` \ No newline at end of file +``` + +[1]: https://conda.io/miniconda.html \ No newline at end of file
