[jira] [Commented] (ARROW-2093) [Python] Possibly do not test pytorch serialization in Travis CI
[
https://issues.apache.org/jira/browse/ARROW-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373753#comment-16373753
]
ASF GitHub Bot commented on ARROW-2093:
---
wesm closed pull request #1637: ARROW-2093: [Python] Do not install PyTorch in
Travis CI
URL: https://github.com/apache/arrow/pull/1637
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git a/ci/travis_script_python.sh b/ci/travis_script_python.sh
index a487da596..9ed5825bb 100755
--- a/ci/travis_script_python.sh
+++ b/ci/travis_script_python.sh
@@ -43,11 +43,14 @@ conda install -y -q pip \
pandas \
cython
-if [ "$PYTHON_VERSION" != "2.7" ] || [ $TRAVIS_OS_NAME != "osx" ]; then
- # Install pytorch for torch tensor conversion tests
- # PyTorch seems to be broken on Python 2.7 on macOS so we skip it
- conda install -y -q pytorch torchvision -c soumith
-fi
+# ARROW-2093: PyTorch increases the size of our conda dependency stack
+# significantly, and so we have disabled these tests in Travis CI for now
+
+# if [ "$PYTHON_VERSION" != "2.7" ] || [ $TRAVIS_OS_NAME != "osx" ]; then
+# # Install pytorch for torch tensor conversion tests
+# # PyTorch seems to be broken on Python 2.7 on macOS so we skip it
+# conda install -y -q pytorch torchvision -c soumith
+# fi
# Build C++ libraries
mkdir -p $ARROW_CPP_BUILD_DIR
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [Python] Possibly do not test pytorch serialization in Travis CI
>
>
> Key: ARROW-2093
> URL: https://issues.apache.org/jira/browse/ARROW-2093
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> I am not sure it is worth downloading ~400MB in binaries
> {code}
> The following packages will be downloaded:
> package|build
> ---|-
> libgcc-5.2.0 |0 1.1 MB defaults
> pillow-5.0.0 | py27_0 958 KB conda-forge
> libtiff-4.0.9 |0 511 KB conda-forge
> libtorch-0.1.12| nomkl_0 1.7 MB defaults
> olefile-0.44 | py27_0 50 KB conda-forge
> torchvision-0.1.9 | py27hdb88a65_1 86 KB soumith
> openblas-0.2.19|214.1 MB conda-forge
> numpy-1.13.1 |py27_blas_openblas_200 8.4 MB
> conda-forge
> pytorch-0.2.0 |py27ha262b23_4cu75 312.2 MB soumith
> mkl-2017.0.3 |0 129.5 MB defaults
>
>Total: 468.6 MB
> {code}
> Follow up from ARROW-2071 https://github.com/apache/arrow/pull/1561
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-2093) [Python] Possibly do not test pytorch serialization in Travis CI
[
https://issues.apache.org/jira/browse/ARROW-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373750#comment-16373750
]
ASF GitHub Bot commented on ARROW-2093:
---
wesm commented on issue #1637: ARROW-2093: [Python] Do not install PyTorch in
Travis CI
URL: https://github.com/apache/arrow/pull/1637#issuecomment-367873718
+1
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [Python] Possibly do not test pytorch serialization in Travis CI
>
>
> Key: ARROW-2093
> URL: https://issues.apache.org/jira/browse/ARROW-2093
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> I am not sure it is worth downloading ~400MB in binaries
> {code}
> The following packages will be downloaded:
> package|build
> ---|-
> libgcc-5.2.0 |0 1.1 MB defaults
> pillow-5.0.0 | py27_0 958 KB conda-forge
> libtiff-4.0.9 |0 511 KB conda-forge
> libtorch-0.1.12| nomkl_0 1.7 MB defaults
> olefile-0.44 | py27_0 50 KB conda-forge
> torchvision-0.1.9 | py27hdb88a65_1 86 KB soumith
> openblas-0.2.19|214.1 MB conda-forge
> numpy-1.13.1 |py27_blas_openblas_200 8.4 MB
> conda-forge
> pytorch-0.2.0 |py27ha262b23_4cu75 312.2 MB soumith
> mkl-2017.0.3 |0 129.5 MB defaults
>
>Total: 468.6 MB
> {code}
> Follow up from ARROW-2071 https://github.com/apache/arrow/pull/1561
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-2093) [Python] Possibly do not test pytorch serialization in Travis CI
[
https://issues.apache.org/jira/browse/ARROW-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371748#comment-16371748
]
ASF GitHub Bot commented on ARROW-2093:
---
wesm opened a new pull request #1637: ARROW-2093: [Python] Do not install
PyTorch in Travis CI
URL: https://github.com/apache/arrow/pull/1637
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [Python] Possibly do not test pytorch serialization in Travis CI
>
>
> Key: ARROW-2093
> URL: https://issues.apache.org/jira/browse/ARROW-2093
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> I am not sure it is worth downloading ~400MB in binaries
> {code}
> The following packages will be downloaded:
> package|build
> ---|-
> libgcc-5.2.0 |0 1.1 MB defaults
> pillow-5.0.0 | py27_0 958 KB conda-forge
> libtiff-4.0.9 |0 511 KB conda-forge
> libtorch-0.1.12| nomkl_0 1.7 MB defaults
> olefile-0.44 | py27_0 50 KB conda-forge
> torchvision-0.1.9 | py27hdb88a65_1 86 KB soumith
> openblas-0.2.19|214.1 MB conda-forge
> numpy-1.13.1 |py27_blas_openblas_200 8.4 MB
> conda-forge
> pytorch-0.2.0 |py27ha262b23_4cu75 312.2 MB soumith
> mkl-2017.0.3 |0 129.5 MB defaults
>
>Total: 468.6 MB
> {code}
> Follow up from ARROW-2071 https://github.com/apache/arrow/pull/1561
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-2093) [Python] Possibly do not test pytorch serialization in Travis CI
[
https://issues.apache.org/jira/browse/ARROW-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353062#comment-16353062
]
Antoine Pitrou commented on ARROW-2093:
---
Also note the builds we're fetching don't seem to work (or not always?):
{code}
SKIP [1]
/home/travis/build/apache/arrow/pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_serialization.py:353:
could not import 'torch'
{code}
Tried to reproduce locally:
{code}
$ python -c "import torch"
Traceback (most recent call last):
File "", line 1, in
File
"/home/antoine/miniconda3/envs/ttt/lib/python3.6/site-packages/torch/__init__.py",
line 53, in
from torch._C import *
ImportError:
/home/antoine/miniconda3/envs/ttt/lib/python3.6/site-packages/torch/lib/libTHC.so.1:
undefined symbol: THLongStorage_inferSizeN
{code}
> [Python] Possibly do not test pytorch serialization in Travis CI
>
>
> Key: ARROW-2093
> URL: https://issues.apache.org/jira/browse/ARROW-2093
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
>Reporter: Wes McKinney
>Priority: Major
> Fix For: 0.9.0
>
>
> I am not sure it is worth downloading ~400MB in binaries
> {code}
> The following packages will be downloaded:
> package|build
> ---|-
> libgcc-5.2.0 |0 1.1 MB defaults
> pillow-5.0.0 | py27_0 958 KB conda-forge
> libtiff-4.0.9 |0 511 KB conda-forge
> libtorch-0.1.12| nomkl_0 1.7 MB defaults
> olefile-0.44 | py27_0 50 KB conda-forge
> torchvision-0.1.9 | py27hdb88a65_1 86 KB soumith
> openblas-0.2.19|214.1 MB conda-forge
> numpy-1.13.1 |py27_blas_openblas_200 8.4 MB
> conda-forge
> pytorch-0.2.0 |py27ha262b23_4cu75 312.2 MB soumith
> mkl-2017.0.3 |0 129.5 MB defaults
>
>Total: 468.6 MB
> {code}
> Follow up from ARROW-2071 https://github.com/apache/arrow/pull/1561
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
