[jira] [Commented] (ARROW-2093) [Python] Possibly do not test pytorch serialization in Travis CI
[ https://issues.apache.org/jira/browse/ARROW-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373753#comment-16373753 ] ASF GitHub Bot commented on ARROW-2093: --- wesm closed pull request #1637: ARROW-2093: [Python] Do not install PyTorch in Travis CI URL: https://github.com/apache/arrow/pull/1637 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/ci/travis_script_python.sh b/ci/travis_script_python.sh index a487da596..9ed5825bb 100755 --- a/ci/travis_script_python.sh +++ b/ci/travis_script_python.sh @@ -43,11 +43,14 @@ conda install -y -q pip \ pandas \ cython -if [ "$PYTHON_VERSION" != "2.7" ] || [ $TRAVIS_OS_NAME != "osx" ]; then - # Install pytorch for torch tensor conversion tests - # PyTorch seems to be broken on Python 2.7 on macOS so we skip it - conda install -y -q pytorch torchvision -c soumith -fi +# ARROW-2093: PyTorch increases the size of our conda dependency stack +# significantly, and so we have disabled these tests in Travis CI for now + +# if [ "$PYTHON_VERSION" != "2.7" ] || [ $TRAVIS_OS_NAME != "osx" ]; then +# # Install pytorch for torch tensor conversion tests +# # PyTorch seems to be broken on Python 2.7 on macOS so we skip it +# conda install -y -q pytorch torchvision -c soumith +# fi # Build C++ libraries mkdir -p $ARROW_CPP_BUILD_DIR This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > [Python] Possibly do not test pytorch serialization in Travis CI > > > Key: ARROW-2093 > URL: https://issues.apache.org/jira/browse/ARROW-2093 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Wes McKinney >Assignee: Wes McKinney >Priority: Major > Labels: pull-request-available > Fix For: 0.9.0 > > > I am not sure it is worth downloading ~400MB in binaries > {code} > The following packages will be downloaded: > package|build > ---|- > libgcc-5.2.0 |0 1.1 MB defaults > pillow-5.0.0 | py27_0 958 KB conda-forge > libtiff-4.0.9 |0 511 KB conda-forge > libtorch-0.1.12| nomkl_0 1.7 MB defaults > olefile-0.44 | py27_0 50 KB conda-forge > torchvision-0.1.9 | py27hdb88a65_1 86 KB soumith > openblas-0.2.19|214.1 MB conda-forge > numpy-1.13.1 |py27_blas_openblas_200 8.4 MB > conda-forge > pytorch-0.2.0 |py27ha262b23_4cu75 312.2 MB soumith > mkl-2017.0.3 |0 129.5 MB defaults > >Total: 468.6 MB > {code} > Follow up from ARROW-2071 https://github.com/apache/arrow/pull/1561 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ARROW-2093) [Python] Possibly do not test pytorch serialization in Travis CI
[ https://issues.apache.org/jira/browse/ARROW-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373750#comment-16373750 ] ASF GitHub Bot commented on ARROW-2093: --- wesm commented on issue #1637: ARROW-2093: [Python] Do not install PyTorch in Travis CI URL: https://github.com/apache/arrow/pull/1637#issuecomment-367873718 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > [Python] Possibly do not test pytorch serialization in Travis CI > > > Key: ARROW-2093 > URL: https://issues.apache.org/jira/browse/ARROW-2093 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Wes McKinney >Assignee: Wes McKinney >Priority: Major > Labels: pull-request-available > Fix For: 0.9.0 > > > I am not sure it is worth downloading ~400MB in binaries > {code} > The following packages will be downloaded: > package|build > ---|- > libgcc-5.2.0 |0 1.1 MB defaults > pillow-5.0.0 | py27_0 958 KB conda-forge > libtiff-4.0.9 |0 511 KB conda-forge > libtorch-0.1.12| nomkl_0 1.7 MB defaults > olefile-0.44 | py27_0 50 KB conda-forge > torchvision-0.1.9 | py27hdb88a65_1 86 KB soumith > openblas-0.2.19|214.1 MB conda-forge > numpy-1.13.1 |py27_blas_openblas_200 8.4 MB > conda-forge > pytorch-0.2.0 |py27ha262b23_4cu75 312.2 MB soumith > mkl-2017.0.3 |0 129.5 MB defaults > >Total: 468.6 MB > {code} > Follow up from ARROW-2071 https://github.com/apache/arrow/pull/1561 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ARROW-2093) [Python] Possibly do not test pytorch serialization in Travis CI
[ https://issues.apache.org/jira/browse/ARROW-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371748#comment-16371748 ] ASF GitHub Bot commented on ARROW-2093: --- wesm opened a new pull request #1637: ARROW-2093: [Python] Do not install PyTorch in Travis CI URL: https://github.com/apache/arrow/pull/1637 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > [Python] Possibly do not test pytorch serialization in Travis CI > > > Key: ARROW-2093 > URL: https://issues.apache.org/jira/browse/ARROW-2093 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Wes McKinney >Assignee: Wes McKinney >Priority: Major > Labels: pull-request-available > Fix For: 0.9.0 > > > I am not sure it is worth downloading ~400MB in binaries > {code} > The following packages will be downloaded: > package|build > ---|- > libgcc-5.2.0 |0 1.1 MB defaults > pillow-5.0.0 | py27_0 958 KB conda-forge > libtiff-4.0.9 |0 511 KB conda-forge > libtorch-0.1.12| nomkl_0 1.7 MB defaults > olefile-0.44 | py27_0 50 KB conda-forge > torchvision-0.1.9 | py27hdb88a65_1 86 KB soumith > openblas-0.2.19|214.1 MB conda-forge > numpy-1.13.1 |py27_blas_openblas_200 8.4 MB > conda-forge > pytorch-0.2.0 |py27ha262b23_4cu75 312.2 MB soumith > mkl-2017.0.3 |0 129.5 MB defaults > >Total: 468.6 MB > {code} > Follow up from ARROW-2071 https://github.com/apache/arrow/pull/1561 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ARROW-2093) [Python] Possibly do not test pytorch serialization in Travis CI
[ https://issues.apache.org/jira/browse/ARROW-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353062#comment-16353062 ] Antoine Pitrou commented on ARROW-2093: --- Also note the builds we're fetching don't seem to work (or not always?): {code} SKIP [1] /home/travis/build/apache/arrow/pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_serialization.py:353: could not import 'torch' {code} Tried to reproduce locally: {code} $ python -c "import torch" Traceback (most recent call last): File "", line 1, in File "/home/antoine/miniconda3/envs/ttt/lib/python3.6/site-packages/torch/__init__.py", line 53, in from torch._C import * ImportError: /home/antoine/miniconda3/envs/ttt/lib/python3.6/site-packages/torch/lib/libTHC.so.1: undefined symbol: THLongStorage_inferSizeN {code} > [Python] Possibly do not test pytorch serialization in Travis CI > > > Key: ARROW-2093 > URL: https://issues.apache.org/jira/browse/ARROW-2093 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Wes McKinney >Priority: Major > Fix For: 0.9.0 > > > I am not sure it is worth downloading ~400MB in binaries > {code} > The following packages will be downloaded: > package|build > ---|- > libgcc-5.2.0 |0 1.1 MB defaults > pillow-5.0.0 | py27_0 958 KB conda-forge > libtiff-4.0.9 |0 511 KB conda-forge > libtorch-0.1.12| nomkl_0 1.7 MB defaults > olefile-0.44 | py27_0 50 KB conda-forge > torchvision-0.1.9 | py27hdb88a65_1 86 KB soumith > openblas-0.2.19|214.1 MB conda-forge > numpy-1.13.1 |py27_blas_openblas_200 8.4 MB > conda-forge > pytorch-0.2.0 |py27ha262b23_4cu75 312.2 MB soumith > mkl-2017.0.3 |0 129.5 MB defaults > >Total: 468.6 MB > {code} > Follow up from ARROW-2071 https://github.com/apache/arrow/pull/1561 -- This message was sent by Atlassian JIRA (v7.6.3#76005)