[jira] [Commented] (ARROW-230) Python: Do not name modules like native ones (i.e. rename pyarrow.io)

2016-10-28 Thread Wes McKinney (JIRA) 

[ 
https://issues.apache.org/jira/browse/ARROW-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15617170#comment-15617170
 ] 

Wes McKinney commented on ARROW-230:


This problem should be fixed by https://github.com/apache/arrow/pull/187

> Python: Do not name modules like native ones (i.e. rename pyarrow.io)
> -
>
> Key: ARROW-230
> URL: https://issues.apache.org/jira/browse/ARROW-230
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Uwe L. Korn
>
> Although you can rename it in imports, still weird stuff can happen.
> E.g. if you re-run make in the build directory (only happens probably if you 
> change pyarrow's CMakeLists.txt and do not call it via setup.py) you will get 
> the following error:
> {noformat}
> -- Found Python lib /usr/lib/x86_64-linux-gnu/libpython2.7.so
> CMake Error at cmake_modules/FindNumPy.cmake:62 (message):
>   NumPy import failure:
>   Traceback (most recent call last):
> File "", line 1, in 
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/__init__.py",
>  line 180, in 
>   from . import add_newdocs
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/add_newdocs.py",
>  line 13, in 
>   from numpy.lib import add_newdoc
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/__init__.py",
>  line 8, in 
>   from .type_check import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/type_check.py",
>  line 11, in 
>   import numpy.core.numeric as _nx
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/core/__init__.py",
>  line 58, in 
>   from numpy.testing import Tester
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/__init__.py",
>  line 14, in 
>   from .utils import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/utils.py",
>  line 15, in 
>   from tempfile import mkdtemp
> File "/usr/lib/python2.7/tempfile.py", line 32, in 
>   import io as _io
>   ImportError:
>   
> /home/uwe/Development/arrow/python/build/temp.linux-x86_64-2.7/./libpyarrow.so:
>   undefined symbol: pyarrow_ARRAY_API
> Call Stack (most recent call first):
>   CMakeLists.txt:223 (find_package)
> {noformat}
> The actual error message here is confusing but the basic problem is that here 
> the wrong io module is imported. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ARROW-230) Python: Do not name modules like native ones (i.e. rename pyarrow.io)

2016-10-19 Thread Jim Pivarski (JIRA) 

[ 
https://issues.apache.org/jira/browse/ARROW-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589997#comment-15589997
 ] 

Jim Pivarski commented on ARROW-230:


I didn't have any luck with that, but it's a different issue, so I created it 
here: [https://issues.apache.org/jira/browse/ARROW-344].

> Python: Do not name modules like native ones (i.e. rename pyarrow.io)
> -
>
> Key: ARROW-230
> URL: https://issues.apache.org/jira/browse/ARROW-230
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Uwe L. Korn
>
> Although you can rename it in imports, still weird stuff can happen.
> E.g. if you re-run make in the build directory (only happens probably if you 
> change pyarrow's CMakeLists.txt and do not call it via setup.py) you will get 
> the following error:
> {noformat}
> -- Found Python lib /usr/lib/x86_64-linux-gnu/libpython2.7.so
> CMake Error at cmake_modules/FindNumPy.cmake:62 (message):
>   NumPy import failure:
>   Traceback (most recent call last):
> File "", line 1, in 
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/__init__.py",
>  line 180, in 
>   from . import add_newdocs
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/add_newdocs.py",
>  line 13, in 
>   from numpy.lib import add_newdoc
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/__init__.py",
>  line 8, in 
>   from .type_check import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/type_check.py",
>  line 11, in 
>   import numpy.core.numeric as _nx
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/core/__init__.py",
>  line 58, in 
>   from numpy.testing import Tester
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/__init__.py",
>  line 14, in 
>   from .utils import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/utils.py",
>  line 15, in 
>   from tempfile import mkdtemp
> File "/usr/lib/python2.7/tempfile.py", line 32, in 
>   import io as _io
>   ImportError:
>   
> /home/uwe/Development/arrow/python/build/temp.linux-x86_64-2.7/./libpyarrow.so:
>   undefined symbol: pyarrow_ARRAY_API
> Call Stack (most recent call first):
>   CMakeLists.txt:223 (find_package)
> {noformat}
> The actual error message here is confusing but the basic problem is that here 
> the wrong io module is imported. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ARROW-230) Python: Do not name modules like native ones (i.e. rename pyarrow.io)

2016-10-19 Thread Wes McKinney (JIRA) 

[ 
https://issues.apache.org/jira/browse/ARROW-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588846#comment-15588846
 ] 

Wes McKinney commented on ARROW-230:


Note that you can get up and running by setting up a conda environment (which 
shouldn't have this issue) instead of using system Python + 
setuptools/virtualenv

> Python: Do not name modules like native ones (i.e. rename pyarrow.io)
> -
>
> Key: ARROW-230
> URL: https://issues.apache.org/jira/browse/ARROW-230
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Uwe L. Korn
>
> Although you can rename it in imports, still weird stuff can happen.
> E.g. if you re-run make in the build directory (only happens probably if you 
> change pyarrow's CMakeLists.txt and do not call it via setup.py) you will get 
> the following error:
> {noformat}
> -- Found Python lib /usr/lib/x86_64-linux-gnu/libpython2.7.so
> CMake Error at cmake_modules/FindNumPy.cmake:62 (message):
>   NumPy import failure:
>   Traceback (most recent call last):
> File "", line 1, in 
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/__init__.py",
>  line 180, in 
>   from . import add_newdocs
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/add_newdocs.py",
>  line 13, in 
>   from numpy.lib import add_newdoc
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/__init__.py",
>  line 8, in 
>   from .type_check import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/type_check.py",
>  line 11, in 
>   import numpy.core.numeric as _nx
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/core/__init__.py",
>  line 58, in 
>   from numpy.testing import Tester
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/__init__.py",
>  line 14, in 
>   from .utils import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/utils.py",
>  line 15, in 
>   from tempfile import mkdtemp
> File "/usr/lib/python2.7/tempfile.py", line 32, in 
>   import io as _io
>   ImportError:
>   
> /home/uwe/Development/arrow/python/build/temp.linux-x86_64-2.7/./libpyarrow.so:
>   undefined symbol: pyarrow_ARRAY_API
> Call Stack (most recent call first):
>   CMakeLists.txt:223 (find_package)
> {noformat}
> The actual error message here is confusing but the basic problem is that here 
> the wrong io module is imported. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ARROW-230) Python: Do not name modules like native ones (i.e. rename pyarrow.io)

2016-10-19 Thread Wes McKinney (JIRA) 

[ 
https://issues.apache.org/jira/browse/ARROW-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588843#comment-15588843
 ] 

Wes McKinney commented on ARROW-230:


This problem is caused by setuptools because {{bin/cython}}, which has been 
munged by setuptools to import {{pkg_resources}} is being invoked in the same 
directory where the built shared libraries are being created. I don't think 
that renaming the module is the approriate fix, will require some tweaks to the 
way the Cython modules are being built in the CMakeLists.txt

> Python: Do not name modules like native ones (i.e. rename pyarrow.io)
> -
>
> Key: ARROW-230
> URL: https://issues.apache.org/jira/browse/ARROW-230
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Uwe L. Korn
>
> Although you can rename it in imports, still weird stuff can happen.
> E.g. if you re-run make in the build directory (only happens probably if you 
> change pyarrow's CMakeLists.txt and do not call it via setup.py) you will get 
> the following error:
> {noformat}
> -- Found Python lib /usr/lib/x86_64-linux-gnu/libpython2.7.so
> CMake Error at cmake_modules/FindNumPy.cmake:62 (message):
>   NumPy import failure:
>   Traceback (most recent call last):
> File "", line 1, in 
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/__init__.py",
>  line 180, in 
>   from . import add_newdocs
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/add_newdocs.py",
>  line 13, in 
>   from numpy.lib import add_newdoc
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/__init__.py",
>  line 8, in 
>   from .type_check import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/type_check.py",
>  line 11, in 
>   import numpy.core.numeric as _nx
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/core/__init__.py",
>  line 58, in 
>   from numpy.testing import Tester
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/__init__.py",
>  line 14, in 
>   from .utils import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/utils.py",
>  line 15, in 
>   from tempfile import mkdtemp
> File "/usr/lib/python2.7/tempfile.py", line 32, in 
>   import io as _io
>   ImportError:
>   
> /home/uwe/Development/arrow/python/build/temp.linux-x86_64-2.7/./libpyarrow.so:
>   undefined symbol: pyarrow_ARRAY_API
> Call Stack (most recent call first):
>   CMakeLists.txt:223 (find_package)
> {noformat}
> The actual error message here is confusing but the basic problem is that here 
> the wrong io module is imported. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ARROW-230) Python: Do not name modules like native ones (i.e. rename pyarrow.io)

2016-10-19 Thread Jim Pivarski (JIRA) 

[ 
https://issues.apache.org/jira/browse/ARROW-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588659#comment-15588659
 ] 

Jim Pivarski commented on ARROW-230:


I made sure my PYTHONPATH and LD_LIBRARY_PATH were blank, installed a new 
directory, compiled the C++ library from source, and then attempted to compile 
the Python library. I'm including a log of that process below with some of the 
early steps truncated (...) and the Python compilation completely untruncated. 
My prompt is a single percent (%).

{noformat}
% echo $PYTHONPATH  

% echo $LD_LIBRARY_PATH  

% export ARROW_HOME=/opt/apache-arrow-0.1.0/cpp/dist
% cd /opt

% tar -xzvf /tmp/downloads/apache-arrow-0.1.0.tar.gz
apache-arrow-0.1.0/
apache-arrow-0.1.0/.travis.yml
apache-arrow-0.1.0/LICENSE.txt
apache-arrow-0.1.0/NOTICE.txt
apache-arrow-0.1.0/README.md
...

% cd apache-arrow-0.1.0/cpp
% source setup_build_env.sh
+ set -e
+++ dirname ./thirdparty/download_thirdparty.sh
++ cd ./thirdparty
++ pwd
+ TP_DIR=/opt/apache-arrow-0.1.0/cpp/thirdparty
+ source /opt/apache-arrow-0.1.0/cpp/thirdparty/versions.sh
++ GTEST_VERSION=1.7.0
...

% mkdir release
% cd release
% cmake .. -DCMAKE_INSTALL_PREFIX:PATH=$ARROW_HOME
clang-tidy not found
   
clang-format not found
Configured for DEBUG build (set with cmake 
-DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: DEBUG
INFO Using built-in specs.
COLLECT_GCC=/usr/bin/c++
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
Target: x86_64-linux-gnu
...
-- Flatbuffers static library: 
/opt/apache-arrow-0.1.0/cpp/thirdparty/installed/lib/libflatbuffers.a
-- Flatbuffers compiler: 
/opt/apache-arrow-0.1.0/cpp/thirdparty/installed/bin/flatc
-- Configuring done
-- Generating done
-- Build files have been written to: /opt/apache-arrow-0.1.0/cpp/release

% make unittest
Scanning dependencies of target metadata_fbs
[  2%] Running flatc compiler on 
/opt/apache-arrow-0.1.0/format/Message.fbs;/opt/apache-arrow-0.1.0/format/File.fbs
[  2%] Built target metadata_fbs
Scanning dependencies of target arrow_objlib
[  4%] Building CXX object CMakeFiles/arrow_objlib.dir/src/arrow/array.cc.o
[  6%] Building CXX object CMakeFiles/arrow_objlib.dir/src/arrow/builder.cc.o
...
17/18 Test #17: ipc-file-test    Passed0.12 sec
  Start 18: ipc-metadata-test
18/18 Test #18: ipc-metadata-test    Passed0.12 sec

100% tests passed, 0 tests failed out of 18

Label Time Summary:
unittest=   2.29 sec

Total Test time (real) =   2.31 sec
[100%] Built target unittest

% make install
[  2%] Built target metadata_fbs
[ 42%] Built target arrow_objlib
[ 42%] Built target arrow_shared
[ 42%] Built target arrow_static
[ 44%] Built target arrow_test_main
[ 46%] Built target array-test
[ 48%] Built target column-test
...
-- Installing: /opt/apache-arrow-0.1.0/cpp/dist/include/arrow/types/union.h
-- Installing: /opt/apache-arrow-0.1.0/cpp/dist/include/arrow/ipc/adapter.h
-- Installing: /opt/apache-arrow-0.1.0/cpp/dist/include/arrow/ipc/file.h
-- Installing: /opt/apache-arrow-0.1.0/cpp/dist/include/arrow/ipc/metadata.h
-- Installing: /opt/apache-arrow-0.1.0/cpp/dist/lib/libarrow_ipc.so
-- Removed runtime path from 
"/opt/apache-arrow-0.1.0/cpp/dist/lib/libarrow_ipc.so"

% cd ../../python
% tree $ARROW_HOME
/opt/apache-arrow-0.1.0/cpp/dist
|-- include
|   `-- arrow
|   |-- api.h
|   |-- array.h
|   |-- builder.h
|   |-- column.h
|   |-- io
|   |   |-- file.h
|   |   |-- hdfs.h
|   |   |-- interfaces.h
|   |   `-- memory.h
|   |-- ipc
|   |   |-- adapter.h
|   |   |-- file.h
|   |   `-- metadata.h
|   |-- schema.h
|   |-- table.h
|   |-- test-util.h
|   |-- type.h
|   |-- types
|   |   |-- collection.h
|   |   |-- construct.h
|   |   |-- datetime.h
|   |   |-- decimal.h
|   |   |-- json.h
|   |   |-- list.h
|   |   |-- primitive.h
|   |   |-- string.h
|   |   |-- struct.h
|   |   `-- union.h
|   `-- util
|   |-- bit-util.h
|   |-- buffer.h
|   |-- logging.h
|   |-- macros.h
|   |-- memory-pool.h
|   |-- random.h
|   |-- status.h
|   `-- visibility.h
`-- lib
|-- libarrow.a
|-- libarrow.so
|-- libarrow_io.so
`-- libarrow_ipc.so

7 directories, 37 files

% python setup.py build_ext --inplace
/home/pivarski/.local/lib/python2.7/site-packages/setuptools/dist.py:331: 
UserWarning: Normalizing '0.1.0dev' to '0.1.0.dev0'
  normalized_version,
running build_ext
creating build
creating build/temp.linux-x86_64-2.7
cmake  -DPYTHON_EXECUTABLE=/usr/bin/python   /opt/apache-arrow-0.1.0/python
-- The C compiler identification is GNU 4.8.4
-- The CXX compiler identification is GNU 4.8.4
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compi

[jira] [Commented] (ARROW-230) Python: Do not name modules like native ones (i.e. rename pyarrow.io)

2016-10-18 Thread Wes McKinney (JIRA) 

[ 
https://issues.apache.org/jira/browse/ARROW-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15587500#comment-15587500
 ] 

Wes McKinney commented on ARROW-230:


Can you provide a full log of what you're doing and how you're running into the 
problem? Remove your {{python/build}} directory first. I've never run into this 
problem. Note that pandas also has an {{io}} subpackage 
(https://github.com/pandas-dev/pandas/tree/master/pandas/io).

> Python: Do not name modules like native ones (i.e. rename pyarrow.io)
> -
>
> Key: ARROW-230
> URL: https://issues.apache.org/jira/browse/ARROW-230
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Uwe L. Korn
>
> Although you can rename it in imports, still weird stuff can happen.
> E.g. if you re-run make in the build directory (only happens probably if you 
> change pyarrow's CMakeLists.txt and do not call it via setup.py) you will get 
> the following error:
> {noformat}
> -- Found Python lib /usr/lib/x86_64-linux-gnu/libpython2.7.so
> CMake Error at cmake_modules/FindNumPy.cmake:62 (message):
>   NumPy import failure:
>   Traceback (most recent call last):
> File "", line 1, in 
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/__init__.py",
>  line 180, in 
>   from . import add_newdocs
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/add_newdocs.py",
>  line 13, in 
>   from numpy.lib import add_newdoc
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/__init__.py",
>  line 8, in 
>   from .type_check import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/type_check.py",
>  line 11, in 
>   import numpy.core.numeric as _nx
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/core/__init__.py",
>  line 58, in 
>   from numpy.testing import Tester
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/__init__.py",
>  line 14, in 
>   from .utils import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/utils.py",
>  line 15, in 
>   from tempfile import mkdtemp
> File "/usr/lib/python2.7/tempfile.py", line 32, in 
>   import io as _io
>   ImportError:
>   
> /home/uwe/Development/arrow/python/build/temp.linux-x86_64-2.7/./libpyarrow.so:
>   undefined symbol: pyarrow_ARRAY_API
> Call Stack (most recent call first):
>   CMakeLists.txt:223 (find_package)
> {noformat}
> The actual error message here is confusing but the basic problem is that here 
> the wrong io module is imported. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ARROW-230) Python: Do not name modules like native ones (i.e. rename pyarrow.io)

2016-10-18 Thread Jim Pivarski (JIRA) 

[ 
https://issues.apache.org/jira/browse/ARROW-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586886#comment-15586886
 ] 

Jim Pivarski commented on ARROW-230:


Actually, I encounter this bug every time.

I don't know how to get my Python environment to `setup.py build_ext --inplace` 
without encountering an `import io` that doesn't yield `undefined symbol: 
pyarrow_ARRAY_API`. Even if I clean the build directory and start over, I hit 
cases with an `import io` in `.local/lib/python2.7/site-packages/pkg_resources` 
or `numpy/lib/format.py`.

Using the 0.1.0 release.

I was going to use pyarrow to explore the structure of the C++ API; everything 
else built correctly.


> Python: Do not name modules like native ones (i.e. rename pyarrow.io)
> -
>
> Key: ARROW-230
> URL: https://issues.apache.org/jira/browse/ARROW-230
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Uwe L. Korn
>
> Although you can rename it in imports, still weird stuff can happen.
> E.g. if you re-run make in the build directory (only happens probably if you 
> change pyarrow's CMakeLists.txt and do not call it via setup.py) you will get 
> the following error:
> {noformat}
> -- Found Python lib /usr/lib/x86_64-linux-gnu/libpython2.7.so
> CMake Error at cmake_modules/FindNumPy.cmake:62 (message):
>   NumPy import failure:
>   Traceback (most recent call last):
> File "", line 1, in 
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/__init__.py",
>  line 180, in 
>   from . import add_newdocs
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/add_newdocs.py",
>  line 13, in 
>   from numpy.lib import add_newdoc
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/__init__.py",
>  line 8, in 
>   from .type_check import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/type_check.py",
>  line 11, in 
>   import numpy.core.numeric as _nx
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/core/__init__.py",
>  line 58, in 
>   from numpy.testing import Tester
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/__init__.py",
>  line 14, in 
>   from .utils import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/utils.py",
>  line 15, in 
>   from tempfile import mkdtemp
> File "/usr/lib/python2.7/tempfile.py", line 32, in 
>   import io as _io
>   ImportError:
>   
> /home/uwe/Development/arrow/python/build/temp.linux-x86_64-2.7/./libpyarrow.so:
>   undefined symbol: pyarrow_ARRAY_API
> Call Stack (most recent call first):
>   CMakeLists.txt:223 (find_package)
> {noformat}
> The actual error message here is confusing but the basic problem is that here 
> the wrong io module is imported. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ARROW-230) Python: Do not name modules like native ones (i.e. rename pyarrow.io)

2016-06-28 Thread Wes McKinney (JIRA) 

[ 
https://issues.apache.org/jira/browse/ARROW-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15353545#comment-15353545
 ] 

Wes McKinney commented on ARROW-230:


Good point. No problems from me

> Python: Do not name modules like native ones (i.e. rename pyarrow.io)
> -
>
> Key: ARROW-230
> URL: https://issues.apache.org/jira/browse/ARROW-230
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: Python
>Reporter: Uwe L. Korn
>
> Although you can rename it in imports, still weird stuff can happen.
> E.g. if you re-run make in the build directory (only happens probably if you 
> change pyarrow's CMakeLists.txt and do not call it via setup.py) you will get 
> the following error:
> {noformat}
> -- Found Python lib /usr/lib/x86_64-linux-gnu/libpython2.7.so
> CMake Error at cmake_modules/FindNumPy.cmake:62 (message):
>   NumPy import failure:
>   Traceback (most recent call last):
> File "", line 1, in 
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/__init__.py",
>  line 180, in 
>   from . import add_newdocs
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/add_newdocs.py",
>  line 13, in 
>   from numpy.lib import add_newdoc
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/__init__.py",
>  line 8, in 
>   from .type_check import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/lib/type_check.py",
>  line 11, in 
>   import numpy.core.numeric as _nx
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/core/__init__.py",
>  line 58, in 
>   from numpy.testing import Tester
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/__init__.py",
>  line 14, in 
>   from .utils import *
> File 
> "/home/uwe/.virtualenvs/pyarrow/local/lib/python2.7/site-packages/numpy/testing/utils.py",
>  line 15, in 
>   from tempfile import mkdtemp
> File "/usr/lib/python2.7/tempfile.py", line 32, in 
>   import io as _io
>   ImportError:
>   
> /home/uwe/Development/arrow/python/build/temp.linux-x86_64-2.7/./libpyarrow.so:
>   undefined symbol: pyarrow_ARRAY_API
> Call Stack (most recent call first):
>   CMakeLists.txt:223 (find_package)
> {noformat}
> The actual error message here is confusing but the basic problem is that here 
> the wrong io module is imported. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)