[
https://issues.apache.org/jira/browse/ARROW-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067449#comment-17067449
]
Jacek Pliszka commented on ARROW-3329:
--------------------------------------
# I am Fedora pip user so I need to adjust some commands
# this step
[https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst#environment-setup-and-build]
ends in arrow repo directory while this step
[https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst#using-pip]
states "Now, let's create a Python virtualenv with all Python dependencies in
the same folder as the repositories and a target installation folder:" going
up to repos dir (above arrow) I end up with error on cmake - <PRE>CMake Error:
The source directory "/data/no_backup/git/arrow/cpp/build" does not appear to
contain CMakeLists.txt.
Specify --help for usage, or press the help button on the CMake GUI.</PRE>
solution is to do cd .. but then pushd hierarchy possibly breaks
# After cd .. cmake works i assume this is enough for python parquet testing
{code:java}
cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME -DCMAKE_INSTALL_LIBDIR=lib
-DARROW_FLIGHT=OFF -DARROW_GANDIVA=OFF -DARROW_ORC=OFF
-DARROW_WITH_BZ2=ON -DARROW_WITH_ZLIB=ON -DARROW_WITH_ZSTD=ON
-DARROW_WITH_LZ4=ON -DARROW_WITH_SNAPPY=ON -DARROW_WITH_BROTLI=ON
-DARROW_PARQUET=ON -DARROW_PYTHON=ON -DARROW_PLASMA=OFF
-DARROW_BUILD_TESTS=ON
{code}
Then make -j4 fails on
{code:java}
// In file included from
/data/no_backup/git/arrow/cpp/src/arrow/ipc/json_integration.cc:29:
/data/no_backup/git/arrow/cpp/src/arrow/ipc/json_internal.h:26:10: fatal error:
rapidjson/document.h: No such file or directory
26 | #include <rapidjson/document.h> // IWYU pragma: export
{code}
installed rapidjson-devel rpm - then it worked
# After pushd arrow/python
{code:java}
// python setup.py build_ext --inplace
{code}
Fails with Could NOT find Arrow (missing: ARROW_FULL_SO_VERSION
ARROW_SO_VERSION) I mentioned a month ago/ ARROW_HOME is set to the dist
directory in repos (so next to arrow repo). Full error message
{noformat}
-- Build output directory: /data/no_backup/git/arrow/python/build/release
CMake Error at cmake_modules/FindArrow.cmake:359 (file):
file failed to open for reading (No such file or directory):
/data/no_backup/git/arrow/dist/include/arrow/util/config.h
Call Stack (most recent call first):
cmake_modules/FindArrowPython.cmake:46 (find_package)
CMakeLists.txt:210 (find_package)
CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:146
(message):
Could NOT find Arrow (missing: ARROW_FULL_SO_VERSION ARROW_SO_VERSION)
(found version "0.0.0")
Call Stack (most recent call first):
/usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:393
(_FPHSA_FAILURE_MESSAGE)
cmake_modules/FindArrow.cmake:412 (find_package_handle_standard_args)
cmake_modules/FindArrowPython.cmake:46 (find_package)
CMakeLists.txt:210 (find_package)
-- Configuring incomplete, errors occurred!
See also "/data/no_backup/git/arrow/python/CMakeFiles/CMakeOutput.log".
See also "/data/no_backup/git/arrow/python/CMakeFiles/CMakeError.log".
error: command 'cmake' failed with exit status 1
{noformat}
> [Python] Error casting decimal(38, 4) to int64
> ----------------------------------------------
>
> Key: ARROW-3329
> URL: https://issues.apache.org/jira/browse/ARROW-3329
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Environment: Python version : 3.6.5
> Pyarrow version : 0.10.0
> Reporter: Kavita Sheth
> Assignee: Jacek Pliszka
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.17.0
>
> Time Spent: 7h
> Remaining Estimate: 0h
>
> Git issue LInk : https://github.com/apache/arrow/issues/2627
> I want to cast pyarrow table column from decimal(38,4) to int64.
> col.cast(pa.int64())
> Error:
> File "pyarrow/table.pxi", line 443, in pyarrow.lib.Column.cast
> File "pyarrow/error.pxi", line 89, in pyarrow.lib.check_status
> pyarrow.lib.ArrowNotImplementedError: No cast implemented from decimal(38,
> 4) to int64
> Python version : 3.6.5
> Pyarrow version : 0.10.0
> is it not implemented yet or I am not using it correctly? If not implemented
> yet, then any work around to cast columns?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)