[jira] [Created] (ARROW-7455) [Ruby] Use Arrow::DataType.resolve for all GArrowDataType input

2019-12-20 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7455: --- Summary: [Ruby] Use Arrow::DataType.resolve for all GArrowDataType input Key: ARROW-7455 URL: https://issues.apache.org/jira/browse/ARROW-7455 Project: Apache Arrow

[jira] [Created] (ARROW-7454) [Ruby] Add support for saving/loading TSV

2019-12-20 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7454: --- Summary: [Ruby] Add support for saving/loading TSV Key: ARROW-7454 URL: https://issues.apache.org/jira/browse/ARROW-7454 Project: Apache Arrow Issue Type:

Re: Regarding pyarrow package size for aws lambda

2019-12-20 Thread Wes McKinney
hi Thanuj, It is straightforward to alter flags in https://github.com/apache/arrow/blob/master/python/manylinux1/build_arrow.sh and create a slimmed down wheel. See the README for instructions how to run the script (It uses docker-compose so should be easily reproducible on any machine). It's

Regarding pyarrow package size for aws lambda

2019-12-20 Thread thanuj d
Hello, I am Thanuj, I am trying to use pyarrow in aws lambda. The problem I am facing is with the size more than 250mb. I tried several options but not successful I tried removing Gandiva files from package but it gives me corrupt file error. Can you please help me with this on how to

[jira] [Created] (ARROW-7453) [Ruby] Add support for Arrow::NullArray#[]

2019-12-20 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7453: --- Summary: [Ruby] Add support for Arrow::NullArray#[] Key: ARROW-7453 URL: https://issues.apache.org/jira/browse/ARROW-7453 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-7452) [GLib] Make GArrowTimeDataType abstract

2019-12-20 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7452: --- Summary: [GLib] Make GArrowTimeDataType abstract Key: ARROW-7452 URL: https://issues.apache.org/jira/browse/ARROW-7452 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-7451) pyarrow.hdfs.connect crashes when executed asynchronously in processes

2019-12-20 Thread Panagiotis Nezis (Jira)
Panagiotis Nezis created ARROW-7451: --- Summary: pyarrow.hdfs.connect crashes when executed asynchronously in processes Key: ARROW-7451 URL: https://issues.apache.org/jira/browse/ARROW-7451 Project:

Re: Trouble with building Arrow GLib

2019-12-20 Thread Chengxin Ma
Hi Kou, Thanks for the quick fix. After installing the patch I am able to build Arrow-GLib now. About the issue related to Meson: I was using Python 3, the problem was solved by using conda instead of pip. Kind Regards Chengxin Sent with ProtonMail Secure Email. ‐‐‐ Original Message

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-20-0

2019-12-20 Thread Wes McKinney
- conda macOS failures: ongoing issues per ARROW-7398 - test-ubuntu-18.04-cpp-cmake32: -- this failure seems to be a flaky Thrift EP download - wheel-manylinux2010-cp35m: flaky GitHub release upload - test-ubuntu-18.04-cpp-static appears legitimate, I'm opening a JIRA

[NIGHTLY] Arrow Build Report for Job nightly-2019-12-20-0

2019-12-20 Thread Crossbow
Arrow Build Report for Job nightly-2019-12-20-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-20-0 Failed Tasks: - conda-osx-clang-py27: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-20-0-azure-conda-osx-clang-py27 -

Re: Trouble with building Arrow GLib

2019-12-20 Thread Sutou Kouhei
Hi, > I’ve successfully installed Meson according to your suggestion, however it > couldn’t run, probably due to some compatibility issues on the system. (I’ve > written an email to the Helpdesk for help.) I think that you're using Python 2. Meson requires Python 3. > In the meantime of

[jira] [Created] (ARROW-7449) [GLib] Make GObject Introspection optional

2019-12-20 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7449: --- Summary: [GLib] Make GObject Introspection optional Key: ARROW-7449 URL: https://issues.apache.org/jira/browse/ARROW-7449 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-7448) [R] Parquet compression not working

2019-12-20 Thread claesmael...@gmail.com (Jira)
claesmael...@gmail.com created ARROW-7448: - Summary: [R] Parquet compression not working Key: ARROW-7448 URL: https://issues.apache.org/jira/browse/ARROW-7448 Project: Apache Arrow

Re: [C++][Compute] RFC: add SIMD support to C++ kernel

2019-12-20 Thread Antoine Pitrou
Hi, I would recommend against reinventing the wheel. It would be possible to reuse an existing C++ SIMD library. There are several of them (Vc, xsimd, libsimdpp...). Of course, "just use Gandiva" is another possible answer. Regards Antoine. Le 20/12/2019 à 08:32, Yibo Cai a écrit : > Hi,

Re: Trouble with building Arrow GLib

2019-12-20 Thread Chengxin Ma
Hi Kou, I am working on [the Cartesius system](https://userinfo.surfsara.nl/systems/cartesius). The OS on it is [bullx Linux](https://userinfo.surfsara.nl/systems/cartesius/software/rhel). I’ve successfully installed Meson according to your suggestion, however it couldn’t run, probably due to

[jira] [Created] (ARROW-7447) [Java] ComplexCopier does incorrect copy in some cases

2019-12-20 Thread Projjal Chanda (Jira)
Projjal Chanda created ARROW-7447: - Summary: [Java] ComplexCopier does incorrect copy in some cases Key: ARROW-7447 URL: https://issues.apache.org/jira/browse/ARROW-7447 Project: Apache Arrow