Re: Access Gandiva filter result by array index

2018-12-13 Thread Ravindra Pindikura
> On Dec 14, 2018, at 3:22 AM, Suvayu Ali wrote: > > Hi everyone, > > Maybe I'm missing something obvious, but for the life of me, I can't > figure out how I can access the elements of an array after a Gandiva > filter operation. > > I have linked a minimal example at the end which I compile

[jira] [Created] (ARROW-4028) [Rust] Merge parquet-rs codebase

2018-12-13 Thread Chao Sun (JIRA)
Chao Sun created ARROW-4028: --- Summary: [Rust] Merge parquet-rs codebase Key: ARROW-4028 URL: https://issues.apache.org/jira/browse/ARROW-4028 Project: Apache Arrow Issue Type: New Feature

[jira] [Created] (ARROW-4027) Reading partitioned datasets using RecordBatchFileReader into R

2018-12-13 Thread Jeffrey Wong (JIRA)
Jeffrey Wong created ARROW-4027: --- Summary: Reading partitioned datasets using RecordBatchFileReader into R Key: ARROW-4027 URL: https://issues.apache.org/jira/browse/ARROW-4027 Project: Apache Arrow

[jira] [Created] (ARROW-4026) [C++] Use separate modular $COMPONENT-test targets for unit tests

2018-12-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4026: --- Summary: [C++] Use separate modular $COMPONENT-test targets for unit tests Key: ARROW-4026 URL: https://issues.apache.org/jira/browse/ARROW-4026 Project: Apache Arrow

[jira] [Created] (ARROW-4025) [Python] TensorFlow/PyTorch arrow ThreadPool workarounds not working in some settings

2018-12-13 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-4025: - Summary: [Python] TensorFlow/PyTorch arrow ThreadPool workarounds not working in some settings Key: ARROW-4025 URL: https://issues.apache.org/jira/browse/ARROW-4025

Re: Arrow JS 0.4.0 Release

2018-12-13 Thread Paul Taylor
Another update: all the existing features and unit tests are working again except for the Table/RecordBatch streaming toString() implementations (and the `arrow2csv` utility), which I'll update later tonight. On JS release cadence, I think Brian's right that the current setup is working count

[jira] [Created] (ARROW-4024) [Python] Cython compilation error on cython==0.27.3

2018-12-13 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-4024: - Summary: [Python] Cython compilation error on cython==0.27.3 Key: ARROW-4024 URL: https://issues.apache.org/jira/browse/ARROW-4024 Project: Apache Arrow Is

[jira] [Created] (ARROW-4023) [Gandiva] Address long CI times in macOS builds

2018-12-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4023: --- Summary: [Gandiva] Address long CI times in macOS builds Key: ARROW-4023 URL: https://issues.apache.org/jira/browse/ARROW-4023 Project: Apache Arrow Issue Type

Access Gandiva filter result by array index

2018-12-13 Thread Suvayu Ali
Hi everyone, Maybe I'm missing something obvious, but for the life of me, I can't figure out how I can access the elements of an array after a Gandiva filter operation. I have linked a minimal example at the end which I compile like this: $ /usr/lib64/ccache/g++ -g -Wall -m64 -std=c++17 -pthre

[jira] [Created] (ARROW-4022) [C++] RFC: promote Datum variant out of compute namespace

2018-12-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4022: --- Summary: [C++] RFC: promote Datum variant out of compute namespace Key: ARROW-4022 URL: https://issues.apache.org/jira/browse/ARROW-4022 Project: Apache Arrow

[jira] [Created] (ARROW-4021) red-arrow compilation

2018-12-13 Thread Dominic Sisneros (JIRA)
Dominic Sisneros created ARROW-4021: --- Summary: red-arrow compilation Key: ARROW-4021 URL: https://issues.apache.org/jira/browse/ARROW-4021 Project: Apache Arrow Issue Type: Bug C

[jira] [Created] (ARROW-4020) [Release] Remove source and binary artifacts from dev dist system after release vote passes

2018-12-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4020: --- Summary: [Release] Remove source and binary artifacts from dev dist system after release vote passes Key: ARROW-4020 URL: https://issues.apache.org/jira/browse/ARROW-4020

Re: Arrow JS 0.4.0 Release

2018-12-13 Thread Wes McKinney
+1 for synchronizing to the main releases when possible. In the 0.12 thread we have discussed moving to time-based releases (e.g. every 2 months). Time-based releases are helpful to create urgency around getting work completed, and making sure that the project is always ready to release. On Thu, De

Re: Arrow JS 0.4.0 Release

2018-12-13 Thread Brian Hulette
Sounds great Paul! Really excited that this refactor is wrapping up. My only concern with including this in 0.4.0 is that I'm not going to have the time to thoroughly review it for a few weeks, so gating on that would really delay it. But I can just manually test with some use-cases I care about in

[jira] [Created] (ARROW-4019) [C++] Fix coverity issues

2018-12-13 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-4019: - Summary: [C++] Fix coverity issues Key: ARROW-4019 URL: https://issues.apache.org/jira/browse/ARROW-4019 Project: Apache Arrow Issue Type: Bug Co

[jira] [Created] (ARROW-4018) [C++] RLE decoder may not big-endian compatible

2018-12-13 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-4018: - Summary: [C++] RLE decoder may not big-endian compatible Key: ARROW-4018 URL: https://issues.apache.org/jira/browse/ARROW-4018 Project: Apache Arrow Issue

Re: Arrow JS 0.4.0 Release

2018-12-13 Thread Paul Taylor
The ongoing JS refactor/upgrade branch is just about done. It's passing all the integration tests, as well as a hundred or so new unit tests. I have to update existing tests where the APIs changed, battle with closure-compiler a bit,

[jira] [Created] (ARROW-4017) [C++] Check and update vendored libraries

2018-12-13 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-4017: - Summary: [C++] Check and update vendored libraries Key: ARROW-4017 URL: https://issues.apache.org/jira/browse/ARROW-4017 Project: Apache Arrow Issue Type: