[jira] [Created] (ARROW-4668) [C++] Support GCP BigQuery Storage API

2019-02-22 Thread Micah Kornfield (JIRA)
Micah Kornfield created ARROW-4668: -- Summary: [C++] Support GCP BigQuery Storage API Key: ARROW-4668 URL: https://issues.apache.org/jira/browse/ARROW-4668 Project: Apache Arrow Issue Type:

Re: Arrow and R benchmark

2019-02-22 Thread Micah Kornfield
Just to follow up on this thread, a new high throughput API [1] for reading data out of big query was released to public beta today. The format it streams is AVRO so it should be higher performance then parsing JSON (and reads can be parallelized). Implementing AVRO reading was something I was

Re: [VOTE] Release Apache Arrow 0.12.1 RC0

2019-02-22 Thread Kouhei Sutou
+1 (binding) I ran the followings on Debian GNU/Linux sid: * ARROW_HAVE_CUDA=no dev/release/verify-release-candidate.sh source 0.12.1 0 * dev/release/verify-release-candidate.sh binaries 0.12.1 0 with: * gcc (Debian 8.2.0-21) 8.2.0 * openjdk version "1.8.0_191" * ruby 2.7.0dev

[jira] [Created] (ARROW-4667) [C++] Unused function warnings with MinGW

2019-02-22 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4667: --- Summary: [C++] Unused function warnings with MinGW Key: ARROW-4667 URL: https://issues.apache.org/jira/browse/ARROW-4667 Project: Apache Arrow Issue Type:

Re: Support for Nested Types in Arrow Java

2019-02-22 Thread Li Jin
Hi Anoop, Arrays and Structs are supported. I am not sure if anyone is working on map type support. On Fri, Feb 22, 2019 at 2:37 PM Anoop Johnson wrote: > Hello Everyone -- > > New user of Arrow here. What is the current status of nested types in > Arrow?

Support for Nested Types in Arrow Java

2019-02-22 Thread Anoop Johnson
Hello Everyone -- New user of Arrow here. What is the current status of nested types in Arrow? https://jira.apache.org/jira/browse/ARROW-1279 indicates that support for maps is in the Arrow spec, but the implementation is not yet done. Is that correct? Is someone already working on this? Other

Re: [VOTE] Release Apache Arrow 0.12.1 RC0

2019-02-22 Thread Francois Saint-Jacques
+1 (non-binding) * Validated sources on Ubuntu 18.04 with cmake 3.10.2 * Validated binaries On Fri, Feb 22, 2019 at 6:33 AM Uwe L. Korn wrote: > +1 (binding) > > * Checked sources on Ubuntu 16.04 with an updated CMake and Gandiva turned > off. > * Verified the uploaded signatures of sources

Question about pyarrow array representation.

2019-02-22 Thread peng yu
Hey channel, I'm trying to fix issue 4350 , which is a result of arrow.Table<-> pandas.df conversion is not symmetric basically we decide to use numpy array as the basis of list when converting from arrow table to pandas. which makes me wondering

[jira] [Created] (ARROW-4665) [C++] With glog activated, DCHECK macros are redefined

2019-02-22 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4665: -- Summary: [C++] With glog activated, DCHECK macros are redefined Key: ARROW-4665 URL: https://issues.apache.org/jira/browse/ARROW-4665 Project: Apache Arrow

[jira] [Created] (ARROW-4664) [C++] DCHECK macro conditions are evaluated in release builds

2019-02-22 Thread Benjamin Kietzman (JIRA)
Benjamin Kietzman created ARROW-4664: Summary: [C++] DCHECK macro conditions are evaluated in release builds Key: ARROW-4664 URL: https://issues.apache.org/jira/browse/ARROW-4664 Project: Apache

[jira] [Created] (ARROW-4663) [Packaging] Conda-forge build misses gflags on linux

2019-02-22 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-4663: -- Summary: [Packaging] Conda-forge build misses gflags on linux Key: ARROW-4663 URL: https://issues.apache.org/jira/browse/ARROW-4663 Project: Apache Arrow

[jira] [Created] (ARROW-4662) [Python] Add type_codes property in UnionType

2019-02-22 Thread Kenta Murata (JIRA)
Kenta Murata created ARROW-4662: --- Summary: [Python] Add type_codes property in UnionType Key: ARROW-4662 URL: https://issues.apache.org/jira/browse/ARROW-4662 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-4660) [C++] gflags fails to build due to CMake error

2019-02-22 Thread Francois Saint-Jacques (JIRA)
Francois Saint-Jacques created ARROW-4660: - Summary: [C++] gflags fails to build due to CMake error Key: ARROW-4660 URL: https://issues.apache.org/jira/browse/ARROW-4660 Project: Apache Arrow

[jira] [Created] (ARROW-4661) [C++] Consolidate random string generators for use in benchmarks and unittests

2019-02-22 Thread Hatem Helal (JIRA)
Hatem Helal created ARROW-4661: -- Summary: [C++] Consolidate random string generators for use in benchmarks and unittests Key: ARROW-4661 URL: https://issues.apache.org/jira/browse/ARROW-4661 Project:

[jira] [Created] (ARROW-4659) [CI] ubuntu/debian nightlies fail because of missing gandiva files

2019-02-22 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4659: -- Summary: [CI] ubuntu/debian nightlies fail because of missing gandiva files Key: ARROW-4659 URL: https://issues.apache.org/jira/browse/ARROW-4659 Project: Apache Arrow

[jira] [Created] (ARROW-4658) [C++] shared gflags is also a run-time conda requirement

2019-02-22 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4658: -- Summary: [C++] shared gflags is also a run-time conda requirement Key: ARROW-4658 URL: https://issues.apache.org/jira/browse/ARROW-4658 Project: Apache Arrow

Re: [VOTE] Release Apache Arrow 0.12.1 RC0

2019-02-22 Thread Uwe L. Korn
+1 (binding) * Checked sources on Ubuntu 16.04 with an updated CMake and Gandiva turned off. * Verified the uploaded signatures of sources and binaries. On Fri, Feb 22, 2019, at 12:22 PM, Uwe L. Korn wrote: > Hi, > > I'd like to propose the first voteable release candidate (RC0) of Apache >

[VOTE] Release Apache Arrow 0.12.1 RC0

2019-02-22 Thread Uwe L. Korn
Hi, I'd like to propose the first voteable release candidate (RC0) of Apache Arrow version 0.12.1. This is a minor release consisting of 14 resolved JIRAs [1]. This release candidate is based on commit: ba09a9e93dc28da629f63e101e231c8b8df942d3 [2] The source release rc4 is hosted at [3]. The

[jira] [Created] (ARROW-4657) [Release] gbenchmark should not be needed for verification

2019-02-22 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4657: -- Summary: [Release] gbenchmark should not be needed for verification Key: ARROW-4657 URL: https://issues.apache.org/jira/browse/ARROW-4657 Project: Apache Arrow