[jira] [Created] (ARROW-4568) Add version macros to headers

2019-02-13 Thread Lawrence Chan (JIRA)
Lawrence Chan created ARROW-4568: Summary: Add version macros to headers Key: ARROW-4568 URL: https://issues.apache.org/jira/browse/ARROW-4568 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-4567) [C++] Convert Scalar values to Array values with length 1

2019-02-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4567: --- Summary: [C++] Convert Scalar values to Array values with length 1 Key: ARROW-4567 URL: https://issues.apache.org/jira/browse/ARROW-4567 Project: Apache Arrow

Re: Compute kernels and Gandiva operators

2019-02-13 Thread Ravindra Pindikura
Thanks, Wes and Francois. > On Feb 13, 2019, at 10:16 PM, Francois Saint-Jacques > wrote: > > Hi, > > I also agree that we should follow a model similar to what you propose. I > think the plan is, correct me if I'm wrong Wes, to write the logical plan > operators, then write a small execution

[jira] [Created] (ARROW-4566) [C++][Flight] Add option to run arrow-flight-benchmark against a perf server running on a different host

2019-02-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4566: --- Summary: [C++][Flight] Add option to run arrow-flight-benchmark against a perf server running on a different host Key: ARROW-4566 URL:

[jira] [Created] (ARROW-4565) [R] Reading records with all non-null decimals SEGFAULTs

2019-02-13 Thread Javier Luraschi (JIRA)
Javier Luraschi created ARROW-4565: -- Summary: [R] Reading records with all non-null decimals SEGFAULTs Key: ARROW-4565 URL: https://issues.apache.org/jira/browse/ARROW-4565 Project: Apache Arrow

Re: Arrow and R benchmark

2019-02-13 Thread Wes McKinney
Would someone like to make some feature requests to Google or engage with them in another way? I have interacted with GCP in the past; I think it would be helpful for them to hear from other Arrow users or community members since I have been quite public as a carrier of the Arrow banner. On Tue,

[jira] [Created] (ARROW-4564) [C++] IWYU docker image silently fails

2019-02-13 Thread Francois Saint-Jacques (JIRA)
Francois Saint-Jacques created ARROW-4564: - Summary: [C++] IWYU docker image silently fails Key: ARROW-4564 URL: https://issues.apache.org/jira/browse/ARROW-4564 Project: Apache Arrow

[jira] [Created] (ARROW-4563) [Python] pa.decimal128 should validate inputs

2019-02-13 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-4563: - Summary: [Python] pa.decimal128 should validate inputs Key: ARROW-4563 URL: https://issues.apache.org/jira/browse/ARROW-4563 Project: Apache Arrow Issue

Re: Compute kernels and Gandiva operators

2019-02-13 Thread Francois Saint-Jacques
Hi, I also agree that we should follow a model similar to what you propose. I think the plan is, correct me if I'm wrong Wes, to write the logical plan operators, then write a small execution engine prototype and produce a proper design document out of this experiment. There's also a placeholder

[jira] [Created] (ARROW-4562) [C++][Flight] Create outgoing composite grpc::ByteBuffer instead of allocating contiguous slice and copying IpcPayload into it

2019-02-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4562: --- Summary: [C++][Flight] Create outgoing composite grpc::ByteBuffer instead of allocating contiguous slice and copying IpcPayload into it Key: ARROW-4562 URL:

Re: [Rust] Rust 0.13.0 release

2019-02-13 Thread Wes McKinney
> BTW, what's the time line of 0.13.0? See https://lists.apache.org/thread.html/7890bd7aebd2d2018fa68a78630280581a544346ce80e4002cd9e548@%3Cdev.arrow.apache.org%3E Since 0.12 was ~January 20 I think it would be good to release again by the end of March On Wed, Feb 13, 2019 at 7:29 AM Renjie

Re: Compute kernels and Gandiva operators

2019-02-13 Thread Wes McKinney
hi Ravindra, On Wed, Feb 13, 2019 at 1:34 AM Ravindra Pindikura wrote: > > Hi, > > I was looking at the recent checkin for arrow kernels, and started to think > of how they would work alongside Gandiva. > > Here are my thoughts : > > 1. Gandiva already has two high-level operators namely

Re: [Rust] Rust 0.13.0 release

2019-02-13 Thread Renjie Liu
Hi, Andy: Thanks for bringing this thread. I'm working on the arrow reader for parquet and expecting to make progress recently. BTW, what's the time line of 0.13.0? Chao Sun 于 2019年2月13日周三 上午10:34写道: > I’m also interested in the Parquet/Arrow integration and may help there. > This is however a

Re: Arrow Flight protocol/API questions

2019-02-13 Thread Antoine Pitrou
For the record, if I run something like "flight-benchmark -num_streams 32 -records_per_batch 65536 -num_threads 1" then: - 80% of the perf-server's CPU time seems spent inside the implicit memcpy() calls in SerializationTraits::Serialize() (going through CodedOutputStream::WriteRaw) -

[jira] [Created] (ARROW-4561) module 'pyarrow' has no attribute 'compat'

2019-02-13 Thread Ganesh Bhat (JIRA)
Ganesh Bhat created ARROW-4561: -- Summary: module 'pyarrow' has no attribute 'compat' Key: ARROW-4561 URL: https://issues.apache.org/jira/browse/ARROW-4561 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-4560) [R] array() needs to take single input, not ...

2019-02-13 Thread JIRA
Romain François created ARROW-4560: -- Summary: [R] array() needs to take single input, not ... Key: ARROW-4560 URL: https://issues.apache.org/jira/browse/ARROW-4560 Project: Apache Arrow