Re: Benchmarking dashboard proposal

2019-01-17 Thread Jeff Zhang
+1 It make sense to track the performance of arrow Because I think project arrow is different from other projects that its goal is efficiently data exchange between systems/languages. Melik-Adamyan, Areg 于2019年1月18日周五 下午2:14写道: > Hello, > > I want to restart/attach to the discussions for

[jira] [Created] (ARROW-4285) [Python] Use proper builder interface for serialization

2019-01-17 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-4285: - Summary: [Python] Use proper builder interface for serialization Key: ARROW-4285 URL: https://issues.apache.org/jira/browse/ARROW-4285 Project: Apache Arrow

Benchmarking dashboard proposal

2019-01-17 Thread Melik-Adamyan, Areg
Hello, I want to restart/attach to the discussions for creating Arrow benchmarking dashboard. I want to propose performance benchmark run per commit to track the changes. The proposal includes building infrastructure for per-commit tracking comprising of the following parts: - Hosted JetBrains

Cleaning up the Arrow Java build output

2019-01-17 Thread Wes McKinney
hi folks, The Java build has recently acquired a bunch of new verbose debugging output that is cluttering our CI builds and making the Travis CI logs take a lot longer to load, etc. I opened https://issues.apache.org/jira/browse/ARROW-4180 about one of the new issues I noticed. Can someone take

Re: [VOTE] Release Apache Arrow 0.12.0 RC4

2019-01-17 Thread Antoine Pitrou
+1 (binding) I ran "./dev/release/verify-release-candidate.sh source 0.12.0 4". Everything succeeded before JS, which failed ("./dev/release/verify-release-candidate.sh: ligne 258: npx : commande introuvable"). - Ubuntu 18.04.1 (x86-64) - CUDA enabled - gcc 7.3.0 - java version "1.8.0_201"

Re: Export symbol guidelines

2019-01-17 Thread shyam narayan singh
Vendored code is part of the arrow. Gandiva is just the caller of the timezone apis. Regards Shyam On Thu, Jan 17, 2019 at 11:06 PM Antoine Pitrou wrote: > > Side note: why do those symbols appear in libarrow.so and not > libgandiva.so? > > Regards > > Antoine. > > > Le 17/01/2019 à 18:35,

[jira] [Created] (ARROW-4284) [C#] File / Stream serialization fails due to type mismatch / missing footer

2019-01-17 Thread Chris Hutchinson (JIRA)
Chris Hutchinson created ARROW-4284: --- Summary: [C#] File / Stream serialization fails due to type mismatch / missing footer Key: ARROW-4284 URL: https://issues.apache.org/jira/browse/ARROW-4284

Re: Export symbol guidelines

2019-01-17 Thread Antoine Pitrou
Side note: why do those symbols appear in libarrow.so and not libgandiva.so? Regards Antoine. Le 17/01/2019 à 18:35, Antoine Pitrou a écrit : > > Le 17/01/2019 à 18:29, shyam narayan singh a écrit : >> Hi >> >> 1. The symbols are "locate_zone" and "to_sys" that are part of >> cast_time.cc.

Re: Export symbol guidelines

2019-01-17 Thread Antoine Pitrou
Le 17/01/2019 à 18:29, shyam narayan singh a écrit : > Hi > > 1. The symbols are "locate_zone" and "to_sys" that are part of > cast_time.cc. These are invoked during casting timestamp with timezone > present. > 2. I am trying different things. I just made the symbols hidden to see the > affect.

Re: Export symbol guidelines

2019-01-17 Thread shyam narayan singh
Hi 1. The symbols are "locate_zone" and "to_sys" that are part of cast_time.cc. These are invoked during casting timestamp with timezone present. 2. I am trying different things. I just made the symbols hidden to see the affect. "manylinux" passed while the others failed. 3. Couple of approaches

Re: Export symbol guidelines

2019-01-17 Thread Antoine Pitrou
Le 17/01/2019 à 17:44, shyam narayan singh a écrit : > Hi > > As part of the timestamp support , > we vendored the Howard hinnant date project. > > I had to export the compiled symbols. Can you elaborate on this? Is it because the symbols have to be

Export symbol guidelines

2019-01-17 Thread shyam narayan singh
Hi As part of the timestamp support , we vendored the Howard hinnant date project. I had to export the compiled symbols. But travis job for "manylinux" is failing for it is expecting only two symbols to be exported. Based on the logs it looks like it

Adding more timestamp types to on-disk storage formats

2019-01-17 Thread Zoltan Ivanfi
Hi, There is an ongoing effort amongst the SQL engines of the Hadoop stack to support different timestamp semantics. This development has some implications for the low-level timestamp types as well. The new timestamp types added to the different SQL engines will rely on the decisions of the lower

[jira] [Created] (ARROW-4283) Should RecordBatchStreamReader/Writer be AsyncIteraable?

2019-01-17 Thread Paul Taylor (JIRA)
Paul Taylor created ARROW-4283: -- Summary: Should RecordBatchStreamReader/Writer be AsyncIteraable? Key: ARROW-4283 URL: https://issues.apache.org/jira/browse/ARROW-4283 Project: Apache Arrow

[jira] [Created] (ARROW-4282) [Rust] builder benchmark is broken

2019-01-17 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4282: -- Summary: [Rust] builder benchmark is broken Key: ARROW-4282 URL: https://issues.apache.org/jira/browse/ARROW-4282 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-4281) [CI] Use Ubuntu Xenial (16.04) VMs on Travis-CI

2019-01-17 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-4281: - Summary: [CI] Use Ubuntu Xenial (16.04) VMs on Travis-CI Key: ARROW-4281 URL: https://issues.apache.org/jira/browse/ARROW-4281 Project: Apache Arrow Issue

Re: [VOTE] Release Apache Arrow 0.12.0 RC4

2019-01-17 Thread Kouhei Sutou
+1 (binding) I ran the followings on Debian GNU/Linux sid: * CC=gcc-7 CXX=g++-7 dev/release/verify-release-candidate.sh source 0.12.0 4 * dev/release/verify-release-candidate.sh binaries 0.12.0 4 with: * gcc-7 (Debian 7.4.0-2) 7.4.0 * openjdk version "1.8.0_191" * ruby 2.7.0dev