Re: pyarrow read_csv with different amount of columns per row

2019-11-18 Thread Micah Kornfield
+dev@arrow to see if there is a more definitive answer, but I don't believe this type of functionality is supported currently. On Fri, Nov 15, 2019 at 1:42 AM Elisa Scandellari < elisa.scandell...@gmail.com> wrote: > Hi, > I'm trying to improve the performance of my program that loads csv

Re: [Help Needed] Arrow IPC Reader in Rust

2019-11-18 Thread Neville Dipale
Thanks Paddy, I've left the fix as is for now. If we come across problems with the precision in the future, we can tweak it accordingly. Interesting that the array printing was a separate issue, I would have never figured it out. On Mon, 18 Nov 2019 at 22:07, paddy horan wrote: > I should

[jira] [Created] (ARROW-7204) [C++][Dataset] In expression should not require exact type match

2019-11-18 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7204: -- Summary: [C++][Dataset] In expression should not require exact type match Key: ARROW-7204 URL: https://issues.apache.org/jira/browse/ARROW-7204 Project: Apache

Re: [Help Needed] Arrow IPC Reader in Rust

2019-11-18 Thread paddy horan
I should have mentioned that I pushed the fix to your branch. P From: paddy horan Sent: Monday, November 18, 2019 3:04 PM To: dev@arrow.apache.org Subject: Re: [Help Needed] Arrow IPC Reader in Rust Hey Neville, I had a chance to look at this. The debugging

Re: [Help Needed] Arrow IPC Reader in Rust

2019-11-18 Thread paddy horan
Hey Neville, I had a chance to look at this. The debugging output is a separate, but misleading, issue. The real cause is the precision of the 32-bit floating point values. The JSON data has 3 decimal places and the array returned from the reader has more than 3, this might be due to the

[jira] [Created] (ARROW-7203) [CI] Trigger GitHub Action cron workflows on demand

2019-11-18 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7203: -- Summary: [CI] Trigger GitHub Action cron workflows on demand Key: ARROW-7203 URL: https://issues.apache.org/jira/browse/ARROW-7203 Project: Apache Arrow

[jira] [Created] (ARROW-7202) [R][CI] Improve rwinlib building on CI to stop re-downloading dependencies

2019-11-18 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7202: -- Summary: [R][CI] Improve rwinlib building on CI to stop re-downloading dependencies Key: ARROW-7202 URL: https://issues.apache.org/jira/browse/ARROW-7202

[jira] [Created] (ARROW-7201) [GLib][Gandiva] Add support for BooleanNode

2019-11-18 Thread Yosuke Shiro (Jira)
Yosuke Shiro created ARROW-7201: --- Summary: [GLib][Gandiva] Add support for BooleanNode Key: ARROW-7201 URL: https://issues.apache.org/jira/browse/ARROW-7201 Project: Apache Arrow Issue Type:

Arrow sync call November 13 recap

2019-11-18 Thread Francois Saint-Jacques
Attendees: - Projjal Chanda - Uwe Korn - Antoine Pitrou - Prudhvi Porandla - François Saint-Jacques Discussion: - Dataset API is going to be a first candidate for the Result refactor (see https://github.com/apache/arrow/pull/5857) - There's an overlap of dataset::Expression class and

[jira] [Created] (ARROW-7200) Running Arrow Flight benchmark on two hosts doesn't work

2019-11-18 Thread Chengxin Ma (Jira)
Chengxin Ma created ARROW-7200: -- Summary: Running Arrow Flight benchmark on two hosts doesn't work Key: ARROW-7200 URL: https://issues.apache.org/jira/browse/ARROW-7200 Project: Apache Arrow

[NIGHTLY] Arrow Build Report for Job nightly-2019-11-18-0

2019-11-18 Thread Crossbow
Arrow Build Report for Job nightly-2019-11-18-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-18-0 Failed Tasks: - conda-osx-clang-py27: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-18-0-azure-conda-osx-clang-py27 -

[jira] [Created] (ARROW-7199) [Java] ConcurrentModificationException in BaseAllocator::getChildAllocators

2019-11-18 Thread Prudhvi Porandla (Jira)
Prudhvi Porandla created ARROW-7199: --- Summary: [Java] ConcurrentModificationException in BaseAllocator::getChildAllocators Key: ARROW-7199 URL: https://issues.apache.org/jira/browse/ARROW-7199