Re: Arrow Rust roadmapping [was Re: [Gandiva] Representing logical query plans in protobuf]

2019-01-05 Thread Neville Dipale
lle, > > On Sat, Jan 5, 2019 at 2:37 PM Neville Dipale > wrote: > > > > Hi Andy & Wes, > > > > Apologies if I go off-topic a bit, I hope my thoughts are related though. > > > > I'm a new contributor to Arrow, but I've been using and following it > sin

Re: [Gandiva] Representing logical query plans in protobuf

2019-01-05 Thread Neville Dipale
Hi Andy & Wes, Apologies if I go off-topic a bit, I hope my thoughts are related though. I'm a new contributor to Arrow, but I've been using and following it since the feather days. I'm interested in contributing to Rust, as that aligns more with my day job(s). I think we (rather, the Rust

Re: [VOTE] Accept donation of Rust DataFusion library for Apache Arrow

2019-01-23 Thread Neville Dipale
Hi Andy, +1 : Accept contribution of DataFusion Rust library Thanks On Wed, 23 Jan 2019 at 03:05, Wes McKinney wrote: > Dear all, > > The developers of DataFusion, an analytical query engine written > in Rust, based on the Arrow columnar memory format, are proposing > to donate the code to

Re: [Rust] Creating Native Types from Rust Types (e.g. i32 -> ArrowNativeType)

2019-01-07 Thread Neville Dipale
for. On Mon, 07 Jan 2019, 17:09 Andy Grove It is possible to create an array of Arrow types from a vec of primitives > e.g. Int32Array::from(vec![1, 2, 3]) IIRC. > > Andy. > > On Mon, Jan 7, 2019 at 5:09 AM Neville Dipale > wrote: > > > I'm trying to find/create a way o

[Rust] Creating Native Types from Rust Types (e.g. i32 -> ArrowNativeType)

2019-01-07 Thread Neville Dipale
I'm trying to find/create a way of converting primitive rust values in Rust to their ArrowNativeType counterparts. I'm trying to implement some array ops which need constant values, so I can be able to multiply say a Int32Type by 3 to get a value. Is there currently a way of doing this that I

Re: [Rust] Creating Native Types from Rust Types (e.g. i32 -> ArrowNativeType)

2019-01-07 Thread Neville Dipale
ons on arrays. On Mon, 7 Jan 2019 at 18:42, Neville Dipale wrote: > Thanks Andy, > > I'm aware of that, and have tried it with no success. What I am looking > for might be similar to ScalarValue in DataFusion. > > If I create an array like Int32Array::from(vec![1]), and try to get t

Re: [Rust] [DISCUSS] Donate DataFusion to Arrow project

2019-01-08 Thread Neville Dipale
Hi Andy, I can't comment on the voting process, but regarding the addition of DataFusion: I support the idea to donate the code, mainly as I think that will help us accelerate some work on Rust. Out of curiousity, I've been prototying a 'Rust dataframe' abstraction which (can/will) have various

Re: [Format] [Rust] ChunkedArray, Column and Table

2019-01-27 Thread Neville Dipale
bvious to me why the Record Batch > definition doesn't reference a Schema) > > Regards > > Antoine. > > > Le 25/01/2019 à 19:48, Neville Dipale a écrit : > > Hi Arrow developers, > > > > I've been looking at the various language impls, and although a Table > is

Re: [ANNOUNCE] New Arrow committer: Chao Sun

2019-02-28 Thread Neville Dipale
Congratulations Chao and Paddy! I'm loving the increase in velocity on the Rust side On Thu, 28 Feb 2019, 17:17 Wes McKinney, wrote: > thank you Chao, and welcome! > > On Thu, Feb 28, 2019 at 6:18 AM paddy horan > wrote: > > > > Congrats Chao! > > > > Get Outlook for iOS

Re: [Rust] [DataFusion] Preferences on futures / threading crates?

2019-03-04 Thread Neville Dipale
I'm a fan of using Rayon. Perhaps if it's not too much work, we could compare the two On Mon, 4 Mar 2019 at 15:04, Krisztián Szűcs wrote: > On Mon, Mar 4, 2019 at 5:55 AM Andy Grove wrote: > > > I have been working on a PoC of parallel query execution and it is > working > > well, and I am now

[Discuss] Array Cast Kernels Support Matrix

2019-03-04 Thread Neville Dipale
Hi Arrow devs, I'm currently adding support for casting arrays in Rust, and I'm wondering what casting operations should be supported, and how. Most operations are simple, but I have a few questions below. * Struct to Struct: I am not supporting in Rust as it might not make sense/be easy to

Re: Timeline for 0.13 Arrow release

2019-03-18 Thread Neville Dipale
Hi Wes, In Rust, we have 2 bugs (https://issues.apache.org/jira/browse/ARROW-4914, https://issues.apache.org/jira/browse/ARROW-4886) both related to array slicing. In summary: * ARROW-4914, the bitmask of the original array is used to determine the validity of the sliced array, but offsets

Re: Timeline for 0.13 Arrow release

2019-03-19 Thread Neville Dipale
the JIRAs (e.g., test case to reproduce). Array currently > doesn't expose a bitmask API, and I don't think we need specialized > implementations for struct & list. > > Chao > > On Mon, Mar 18, 2019 at 8:24 PM Neville Dipale > wrote: > > > Hi Wes, > > > >

Re: Timeline for 0.13 Arrow release

2019-03-19 Thread Neville Dipale
When is the cut-off for PRs? We have a public holiday on Thursday, and I want to use that to finish off my work on array casting. If that'll be too late I can defer to the next release. On Tue, 19 Mar 2019, 12:34 Antoine Pitrou, wrote: > > The only potential blocker from my POV is >

Re: [Rust] Rust 0.13.0 release

2019-02-12 Thread Neville Dipale
Thanks for bringing this up Andy. I'm unemployed/on recovery leave, so I've had some surplus time to work on Rust. There's a lot of features that I've wanted to work on, some which I've spent some time attempting, but struggled with. A few block additional work that I could contribute. In

[Format] [Rust] ChunkedArray, Column and Table

2019-01-25 Thread Neville Dipale
Hi Arrow developers, I've been looking at the various language impls, and although a Table isn't currently part of the spec, it seems to be implemented in CPP, Python, Go, JS (and perhaps other languages). Are there plans of standardising these and adding them to the spec? I'm asking because

Re: [Rust] code style: restrict line width to 90 characters?

2019-01-25 Thread Neville Dipale
Hi Chao, What's the current limit? I just ran rustfmt, and seems like it's not reformatting at 100 characters. I support changing whatever the current width is to 90 characters. Regards Neville On Fri, 25 Jan 2019 at 19:49, Chao Sun wrote: > Hi Rust developers, > > Just want to know if anyone

Re: [ANNOUNCE] New Arrow committer: Neville Dipale

2019-05-13 Thread Neville Dipale
turday, May 11, 2019, paddy horan > > > > > wrote: > > > > > > > > > > > > > > > Congrats Neville! Thank you for your contributions! > > > > > > > > > > > > > > > > Get Outlook for iOS<https://aka.ms/

[Rust] [Discuss] Generalising Eq, Neq Kernel Functions Beyond Numeric Types

2019-05-13 Thread Neville Dipale
Hi Arrow[Rust] developers, I came across an instance where I wanted to compare 2 arrays that aren't numeric (bool, string, list?), and couldn't conveniently leverage the comparison array_ops for this. This is due to the trait bounds that require that PrimitiveArray satisfy T: ArrowNumericType.

[Rust] [Format] Should Null Bitmaps be Padded to 8 or 64 Bits?

2019-04-26 Thread Neville Dipale
Hi Arrow developers, I'm currently working on IPC in Rust, specifically reading Arrow files. I've noticed that null buffers/bitmaps are always padded to 64 bits (from pyarrow, not sure about others), while in Rust we pad to 8 bits. 1. Is this fine re. Rust per the spec? I'm having issues with

Re: Proper way to retrigger Travis CI builds

2019-04-25 Thread Neville Dipale
To add here, sometimes builds for unrelated changes are caused by your branch being behind master. I've noticed that whenever I rebase my changes to latest master, I reliably only trigger the Rust jobs to run. Maybe that could also help non-Arrow commiters :) On Thu, 25 Apr 2019 at 14:11, Wes

Re: [DISCUSS] [Rust] Adding support for Flight protocol

2019-11-17 Thread Neville Dipale
ess most of my experience up to now is with Tonic > itself, I > > wanted to make myself available to you all for help or special > > implementations coming from the Tonic side. I am also willing to help > with > > the flight rust implementation. So please let me know a

[Help Needed] Arrow IPC Reader in Rust

2019-11-15 Thread Neville Dipale
Hi Arrow developers, I'm "done" with the Arrow IPC Reader in Rust (for supported data types), but am having issues with reading some of the test data. Specifically, I've noticed that when reading the integration test data (primitve_generated), where I expect an array with 17 values, the arrow

Re: [DISCUSS] [Rust] Adding support for Flight protocol

2019-10-17 Thread Neville Dipale
Good evening With support for testing against integration files now done, I've resumed work on the IPC reader. If I don't encounter trouble reading the existing files, I expect to be done with this work by the end of the weekend. I had taken the approach of one large PR to include all

Re: [DISCUSS] [Rust] Adding support for Flight protocol

2019-10-17 Thread Neville Dipale
> they might be interested in helping here too. > > Let me know how else I can help out with this effort. > > Andy. > > > > On Thu, Oct 17, 2019 at 2:42 PM Neville Dipale > wrote: > > > Good evening > > > > With support for testing against i

Re: [Help Needed] Arrow IPC Reader in Rust

2019-11-18 Thread Neville Dipale
___ > From: paddy horan > Sent: Saturday, November 16, 2019 1:03 PM > To: dev@arrow.apache.org > Subject: Re: [Help Needed] Arrow IPC Reader in Rust > > Hey Neville, > > I'll take a look if no-one beats me to it (I might not have time today or > tomorrow). > >

Re: [DISCUSS] Adding "trivial" buffer compression option to IPC protocol (ARROW-300)

2020-03-01 Thread Neville Dipale
I also support compression at the buffer level, and making it an extra message. Talking about compression and flight, has anyone tested using grpc's compression to compress at the transport level (if that's a correct way to describe it)? I believe only gzip and brotli are currently supported, so

Re: [Rust] Possible blocking issue for 0.16 release

2020-01-26 Thread Neville Dipale
Hi Andy, I think `cargo update` is the correct approach to resolve this issue. Yes, we've got quite a bit of backlog in Rust, but we should initiate the process to adopt parquet-format with Chao and Ivan's approval post 0.16. In the interim we could fix the thrift dependency issue upstream (as

Re: [Discuss][Rust] Policy regarding "unsafe"

2020-01-17 Thread Neville Dipale
Hi Paddy, On Fri, 10 Jan 2020 at 04:13, paddy horan wrote: > Hi All, > > This time last year there was a brief discussion on the usage of unsafe in > Rust (a user on github raised the issue and I created the JIRA). [1] > > So far we mostly avoid unsafe in the public API's. The thinking here is

Re: [Discuss][Rust] Policy regarding "unsafe"

2020-01-17 Thread Neville Dipale
Hi Paddy, Arrow Developers, I've given this some thought, and I preliminarily think that perhaps we can audit our use of unsafe and evaluate where we can remove it, propagate it upwards (and provide safe alternatives) or provide some safety to callers. Looking at the 3 options that Paul Kernfeld

Re: [VOTE] Increment MetadataVersion in Schema.fbs from V4 to V5 for 1.0.0 release

2020-06-30 Thread Neville Dipale
+1 (non-binding) On Tue, 30 Jun 2020 at 06:29, Ben Kietzman wrote: > +1 (non binding) > > On Tue, Jun 30, 2020, 00:25 Wes McKinney wrote: > > > +1 (binding) > > > > On Mon, Jun 29, 2020 at 10:49 PM Micah Kornfield > > wrote: > > > > > > +1 (binding) > > > > > > On Mon, Jun 29, 2020 at 2:43 PM

Re: Bot to set "In Progress" status in JIRA

2020-06-30 Thread Neville Dipale
Thanks Wes, I noticed this today, but was a bit confused as to why you reassigned a JIRA to yourself, then back to me. This clarifies what happened :) Neville On Tue, 30 Jun 2020 at 15:39, Wes McKinney wrote: > hi, > > Yesterday I set up a bot to set issues to In Progress if they have an >

[Integration] Errors running archery integration on Windows

2020-07-06 Thread Neville Dipale
Hi Arrow devs, I'm trying to run archery integration tests in Windows 10 (Python 3.7.7; conda 4.8.3), but I'm getting an error *ValueError: low is out of bounds for int32* (https://gist.github.com/nevi-me/4946eabb2dc111e10b98c074b45b73b1 ). Has someone else encountered this problem before?

Re: [Integration] Errors running archery integration on Windows

2020-07-06 Thread Neville Dipale
> > Numpy on windows has different default bitwidth than on linux. Perhaps > this > > is causing the issue? (see: > > > https://stackoverflow.com/questions/36278590/numpy-array-dtype-is-coming-as-int32-by-default-in-a-windows-10-64-bit-machine > > ) > > > >

Status of Rust Integration Testing

2020-07-10 Thread Neville Dipale
Good day Arrow devs, I've spent a few evenings looking into the issues that we're experiencing with Rust integration testing. In summary, none of our tests pass (zero batch doesn't count :) ). This is mainly because of changes from the legacy padding in the 0.15.0 release, which we never made in

Re: Status of Rust Integration Testing

2020-07-11 Thread Neville Dipale
. One question, we have "gold" files for 0.14.0 > checked into the test-data repo and run integration tests on those to > ensure we can read them in a few implementations. Does Rust at least read > those correctly? > > Thanks, > Micah > > On Fri, Jul 10, 2020 at 1:03 PM

[Rust] Creating a separate branch for Arrow Partuet writer until next release

2020-08-08 Thread Neville Dipale
Good day, This relates to https://github.com/apache/arrow/pull/7319 (ARROW-8289) In the past few months we haven't had enough review bandwidth on Rust's Parquet implementation (mostly relying on Chao for non-trivial reviews), and given the amount of work needed for an Arrow writer + the interest

[jira] [Created] (ARROW-4680) [CI] [Rust] Travis CI builds fail with latest Rust 1.34.0-nightly (2019-02-25)

2019-02-25 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4680: - Summary: [CI] [Rust] Travis CI builds fail with latest Rust 1.34.0-nightly (2019-02-25) Key: ARROW-4680 URL: https://issues.apache.org/jira/browse/ARROW-4680

[jira] [Created] (ARROW-4769) [Rust] Improve array limit function where max records > len

2019-03-04 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4769: - Summary: [Rust] Improve array limit function where max records > len Key: ARROW-4769 URL: https://issues.apache.org/jira/browse/ARROW-4769 Project: Apache Ar

[jira] [Created] (ARROW-4865) [Rust] Support casting lists and primitives to lists

2019-03-14 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4865: - Summary: [Rust] Support casting lists and primitives to lists Key: ARROW-4865 URL: https://issues.apache.org/jira/browse/ARROW-4865 Project: Apache Arrow

[jira] [Created] (ARROW-4853) [Rust] Array slice doesn't work on ListArray and StructArray

2019-03-13 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4853: - Summary: [Rust] Array slice doesn't work on ListArray and StructArray Key: ARROW-4853 URL: https://issues.apache.org/jira/browse/ARROW-4853 Project: Apache Arrow

[jira] [Created] (ARROW-4854) [Rust] Use Array Slice for limit kernel

2019-03-13 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4854: - Summary: [Rust] Use Array Slice for limit kernel Key: ARROW-4854 URL: https://issues.apache.org/jira/browse/ARROW-4854 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-4968) [Rust] StructArray builder and From<> methods should check that field types match schema

2019-03-19 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4968: - Summary: [Rust] StructArray builder and From<> methods should check that field types match schema Key: ARROW-4968 URL: https://issues.apache.org/jira/browse/ARRO

[jira] [Created] (ARROW-4886) [Rust] Inconsistent behaviour with casting sliced primitive array to list array

2019-03-14 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4886: - Summary: [Rust] Inconsistent behaviour with casting sliced primitive array to list array Key: ARROW-4886 URL: https://issues.apache.org/jira/browse/ARROW-4886

[jira] [Created] (ARROW-4914) [Rust] Array slice returns incorrect bitmask

2019-03-16 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4914: - Summary: [Rust] Array slice returns incorrect bitmask Key: ARROW-4914 URL: https://issues.apache.org/jira/browse/ARROW-4914 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4804) [Rust] Read temporal values from CSV

2019-03-07 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4804: - Summary: [Rust] Read temporal values from CSV Key: ARROW-4804 URL: https://issues.apache.org/jira/browse/ARROW-4804 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-4806) [Rust] Support casting temporal arrays in cast kernels

2019-03-07 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4806: - Summary: [Rust] Support casting temporal arrays in cast kernels Key: ARROW-4806 URL: https://issues.apache.org/jira/browse/ARROW-4806 Project: Apache Arrow

[jira] [Created] (ARROW-4803) [Rust] Read temporal values from JSON

2019-03-07 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4803: - Summary: [Rust] Read temporal values from JSON Key: ARROW-4803 URL: https://issues.apache.org/jira/browse/ARROW-4803 Project: Apache Arrow Issue Type: Sub

[jira] [Created] (ARROW-4805) [Rust] Write temporal arrays to CSV

2019-03-07 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4805: - Summary: [Rust] Write temporal arrays to CSV Key: ARROW-4805 URL: https://issues.apache.org/jira/browse/ARROW-4805 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-4544) [Rust] Read nested JSON structs into StructArrays

2019-02-12 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4544: - Summary: [Rust] Read nested JSON structs into StructArrays Key: ARROW-4544 URL: https://issues.apache.org/jira/browse/ARROW-4544 Project: Apache Arrow

[jira] [Created] (ARROW-4556) [Rust] Preserve order of JSON inferred schema

2019-02-12 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4556: - Summary: [Rust] Preserve order of JSON inferred schema Key: ARROW-4556 URL: https://issues.apache.org/jira/browse/ARROW-4556 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4540) [Rust] Add basic JSON reader

2019-02-12 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4540: - Summary: [Rust] Add basic JSON reader Key: ARROW-4540 URL: https://issues.apache.org/jira/browse/ARROW-4540 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-4534) [Rust] Build JSON reader for reading record batches from line-delimited JSON files

2019-02-11 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4534: - Summary: [Rust] Build JSON reader for reading record batches from line-delimited JSON files Key: ARROW-4534 URL: https://issues.apache.org/jira/browse/ARROW-4534

[jira] [Created] (ARROW-4449) [Rust] Convert File to T: Read + Seek for schema inference

2019-02-01 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4449: - Summary: [Rust] Convert File to T: Read + Seek for schema inference Key: ARROW-4449 URL: https://issues.apache.org/jira/browse/ARROW-4449 Project: Apache Arrow

[jira] [Created] (ARROW-4463) [Rust] Support read:write of Feather files

2019-02-03 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4463: - Summary: [Rust] Support read:write of Feather files Key: ARROW-4463 URL: https://issues.apache.org/jira/browse/ARROW-4463 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-5182) [Rust] Create Arrow File writer

2019-04-17 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5182: - Summary: [Rust] Create Arrow File writer Key: ARROW-5182 URL: https://issues.apache.org/jira/browse/ARROW-5182 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-5181) [Rust] Create Arrow File reader

2019-04-17 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5181: - Summary: [Rust] Create Arrow File reader Key: ARROW-5181 URL: https://issues.apache.org/jira/browse/ARROW-5181 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-5180) [Rust] IPC Support

2019-04-17 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5180: - Summary: [Rust] IPC Support Key: ARROW-5180 URL: https://issues.apache.org/jira/browse/ARROW-5180 Project: Apache Arrow Issue Type: New Feature

[jira] [Created] (ARROW-5360) [Rust] Builds are broken by rustyline on nightly 2019-05-16+

2019-05-17 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5360: - Summary: [Rust] Builds are broken by rustyline on nightly 2019-05-16+ Key: ARROW-5360 URL: https://issues.apache.org/jira/browse/ARROW-5360 Project: Apache Arrow

[jira] [Created] (ARROW-5303) [Rust] Add SIMD vectorization of numeric casts

2019-05-12 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5303: - Summary: [Rust] Add SIMD vectorization of numeric casts Key: ARROW-5303 URL: https://issues.apache.org/jira/browse/ARROW-5303 Project: Apache Arrow Issue

[jira] [Created] (ARROW-5400) [Rust] Test/ensure that reader and writer support zero-length record batches

2019-05-23 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5400: - Summary: [Rust] Test/ensure that reader and writer support zero-length record batches Key: ARROW-5400 URL: https://issues.apache.org/jira/browse/ARROW-5400 Project

[jira] [Created] (ARROW-5399) [Rust] [Testing] Add IPC test files to arrow-testing

2019-05-23 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5399: - Summary: [Rust] [Testing] Add IPC test files to arrow-testing Key: ARROW-5399 URL: https://issues.apache.org/jira/browse/ARROW-5399 Project: Apache Arrow

[jira] [Created] (ARROW-5408) [Rust] Create struct array builder that creates null buffers

2019-05-23 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5408: - Summary: [Rust] Create struct array builder that creates null buffers Key: ARROW-5408 URL: https://issues.apache.org/jira/browse/ARROW-5408 Project: Apache Arrow

[jira] [Created] (ARROW-5367) [Rust] Add temporal kernels

2019-05-18 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5367: - Summary: [Rust] Add temporal kernels Key: ARROW-5367 URL: https://issues.apache.org/jira/browse/ARROW-5367 Project: Apache Arrow Issue Type: New Feature

[jira] [Created] (ARROW-5366) [Rust] Implement Duration and Interval Types

2019-05-18 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5366: - Summary: [Rust] Implement Duration and Interval Types Key: ARROW-5366 URL: https://issues.apache.org/jira/browse/ARROW-5366 Project: Apache Arrow Issue

[jira] [Created] (ARROW-5352) [Rust] BinaryArray filter loses replaces nulls with empty strings

2019-05-16 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5352: - Summary: [Rust] BinaryArray filter loses replaces nulls with empty strings Key: ARROW-5352 URL: https://issues.apache.org/jira/browse/ARROW-5352 Project: Apache

[jira] [Created] (ARROW-5351) [Rust] Add support for take kernel functions

2019-05-16 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5351: - Summary: [Rust] Add support for take kernel functions Key: ARROW-5351 URL: https://issues.apache.org/jira/browse/ARROW-5351 Project: Apache Arrow Issue

[jira] [Created] (ARROW-5350) [Rust] Support filtering on nested array types

2019-05-16 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5350: - Summary: [Rust] Support filtering on nested array types Key: ARROW-5350 URL: https://issues.apache.org/jira/browse/ARROW-5350 Project: Apache Arrow Issue

[jira] [Created] (ARROW-5188) [Rust] Add temporal builders for StructArray

2019-04-19 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5188: - Summary: [Rust] Add temporal builders for StructArray Key: ARROW-5188 URL: https://issues.apache.org/jira/browse/ARROW-5188 Project: Apache Arrow Issue

[jira] [Created] (ARROW-5187) [Rust] Ability to flatten StructArray into a RecordBatch

2019-04-19 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5187: - Summary: [Rust] Ability to flatten StructArray into a RecordBatch Key: ARROW-5187 URL: https://issues.apache.org/jira/browse/ARROW-5187 Project: Apache Arrow

[jira] [Created] (ARROW-5191) [Rust] Expose schema in readers (CSV, JSON) without reading batches

2019-04-21 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5191: - Summary: [Rust] Expose schema in readers (CSV, JSON) without reading batches Key: ARROW-5191 URL: https://issues.apache.org/jira/browse/ARROW-5191 Project: Apache

[jira] [Created] (ARROW-6650) [Rust] [Integration] Add method to generate JSON from RecordBatch

2019-09-20 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-6650: - Summary: [Rust] [Integration] Add method to generate JSON from RecordBatch Key: ARROW-6650 URL: https://issues.apache.org/jira/browse/ARROW-6650 Project: Apache

[jira] [Created] (ARROW-7193) [Rust] Create Arrow stream reader

2019-11-16 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7193: - Summary: [Rust] Create Arrow stream reader Key: ARROW-7193 URL: https://issues.apache.org/jira/browse/ARROW-7193 Project: Apache Arrow Issue Type: Sub

[jira] [Created] (ARROW-7194) [Rust] CSV Writer causing recursion errors

2019-11-16 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7194: - Summary: [Rust] CSV Writer causing recursion errors Key: ARROW-7194 URL: https://issues.apache.org/jira/browse/ARROW-7194 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-7364) [Rust] Add cast options to cast kernel

2019-12-10 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7364: - Summary: [Rust] Add cast options to cast kernel Key: ARROW-7364 URL: https://issues.apache.org/jira/browse/ARROW-7364 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-7324) [Rust] Add Timezone to Timestamp

2019-12-04 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7324: - Summary: [Rust] Add Timezone to Timestamp Key: ARROW-7324 URL: https://issues.apache.org/jira/browse/ARROW-7324 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-6944) [Rust] Add StringType

2019-10-19 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-6944: - Summary: [Rust] Add StringType Key: ARROW-6944 URL: https://issues.apache.org/jira/browse/ARROW-6944 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-6928) [Rust] Add FixedSizeList type

2019-10-17 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-6928: - Summary: [Rust] Add FixedSizeList type Key: ARROW-6928 URL: https://issues.apache.org/jira/browse/ARROW-6928 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-7207) [Rust] Update Generated Flatbuffer Files

2019-11-19 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7207: - Summary: [Rust] Update Generated Flatbuffer Files Key: ARROW-7207 URL: https://issues.apache.org/jira/browse/ARROW-7207 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-7460) [Rust] Improve arithmetic kernels with autovec

2019-12-22 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7460: - Summary: [Rust] Improve arithmetic kernels with autovec Key: ARROW-7460 URL: https://issues.apache.org/jira/browse/ARROW-7460 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7705) [Rust] Initial sort implementation

2020-01-28 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7705: - Summary: [Rust] Initial sort implementation Key: ARROW-7705 URL: https://issues.apache.org/jira/browse/ARROW-7705 Project: Apache Arrow Issue Type: Sub

[jira] [Created] (ARROW-7704) [Rust] Support sort

2020-01-28 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7704: - Summary: [Rust] Support sort Key: ARROW-7704 URL: https://issues.apache.org/jira/browse/ARROW-7704 Project: Apache Arrow Issue Type: New Feature

[jira] [Created] (ARROW-7924) [Rust] Add sort for float types

2020-02-23 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7924: - Summary: [Rust] Add sort for float types Key: ARROW-7924 URL: https://issues.apache.org/jira/browse/ARROW-7924 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-7620) [Rust] Windows builds failing due to flatbuffer compile error

2020-01-20 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7620: - Summary: [Rust] Windows builds failing due to flatbuffer compile error Key: ARROW-7620 URL: https://issues.apache.org/jira/browse/ARROW-7620 Project: Apache Arrow

[jira] [Created] (ARROW-7521) [Rust] Remove tuple on FixedSizeList datatype

2020-01-08 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7521: - Summary: [Rust] Remove tuple on FixedSizeList datatype Key: ARROW-7521 URL: https://issues.apache.org/jira/browse/ARROW-7521 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7475) [Rust] Create Arrow Stream writer

2019-12-29 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-7475: - Summary: [Rust] Create Arrow Stream writer Key: ARROW-7475 URL: https://issues.apache.org/jira/browse/ARROW-7475 Project: Apache Arrow Issue Type: Sub

[jira] [Created] (ARROW-8308) [Rust] [Flight] Implement DoExchange on examples

2020-04-01 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-8308: - Summary: [Rust] [Flight] Implement DoExchange on examples Key: ARROW-8308 URL: https://issues.apache.org/jira/browse/ARROW-8308 Project: Apache Arrow

[jira] [Created] (ARROW-8881) [Rust] Add large list and binary support

2020-05-21 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-8881: - Summary: [Rust] Add large list and binary support Key: ARROW-8881 URL: https://issues.apache.org/jira/browse/ARROW-8881 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-8883) [Rust] [Integration Testing] Disable unsupported tests

2020-05-21 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-8883: - Summary: [Rust] [Integration Testing] Disable unsupported tests Key: ARROW-8883 URL: https://issues.apache.org/jira/browse/ARROW-8883 Project: Apache Arrow

[jira] [Created] (ARROW-9007) [Rust] Support appending arrays by merging array data

2020-06-02 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-9007: - Summary: [Rust] Support appending arrays by merging array data Key: ARROW-9007 URL: https://issues.apache.org/jira/browse/ARROW-9007 Project: Apache Arrow

[jira] [Created] (ARROW-9095) [Rust] Fix NullArray to comply with spec

2020-06-10 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-9095: - Summary: [Rust] Fix NullArray to comply with spec Key: ARROW-9095 URL: https://issues.apache.org/jira/browse/ARROW-9095 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-9053) [Rust] Add sort for lists and structs

2020-06-06 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-9053: - Summary: [Rust] Add sort for lists and structs Key: ARROW-9053 URL: https://issues.apache.org/jira/browse/ARROW-9053 Project: Apache Arrow Issue Type: Sub