RE: [Discuss] [Rust] Arrow2/parquet2 going foward

2021-08-03 Thread paddy horan
e%7C84df9e7fe9f640afb435%7C1%7C0%7C637636225764531989%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000sdata=ltf66TZejbomCtlqvhmDswFfdrunChIz5rDTeZzwyRU%3Dreserved=0>. Best, Jorge On Tue, Aug 3, 2021 at 3:13 PM paddy horan wrote: >

RE: [Discuss] [Rust] Arrow2/parquet2 going foward

2021-08-03 Thread paddy horan
Hi Jorge, What do you think about moving Arrow2 into the main Arrow repo where it is only enabled via an "experimental" feature flag? This would allow development of Arrow2 to proceed in the main repo but also this would be a clear signal that Arrow2 is <1.0. When we feel ready (i.e. Arrow2

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

2021-07-29 Thread paddy horan
Congrats Neville! From: Wes McKinney Sent: Thursday, July 29, 2021 6:20 PM To: dev Subject: [ANNOUNCE] New Arrow PMC member: Neville Dipale The Project Management Committee (PMC) for Apache Arrow has invited Neville Dipale to become a PMC member and we are

Re: [ANNOUNCE] New Arrow committer: Ian Cook

2021-04-28 Thread paddy horan
Congrats Ian! From: Jorge Cardoso Leit?o Sent: Wednesday, April 28, 2021 4:56:12 PM To: dev@arrow.apache.org Subject: Re: [ANNOUNCE] New Arrow committer: Ian Cook Congratulations and thank you for your contributions :) On Wed, Apr 28, 2021 at 10:37 PM Neal

Re: [ANNOUNCE] New Arrow committer: Daniël Heres

2021-04-28 Thread paddy horan
Congrats Daniël! From: Andy Grove Sent: Wednesday, April 28, 2021 9:24:41 AM To: dev Subject: [ANNOUNCE] New Arrow committer: Daniël Heres On behalf of the Arrow PMC, I'm happy to announce that Daniël has accepted an invitation to become a committer on Apache

Re: [VOTE] Move Rust components to new repos and process

2021-04-15 Thread paddy horan
+1 From: Joris Van den Bossche Sent: Thursday, April 15, 2021 10:07:27 AM To: dev Subject: Re: [VOTE] Move Rust components to new repos and process +1 (non-binding) Joris On Thu, 15 Apr 2021 at 15:42, Wes McKinney wrote: > +1 (binding) > > On Thu, Apr 15,

Re: [VOTE] Accept donation of Rust Ballista project

2021-03-21 Thread paddy horan
+1 (non-binding) From: Sutou Kouhei Sent: Sunday, March 21, 2021 4:34:43 PM To: dev@arrow.apache.org Subject: Re: [VOTE] Accept donation of Rust Ballista project +1 (binding) In "[VOTE] Accept donation of Rust Ballista project" on Sun, 21 Mar 2021

[DISCUSS] How to describe computation on Arrow data?

2021-03-18 Thread paddy horan
Hi All, I do not have a computer science background so I may not be asking this in the correct way or using the correct terminology but I wonder if we can achieve some level of standardization when describing computation over Arrow data. At the moment on the Rust side DataFusion clearly has a

Re: [ANNOUNCE] New Arrow PMC member: Andrew Lamb

2021-03-08 Thread paddy horan
Congrats Andrew! From: Krisztián Szűcs Sent: Monday, March 8, 2021 3:14:03 PM To: dev Subject: Re: [ANNOUNCE] New Arrow PMC member: Andrew Lamb Congratulations Andrew! On Mon, Mar 8, 2021 at 7:43 PM Daniël Heres wrote: > > Congrats Andrew, well deserved! > >

Re: [ANNOUNCE] New Arrow PMC member: Jorge Leitão

2021-03-08 Thread paddy horan
Congrats Jorge! Well deserved! From: Krisztián Szűcs Sent: Monday, March 8, 2021 3:14 PM To: dev Subject: Re: [ANNOUNCE] New Arrow PMC member: Jorge Leitão Congratulations Jorge! On Mon, Mar 8, 2021 at 7:44 PM Daniël Heres wrote: > > Congrats Jorge, well

Re: [Rust] Announcement: Rust is now part of the Arrow Flight Integration Test

2021-01-09 Thread paddy horan
This was a long time coming. Congrats and thank you to all involved! From: Andrew Lamb Sent: Saturday, January 9, 2021 6:08:47 AM To: dev@arrow.apache.org ; carol.nich...@integer32.com ; jake.gould...@integer32.com ; Neville Dipale Subject: [Rust]

Re: [ANNOUNCE] New Arrow committers: Ji Liu and Liya Fan

2020-06-11 Thread paddy horan
Congrats! From: Micah Kornfield Sent: Thursday, June 11, 2020 12:59:32 PM To: dev Subject: Re: [ANNOUNCE] New Arrow committers: Ji Liu and Liya Fan Congratulations! On Thu, Jun 11, 2020 at 9:32 AM David Li wrote: > Congrats Ji & Liya! > > David > > On

[jira] [Created] (ARROW-8819) [Rust] Rust docs don't complile for the Arrow crate

2020-05-15 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8819: -- Summary: [Rust] Rust docs don't complile for the Arrow crate Key: ARROW-8819 URL: https://issues.apache.org/jira/browse/ARROW-8819 Project: Apache Arrow Issue

[jira] [Created] (ARROW-8818) [Rust] Failing to build on master due to Flatbuffers/Union issues

2020-05-15 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8818: -- Summary: [Rust] Failing to build on master due to Flatbuffers/Union issues Key: ARROW-8818 URL: https://issues.apache.org/jira/browse/ARROW-8818 Project: Apache Arrow

[jira] [Created] (ARROW-8817) [Rust] Add support for Union arrays in Parquet

2020-05-15 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8817: -- Summary: [Rust] Add support for Union arrays in Parquet Key: ARROW-8817 URL: https://issues.apache.org/jira/browse/ARROW-8817 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-8723) [Rust] Remove SIMD specific benchmark code

2020-05-06 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8723: -- Summary: [Rust] Remove SIMD specific benchmark code Key: ARROW-8723 URL: https://issues.apache.org/jira/browse/ARROW-8723 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-8622) [Rust] Parquet crate does not compile on aarch64

2020-04-29 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8622: -- Summary: [Rust] Parquet crate does not compile on aarch64 Key: ARROW-8622 URL: https://issues.apache.org/jira/browse/ARROW-8622 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-8616) [Rust] Turn explicit SIMD off by default

2020-04-28 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8616: -- Summary: [Rust] Turn explicit SIMD off by default Key: ARROW-8616 URL: https://issues.apache.org/jira/browse/ARROW-8616 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-8576) [Rust] Implement ArrayEqual for UnionArray

2020-04-23 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8576: -- Summary: [Rust] Implement ArrayEqual for UnionArray Key: ARROW-8576 URL: https://issues.apache.org/jira/browse/ARROW-8576 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-8560) [Rust] Docs for MutableBuffer resize are incorrect

2020-04-22 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8560: -- Summary: [Rust] Docs for MutableBuffer resize are incorrect Key: ARROW-8560 URL: https://issues.apache.org/jira/browse/ARROW-8560 Project: Apache Arrow Issue

[Discuss] [Rust] Common Trait(s) for iterating over RecordBatch's

2020-04-22 Thread paddy horan
Hi All, I just open ARROW-8559 [1] to consolidate the traits for Record Batch iterators. I feel this needs to be done prior to 1.0 as we need to be clear as to what external crates should implement to integrate with the Arrow ecosystem. This might be disruptive though so I wanted to bring it

[jira] [Created] (ARROW-8559) [Rust] Consolidate Record Batch iterator traits in main arrow crate

2020-04-22 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8559: -- Summary: [Rust] Consolidate Record Batch iterator traits in main arrow crate Key: ARROW-8559 URL: https://issues.apache.org/jira/browse/ARROW-8559 Project: Apache Arrow

[jira] [Created] (ARROW-8558) [Rust] GitHub Actions missing rustfmt

2020-04-22 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8558: -- Summary: [Rust] GitHub Actions missing rustfmt Key: ARROW-8558 URL: https://issues.apache.org/jira/browse/ARROW-8558 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-8547) [Rust] Implement JsonEqual for UnionArray

2020-04-21 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8547: -- Summary: [Rust] Implement JsonEqual for UnionArray Key: ARROW-8547 URL: https://issues.apache.org/jira/browse/ARROW-8547 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-8546) [Rust] Handle UnionArray in get_fb_field_type

2020-04-21 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8546: -- Summary: [Rust] Handle UnionArray in get_fb_field_type Key: ARROW-8546 URL: https://issues.apache.org/jira/browse/ARROW-8546 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-8480) [Rust] There is no check for allocation failure

2020-04-16 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8480: -- Summary: [Rust] There is no check for allocation failure Key: ARROW-8480 URL: https://issues.apache.org/jira/browse/ARROW-8480 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-8479) [Rust] Use "raw_data_mut" in "Buffer::typed_data_mut"

2020-04-16 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8479: -- Summary: [Rust] Use "raw_data_mut" in "Buffer::typed_data_mut" Key: ARROW-8479 URL: https://issues.apache.org/jira/browse/ARROW-8479 Project: Apache A

[jira] [Created] (ARROW-8219) [Rust] sqlparser crate needs to be bumped to version 0.2.5

2020-03-25 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8219: -- Summary: [Rust] sqlparser crate needs to be bumped to version 0.2.5 Key: ARROW-8219 URL: https://issues.apache.org/jira/browse/ARROW-8219 Project: Apache Arrow

[jira] [Created] (ARROW-8197) [Rust] DataFusion "create_physical_plan" returns incorrect schema?

2020-03-24 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8197: -- Summary: [Rust] DataFusion "create_physical_plan" returns incorrect schema? Key: ARROW-8197 URL: https://issues.apache.org/jira/browse/ARROW-8197 Project: Ap

[jira] [Created] (ARROW-7836) [Rust] "allocate_aligned"/"reallocate" need to initialize memory to avoid UB

2020-02-11 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-7836: -- Summary: [Rust] "allocate_aligned"/"reallocate" need to initialize memory to avoid UB Key: ARROW-7836 URL: https://issues.apache.org/jira/browse/ARROW-7836

Re: [Discuss][Rust] Policy regarding "unsafe"

2020-01-19 Thread paddy horan
to users beyond those using Arrow as a > development platform. > > The above are some of my thoughts, but important's that I don't have a lot > of experience with Rust, especially `unsafe` and the other dark corners of > the language. > > Regards > Neville > > On F

[Discuss][Rust] Policy regarding "unsafe"

2020-01-09 Thread paddy horan
Hi All, This time last year there was a brief discussion on the usage of unsafe in Rust (a user on github raised the issue and I created the JIRA). [1] So far we mostly avoid unsafe in the public API's. The thinking here is that Arrow is a "development platform", i.e. lower level that most

Re: [Help Needed] Arrow IPC Reader in Rust

2019-11-18 Thread paddy horan
I should have mentioned that I pushed the fix to your branch. P From: paddy horan Sent: Monday, November 18, 2019 3:04 PM To: dev@arrow.apache.org Subject: Re: [Help Needed] Arrow IPC Reader in Rust Hey Neville, I had a chance to look at this. The debugging

Re: [Help Needed] Arrow IPC Reader in Rust

2019-11-18 Thread paddy horan
to the fact that we read in 64-bit floats and cast? I implemented a quick fix to test and I can pass all tests locally, although I will leave it to you to change as I'm not sure where in your process it's best to adjust the precision. Regards, Paddy From: paddy horan

Re: [Help Needed] Arrow IPC Reader in Rust

2019-11-16 Thread paddy horan
Hey Neville, I'll take a look if no-one beats me to it (I might not have time today or tomorrow). P From: Neville Dipale Sent: Saturday, November 16, 2019 1:42 AM To: dev@arrow.apache.org Subject: [Help Needed] Arrow IPC Reader in Rust Hi Arrow developers,

[jira] [Created] (ARROW-7006) [Rust] Bump flatbuffers version to avoid vulnerability

2019-10-28 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-7006: -- Summary: [Rust] Bump flatbuffers version to avoid vulnerability Key: ARROW-7006 URL: https://issues.apache.org/jira/browse/ARROW-7006 Project: Apache Arrow

[jira] [Created] (ARROW-7005) [Rust] run "cargo audit" in CI

2019-10-28 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-7005: -- Summary: [Rust] run "cargo audit" in CI Key: ARROW-7005 URL: https://issues.apache.org/jira/browse/ARROW-7005 Project: Apache Arrow Issue Type: I

[jira] [Created] (ARROW-6971) [Rust] Replace "RecordBatchReader" with "BatchIterator"

2019-10-22 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6971: -- Summary: [Rust] Replace "RecordBatchReader" with "BatchIterator" Key: ARROW-6971 URL: https://issues.apache.org/jira/browse/ARROW-6971 P

Re: [ANNOUNCE] New Arrow committer: Eric Erhardt

2019-10-17 Thread paddy horan
Congrats Eric! From: Micah Kornfield Sent: Thursday, October 17, 2019 12:45:15 PM To: dev Subject: Re: [ANNOUNCE] New Arrow committer: Eric Erhardt Congrats Eric! On Thu, Oct 17, 2019 at 6:58 AM Wes McKinney wrote: > On behalf of the Arrow PMC, I'm happy to

[jira] [Created] (ARROW-6881) [Rust] Remove "array_ops" in favor of the "compute" sub-module

2019-10-14 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6881: -- Summary: [Rust] Remove "array_ops" in favor of the "compute" sub-module Key: ARROW-6881 URL: https://issues.apache.org/jira/browse/ARROW-6881 P

[jira] [Created] (ARROW-6880) [Rust] Add explicit SIMD for min/max kernel

2019-10-14 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6880: -- Summary: [Rust] Add explicit SIMD for min/max kernel Key: ARROW-6880 URL: https://issues.apache.org/jira/browse/ARROW-6880 Project: Apache Arrow Issue Type: Sub

[jira] [Created] (ARROW-6879) [Rust] Add explicit SIMD for sum kernel

2019-10-14 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6879: -- Summary: [Rust] Add explicit SIMD for sum kernel Key: ARROW-6879 URL: https://issues.apache.org/jira/browse/ARROW-6879 Project: Apache Arrow Issue Type

Re: Can't find myself in contributor list

2019-10-09 Thread paddy horan
It might also be due to our merge tool. PRs are merged locally and pushed to master (with the corresponding PR on github being “closed” rather than “merged”). This might not be reflected in the pulse view. P From: Wes McKinney Sent: Wednesday, October 9,

[jira] [Created] (ARROW-6621) [Rust][DataFusion] Examples for DataFusion are not executed in CI

2019-09-19 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6621: -- Summary: [Rust][DataFusion] Examples for DataFusion are not executed in CI Key: ARROW-6621 URL: https://issues.apache.org/jira/browse/ARROW-6621 Project: Apache Arrow

[jira] [Created] (ARROW-6482) [Rust] Investigate enabling features in regex crate to reduce compile times

2019-09-07 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6482: -- Summary: [Rust] Investigate enabling features in regex crate to reduce compile times Key: ARROW-6482 URL: https://issues.apache.org/jira/browse/ARROW-6482 Project

[Rust] Long compile times causing CI to fail

2019-09-07 Thread paddy horan
Hi All, We have recently had a lot of CI builds fail for Rust due to long compile times, this was first pointed out by Francois on the following PR: https://github.com/apache/arrow/pull/5303 However, it seems unrelated to this change as the following PR's are failing for the same reason also:

Re: New Users on JIRA

2019-09-05 Thread paddy horan
sure to select "Contributor" * Click Add I just took care of this one. - Wes On Thu, Sep 5, 2019 at 9:44 PM paddy horan wrote: > > Hi All, > > I have the same issue again where there is a new user (hengruo) that needs > permissions changed so I can assign an issue.

New Users on JIRA

2019-09-05 Thread paddy horan
Hi All, I have the same issue again where there is a new user (hengruo) that needs permissions changed so I can assign an issue. I know that this was discussed recently which leads me to another question. How do others find previous conversations in the mailing list archives? I find it

[jira] [Created] (ARROW-6410) [Rust] Explore using "autocfg" to enable the widest available SIMD instructions automatically

2019-09-01 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6410: -- Summary: [Rust] Explore using "autocfg" to enable the widest available SIMD instructions automatically Key: ARROW-6410 URL: https://issues.apache.org/jira/browse/

[jira] [Created] (ARROW-6408) [Rust] Use "if cfg!" pattern in SIMD kernel implementations

2019-09-01 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6408: -- Summary: [Rust] Use "if cfg!" pattern in SIMD kernel implementations Key: ARROW-6408 URL: https://issues.apache.org/jira/browse/ARROW-6408 Project: Ap

Re: [ANNOUNCE] New Arrow committer: David M Li

2019-08-31 Thread paddy horan
Congrats David Get Outlook for iOS From: Ryan Murray Sent: Saturday, August 31, 2019 4:14:08 AM To: dev@arrow.apache.org ; emkornfi...@gmail.com Subject: Re: [ANNOUNCE] New Arrow committer: David M Li Congratulations David! On Sat, 31

[jira] [Created] (ARROW-6372) [Rust][Datafusion] Predictate push down optimization can break query plan

2019-08-27 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6372: -- Summary: [Rust][Datafusion] Predictate push down optimization can break query plan Key: ARROW-6372 URL: https://issues.apache.org/jira/browse/ARROW-6372 Project: Apache

Re: Assigning Issues to New Users

2019-08-23 Thread paddy horan
o alter roles -- currently only PMC members are admins. I am not opposed to letting all committers be Admin on JIRA, but we have never formally discussed it. - Wes On Fri, Aug 23, 2019 at 9:50 AM paddy horan wrote: > > Hi All, > > I was going to merge a PR last night when I noti

Assigning Issues to New Users

2019-08-23 Thread paddy horan
Hi All, I was going to merge a PR last night when I noticed that it was still unassigned, I believe it is best practice to make sure all issues are assigned on JIRA before merging the corresponding PR? However, I cannot assign the issue to the user, I believe that I need to change his

[jira] [Created] (ARROW-6303) [Rust] Add a feature to disable SIMD

2019-08-20 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-6303: -- Summary: [Rust] Add a feature to disable SIMD Key: ARROW-6303 URL: https://issues.apache.org/jira/browse/ARROW-6303 Project: Apache Arrow Issue Type

Re: [ANNOUNCE] New Arrow PMC member: Sebastien Binet

2019-08-14 Thread paddy horan
Congrats Sebastian! Get Outlook for iOS From: Wes McKinney Sent: Tuesday, August 13, 2019 4:54 PM To: dev@arrow.apache.org Subject: [ANNOUNCE] New Arrow PMC member: Sebastien Binet The Project Management Committee (PMC) for Apache Arrow

Re: [ANNOUNCE] New Arrow PMC member: Micah Kornfield

2019-08-09 Thread paddy horan
Congrats Micah! Get Outlook for iOS From: Wes McKinney Sent: Friday, August 9, 2019 11:12 AM To: dev@arrow.apache.org Subject: [ANNOUNCE] New Arrow PMC member: Micah Kornfield The Project Management Committee (PMC) for Apache Arrow has

Re: Options for running the integration tests

2019-08-08 Thread paddy horan
onding entry in the docker-compose.yml. On Thu, Aug 8, 2019 at 6:39 PM paddy horan wrote: > Thanks Antoine, > > > Personally I run C++ / Java integration tests locally, without any > Docker image. But I wouldn't be able to run the other integration tests... > > Right this w

Re: Options for running the integration tests

2019-08-08 Thread paddy horan
From: Antoine Pitrou Sent: Thursday, August 8, 2019 10:50 AM To: dev@arrow.apache.org Subject: Re: Options for running the integration tests On Wed, 7 Aug 2019 20:29:13 + paddy horan wrote: > Hi All, > > I have been away from Arrow for a while due to relocation of fa

Options for running the integration tests

2019-08-07 Thread paddy horan
Hi All, I have been away from Arrow for a while due to relocation of family and RSI. I'd like to start working toward getting Rust passing the integration tests. In the last few months a lot of work has been done to "dockerize" many of the build steps in the project, which I'm trying to

[jira] [Created] (ARROW-6109) [Integration] Docker image for integration testing can't be built on windows

2019-08-01 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-6109: -- Summary: [Integration] Docker image for integration testing can't be built on windows Key: ARROW-6109 URL: https://issues.apache.org/jira/browse/ARROW-6109 Project

Re: [ANNOUNCE] New Arrow committer: Neville Dipale

2019-05-11 Thread paddy horan
Congrats Neville! Thank you for your contributions! Get Outlook for iOS From: Andy Grove Sent: Saturday, May 11, 2019 11:23 AM To: dev@arrow.apache.org Subject: [ANNOUNCE] New Arrow committer: Neville Dipale On behalf of the Arrow PMC,

Re: Assignee on Jira

2019-03-10 Thread paddy horan
Sat, 9 Mar 2019 20:02:53 -0800, Micah Kornfield wrote: > I don't know the details, but you might need to make them a "contributor" > in JIRA. It has been mentioned a few times on the mailing list in the past. > > On Sat, Mar 9, 2019 at 5:38 PM paddy horan wrote: > >

Assignee on Jira

2019-03-09 Thread paddy horan
Hi All, Quick question. I have merged two PR's in the last week (ARROW-2409 and ARROW-4791). In both cases the assignee was left unassigned in JIRA. I think this should be updated for metrics, etc.? When I go back and try to update it manually I can't seem to find the users that

Re: Assignee on Jira

2019-03-09 Thread paddy horan
Correction, the contributors' name was Owen Nelson. I'd be surprised if Owen Wilson was contributing to Arrow... P From: paddy horan Sent: Saturday, March 9, 2019 8:33 PM To: dev@arrow.apache.org Subject: Assignee on Jira Hi All, Quick question. I have

Re: [Rust] [DataFusion] Preferences on futures / threading crates?

2019-03-04 Thread paddy horan
No opposition here. P Get Outlook for iOS From: Andy Grove Sent: Sunday, March 3, 2019 11:55 PM To: dev@arrow.apache.org Subject: [Rust] [DataFusion] Preferences on futures / threading crates? I have been working on a PoC of parallel

[jira] [Created] (ARROW-4752) [Rust] Add explicit SIMD vectorization for the divide kernel

2019-03-03 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4752: -- Summary: [Rust] Add explicit SIMD vectorization for the divide kernel Key: ARROW-4752 URL: https://issues.apache.org/jira/browse/ARROW-4752 Project: Apache Arrow

Re: [ANNOUNCE] New Arrow committer: Chao Sun

2019-02-28 Thread paddy horan
Congrats Chao! Get Outlook for iOS From: Uwe L. Korn Sent: Thursday, February 28, 2019 5:29 AM To: dev@arrow.apache.org Subject: [ANNOUNCE] New Arrow committer: Chao Sun On behalf of the Arrow PMC, I'm happy to announce that Chao has an

[jira] [Created] (ARROW-4683) [Rust] Enable "#![deny(missing_docs)]"

2019-02-26 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4683: -- Summary: [Rust] Enable "#![deny(missing_docs)]" Key: ARROW-4683 URL: https://issues.apache.org/jira/browse/ARROW-4683 Project: Apache Arrow

[jira] [Created] (ARROW-4656) [Rust] Implement CSV Writer

2019-02-21 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4656: -- Summary: [Rust] Implement CSV Writer Key: ARROW-4656 URL: https://issues.apache.org/jira/browse/ARROW-4656 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-4591) [Rust] Add explicit SIMD vectorization for aggregation ops in "array_ops"

2019-02-16 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4591: -- Summary: [Rust] Add explicit SIMD vectorization for aggregation ops in "array_ops" Key: ARROW-4591 URL: https://issues.apache.org/jira/browse/ARROW-4591 Proje

[jira] [Created] (ARROW-4590) [Rust] Add explicit SIMD vectorization for comparison ops in "array_ops"

2019-02-16 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4590: -- Summary: [Rust] Add explicit SIMD vectorization for comparison ops in "array_ops" Key: ARROW-4590 URL: https://issues.apache.org/jira/browse/ARROW-4590 Proje

[jira] [Created] (ARROW-4586) [Rust] Remove arrow/mod.rs as it is not needed

2019-02-15 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4586: -- Summary: [Rust] Remove arrow/mod.rs as it is not needed Key: ARROW-4586 URL: https://issues.apache.org/jira/browse/ARROW-4586 Project: Apache Arrow Issue Type

Re: [Rust] Rust 0.13.0 release

2019-02-12 Thread paddy horan
Hi All, The focus for me for 0.13.0 is SIMD. I would like to port all the "ops" in "array_ops" to the new "compute" module and leverage SIMD for them all. I have most of this done in various forks. Past 0.13.0 I would really like to work toward getting Rust running in the integration tests.

[jira] [Created] (ARROW-4513) [Rust] Implement BitAnd/BitOr for and

2019-02-08 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4513: -- Summary: [Rust] Implement BitAnd/BitOr for and Key: ARROW-4513 URL: https://issues.apache.org/jira/browse/ARROW-4513 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-4490) [Rust] Add explicit SIMD vectorization for boolean ops in "array_ops"

2019-02-05 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4490: -- Summary: [Rust] Add explicit SIMD vectorization for boolean ops in "array_ops" Key: ARROW-4490 URL: https://issues.apache.org/jira/browse/ARROW-4490 Proje

[jira] [Created] (ARROW-4489) [Rust] PrimitiveArray.value_slice performs bounds checking when it should not

2019-02-05 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4489: -- Summary: [Rust] PrimitiveArray.value_slice performs bounds checking when it should not Key: ARROW-4489 URL: https://issues.apache.org/jira/browse/ARROW-4489 Project

[jira] [Created] (ARROW-4488) [Rust] From AsRef<[u8]> for Buffer does not ensure correct padding

2019-02-05 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4488: -- Summary: [Rust] From AsRef<[u8]> for Buffer does not ensure correct padding Key: ARROW-4488 URL: https://issues.apache.org/jira/browse/ARROW-4488 Project: Apache

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

2019-02-04 Thread paddy horan
Congrats Andy Get Outlook for iOS From: Wes McKinney Sent: Monday, February 4, 2019 10:39 AM To: dev@arrow.apache.org Subject: [ANNOUNCE] New Arrow PMC member: Andy Grove The Project Management Committee (PMC) for Apache Arrow has invited

[jira] [Created] (ARROW-4468) [Rust] Implement BitAnd for Buffer

2019-02-03 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4468: -- Summary: [Rust] Implement BitAnd for Buffer Key: ARROW-4468 URL: https://issues.apache.org/jira/browse/ARROW-4468 Project: Apache Arrow Issue Type: Improvement

Re: [Rust] code style: restrict line width to 90 characters?

2019-01-25 Thread paddy horan
+1 from me Get Outlook for iOS From: Renjie Liu Sent: Friday, January 25, 2019 7:49 PM To: dev@arrow.apache.org Subject: Re: [Rust] code style: restrict line width to 90 characters? +1 for this suggestio. Chao Sun 于 2019年1月26日周六

[jira] [Created] (ARROW-4377) Implement std::fmt::Debug for all PrimitiveArrays

2019-01-25 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4377: -- Summary: Implement std::fmt::Debug for all PrimitiveArrays Key: ARROW-4377 URL: https://issues.apache.org/jira/browse/ARROW-4377 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4376) [Rust] Implement from_record_iter for csv::Reader

2019-01-25 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4376: -- Summary: [Rust] Implement from_record_iter for csv::Reader Key: ARROW-4376 URL: https://issues.apache.org/jira/browse/ARROW-4376 Project: Apache Arrow Issue

Re: [VOTE] Accept donation of Rust DataFusion library for Apache Arrow

2019-01-23 Thread paddy horan
+1 (non-binding) Thanks Andy Get Outlook for iOS From: Chao Sun Sent: Wednesday, January 23, 2019 1:07 PM To: dev@arrow.apache.org Subject: Re: [VOTE] Accept donation of Rust DataFusion library for Apache Arrow +1 (non-binding) Glad to

Re: [Rust] Adding owners to crates.io for arrow and parquet crates

2019-01-19 Thread paddy horan
Hey Andy, I assume you are looking for Arrow committers? (Probably PMC is more ideal) Basically I’m happy to help where I can if I can. P Get Outlook for iOS From: Andy Grove Sent: Saturday, January 19, 2019 3:58 PM To:

[jira] [Created] (ARROW-4282) [Rust] builder benchmark is broken

2019-01-17 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4282: -- Summary: [Rust] builder benchmark is broken Key: ARROW-4282 URL: https://issues.apache.org/jira/browse/ARROW-4282 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-4271) [Rust] Move Parquet specific info to Parquet Readme

2019-01-15 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4271: -- Summary: [Rust] Move Parquet specific info to Parquet Readme Key: ARROW-4271 URL: https://issues.apache.org/jira/browse/ARROW-4271 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4196) [Rust] Add explicit SIMD vectorization for ops in "array_ops"

2019-01-08 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4196: -- Summary: [Rust] Add explicit SIMD vectorization for ops in "array_ops" Key: ARROW-4196 URL: https://issues.apache.org/jira/browse/ARROW-4196 Project: Ap

Re: Rust bindings for Gandiva

2019-01-04 Thread paddy horan
Hey Andy, I am very interested in this, I’m also looking into adding explicit SIMD to our existing “array_ops”. Maybe we can plan out what is needed on the developer wiki so that we can all help out where we are able. I’ve seen it mentioned here and there but what it the current state of

Re: [Rust] move parquet into a separate sub-crate

2018-12-29 Thread paddy horan
as it involves encoding/decoding mechanisms which are specific to the latter. Therefore, parquet needs to depend on arrow. The cargo workspace is pretty flexible about this so a sub-crate is allowed to depend on the main crate. On Fri, Dec 28, 2018 at 6:55 PM paddy horan wrote: > This se

RE: [Rust] move parquet into a separate sub-crate

2018-12-28 Thread paddy horan
This seems reasonable. The flexibility with CI is a positive for sure. > 1. Cargo doesn't allow cyclic dependency. So if the parquet sub-crate > depends on arrow, we can't reference parquet in arrow. This is my only concern, the Rust implementation is evolving rapidly and adopting workspaces

[jira] [Created] (ARROW-4072) [Rust] Set default value for PARQUET_TEST_DATA

2018-12-18 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4072: -- Summary: [Rust] Set default value for PARQUET_TEST_DATA Key: ARROW-4072 URL: https://issues.apache.org/jira/browse/ARROW-4072 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-4071) [Rust] Add rustfmt as a pre-commit hook

2018-12-18 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4071: -- Summary: [Rust] Add rustfmt as a pre-commit hook Key: ARROW-4071 URL: https://issues.apache.org/jira/browse/ARROW-4071 Project: Apache Arrow Issue Type: Task

Re: [RUST] [DISCUSS] Changing type of array lengths

2018-12-09 Thread paddy horan
ing usize over i64/u64? Is usize 64 >bits in Rust when compiling on Windows? >On Fri, Dec 7, 2018 at 9:48 AM Andy Grove >wrote: >> >> I am in favor of using usize. >> >> Thanks. >> >> On Thu, Dec 6, 2018 at 7:20 PM paddy horan >wrote: >

RE: Timeline for Arrow 0.12.0 release

2018-12-06 Thread paddy horan
Other than Andy’s PR below I’m going to try and find time to work on ARROW-3827, I’ll bump it 0.13 if I can’t find the time early next week. There is nothing else in the 0.12 backlog for Rust. It would be nice to get the parquet merge in though. Paddy

[RUST] [DISCUSS] Changing type of array lengths

2018-12-06 Thread paddy horan
All, As part of the PR for ARROW-3347 there was a discussion regarding the type that should be used for anything that measures the length of an array, i.e. len and capacity. The result of this discussion was that the Rust implementation should switch to using usize as the type for

Re: Timeline for Arrow 0.12.0 release

2018-12-05 Thread paddy horan
I’m traveling at the moment but I’ll look through all the outstanding Jira’s tomorrow and organize them. Paddy Get Outlook for iOS From: Andy Grove Sent: Tuesday, December 4, 2018 9:58 PM To: dev@arrow.apache.org Subject: Re: Timeline

Re: [DISCUSS] Rust add adapter for parquet

2018-11-21 Thread paddy horan
Wed, Nov 21, 2018 at 10:18 AM paddy horan wrote: > I think using nightly is fine for the reasons mentioned already. We > should switch our CI to still run CI against stable (non fatal) so we know > when we can make the move back to stable. > > > > A bigger issue is windows su

RE: [DISCUSS] Rust add adapter for parquet

2018-11-21 Thread paddy horan
I think using nightly is fine for the reasons mentioned already. We should switch our CI to still run CI against stable (non fatal) so we know when we can make the move back to stable. A bigger issue is windows support for parquet-rs, Chao – I don’t believe that parquet-rs supports windows,

[jira] [Created] (ARROW-3827) [Rust] Implement UnionArray

2018-11-16 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-3827: -- Summary: [Rust] Implement UnionArray Key: ARROW-3827 URL: https://issues.apache.org/jira/browse/ARROW-3827 Project: Apache Arrow Issue Type: New Feature

  1   2   >