Re: [ANNOUNCE] New Arrow committer: Sarah Gilmore

2024-04-12 Thread Ian Joiner
Congrats! On Fri, Apr 12, 2024 at 10:18 AM Gang Wu wrote: > Congrats! > > On Fri, Apr 12, 2024 at 9:11 PM Patrick Horan wrote: > > > Congratulations! > > > > On Thu, Apr 11, 2024, at 11:10 AM, Raúl Cumplido wrote: > > > Congratulations Sarah! > > > > > > El jue, 11 abr 2024 a las 13:13, Sutou K

Re: [ANNOUNCE] New Arrow PMC chair: Andy Grove

2023-11-27 Thread Ian Joiner
Congrats Andy and thanks Andrew! On Monday, November 27, 2023, Yibo Cai wrote: > Congrats Andy! > > On 11/28/23 06:03, L. C. Hsieh wrote: > >> Congrats Andy! >> >> Thanks Andrew for the efforts to lead the Arrow project in the past year! >> >> On Tue, Nov 28, 2023 at 3:51 AM Krisztián Szűcs >>

Re: [ANNOUNCE] New Arrow committer: Xuwei Fu

2023-10-24 Thread Ian Joiner
Congrats! On Mon, Oct 23, 2023 at 2:33 AM Sutou Kouhei wrote: > On behalf of the Arrow PMC, I'm happy to announce that Xuwei Fu > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > -- > kou >

Re: [ACCOUNCE] New Arrow Committer: Metehan Yildirim

2023-09-05 Thread Ian Joiner
Congratulations! On Tue, Sep 5, 2023 at 12:14 PM Andrew Lamb wrote: > Belatedly, > > On behalf of the Arrow PMC, I'm happy to announce that Metehan Yildirim > (mete[1]) > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Andrew

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 29.0.0 RC1

2023-08-11 Thread Ian Joiner
+1 (non-binding) Verified on System 76 / Ubuntu 22.04 On Fri, Aug 11, 2023 at 2:13 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M1 Mac. > > Thanks Andy. > > On Fri, Aug 11, 2023 at 10:59 AM Andy Grove wrote: > > > > Hi, > > > > I would like to propose a release of Apache Arrow DataFus

Re: New datatype: Huge integers & decimals

2023-05-23 Thread Ian Joiner
That’s a possibility. Do we consider officially support them? On Tuesday, May 23, 2023, Antoine Pitrou wrote: > > I'm not sure what you're actually proposing here. A new extension type > perhaps? > > > Le 23/05/2023 à 19:13, Ian Joiner a écrit : > >> H

New datatype: Huge integers & decimals

2023-05-23 Thread Ian Joiner
Hi, We need to have really large integers (with 128, 256 and 512 bits) as well as decimals (up to at least decimal1024) because they do actually exist in crypto / web3 space. See https://docs.rs/primitive-types/latest/primitive_types/ for an example of what needs to be supported. If accepted we

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-26 Thread Ian Joiner
The error is like this: collect2: fatal error: ld terminated with signal 9 [Killed] On Mon, Mar 27, 2023 at 2:32 AM Ian Joiner wrote: > 0 (non-binding) > I got an error repeatedly when running the tests since > `datafusion-benchmarks` can not be compiled. > > Ian > Tested on

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-26 Thread Ian Joiner
0 (non-binding) I got an error repeatedly when running the tests since `datafusion-benchmarks` can not be compiled. Ian Tested on my HP/Ubuntu 22.04/AMD64 On Fri, Mar 24, 2023 at 10:16 AM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation,

Re: [VOTE][RUST] Release Apache Arrow Rust 36.0.0 RC1

2023-03-26 Thread Ian Joiner
+1 (Non-binding) Ian Verified on my HP / Ubuntu 22.04 / AMD64 On Fri, Mar 24, 2023 at 3:24 PM Raphael Taylor-Davies wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 36.0.0. > > This release candidate is based on commit: > 71ecc39f36c8f38a5fc93b

Re: [VOTE][RUST][DataFusion] Release DataFusion Python Bindings 20.0.0 RC2

2023-03-19 Thread Ian Joiner
+1 (Non-binding) Verified on Ubuntu 22.04 x86 machine Ian On Sat, Mar 18, 2023 at 11:36 AM Jeremy Dyer wrote: > +1 (non-binding) > > Verified on Ubuntu 22.04 x86 machine and ran several tests with > arrow-datafusion-python as a dependency in third party application. Thanks > for getting the r

Re: [ANNOUNCE] New Arrow PMC member: Will Jones

2023-03-15 Thread Ian Joiner
Congrats Will! Well deserved! Ian On Wednesday, March 15, 2023, Nic Crane wrote: > Congratulations Will! :) > > On Tue, 14 Mar 2023 at 03:09, Jin Shang wrote: > > > Congrats Will! > > > > > 2023年3月14日 11:06,Vibhatha Abeykoon 写道: > > > > > > Congratulations Will. > > > > > > On Tue, Mar 14, 20

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 20.0.0 RC1

2023-03-12 Thread Ian Joiner
+1 (non-binding) Thanks! Ian On Sat, Mar 11, 2023 at 6:28 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on Intel Mac. > > Thanks Andy. > > On Sat, Mar 11, 2023 at 8:12 AM Jeremy Dyer wrote: > > > > +1 (non-binding). Verified via release script on ubuntu 22 x86 machine. > > Thanks for gett

Re: [VOTE][RUST] Release Apache Arrow Rust 35.0.0 RC1

2023-03-12 Thread Ian Joiner
+1 (non-binding) Really thanks! Ian On Saturday, March 11, 2023, Andrew Lamb wrote: > +1 (binding) > > Looks like (another) good release. > > Thank you for preparing it > > On Fri, Mar 10, 2023 at 1:47 PM Raphael Taylor-Davies > wrote: > > > Hi, > > > > I would like to propose a release of Ap

Re: [VOTE][RUST][Ballista] Release Apache Arrow Ballista 0.11.0 RC1

2023-02-24 Thread Ian Joiner
+1 (Non-binding) Thanks Andy! Verified on my System76 / Ubuntu 22.04 / AMD64 Ian On Fri, Feb 24, 2023 at 8:59 AM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow Ballista Implementation, > version 0.11.0. > > This release candidate is based on commit: > eba125e1d0

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 19.0.0 RC1

2023-02-24 Thread Ian Joiner
+1 (Non-binding) Thanks Andy! Verified on my System76 / Ubuntu 22.04 / AMD64. No absurdly slow test found. Ian On Fri, Feb 24, 2023 at 11:07 AM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > version 19.0.0. > > This release candida

Re: [VOTE][RUST] Release Apache Arrow Rust 34.0.0 RC1

2023-02-24 Thread Ian Joiner
+1 (Non-binding) Thanks Raphael! Verified on my System76 / Ubuntu 22.04 / AMD64 Ian On Fri, Feb 24, 2023 at 5:28 AM Raphael Taylor-Davies wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 34.0.0. > > This release candidate is based on commit: >

Re: [ANNOUNCE] New Arrow committer: Wang Mingming

2023-02-22 Thread Ian Joiner
Congrats! On Wed, Feb 22, 2023 at 7:26 AM Andrew Lamb wrote: > Hi, > > On behalf of the Arrow PMC, I'm happy to announce that mingmwang > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Andrew >

Re: [VOTE][RUST][DataFusion] Release DataFusion Python Bindings 0.8.0 RC2

2023-02-22 Thread Ian Joiner
+1 (Non-binding) Really thanks Andy! This is awesome! Ian On Wed, Feb 22, 2023 at 7:55 AM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion Python > Bindings, > version 0.8.0. > > This release candidate is based on commit: > 1e934f081c49212e169def5565f31b

Re: [VOTE][RUST][DataFusion] Release DataFusion Python Bindings 0.8.0 RC1

2023-02-20 Thread Ian Joiner
Hey Jeremy, I’d love to help debug that with you, Andy and Andrew since we have a similar problem in Ballista Python binding which doesn’t have a version mismatch. I will use conda and see what’s actually going on today. - Ian Joiner On Monday, February 20, 2023, Jeremy Dyer wrote: >

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 17.0.0 RC2

2023-01-28 Thread Ian Joiner
+1 (Non-binding) Verified on my System76/Ubuntu 22.04/AMD64 Ian On Fri, Jan 27, 2023 at 11:21 AM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > version 17.0.0. > > This release candidate is based on commit: > fbff8e27630bef42d370053

Re: [VOTE][RUST] Release Apache Arrow Rust 32.0.0 RC1

2023-01-28 Thread Ian Joiner
+1 (Non-binding) Verified on my System76/Ubuntu 22.04/AMD64 Ian On Fri, Jan 27, 2023 at 11:34 AM Raphael Taylor-Davies wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 32.0.0. > > This release candidate is based on commit: > 53a650a5daa5e7a18185

Re: [VOTE][RUST] Release Apache Arrow Rust 31.0.0 RC1

2023-01-13 Thread Ian Joiner
+1 (Non-binding) Tested on System76/ARM64/Ubuntu 22.04 Ian On Friday, January 13, 2023, Raphael Taylor-Davies wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 31.0.0. > > This release candidate is based on commit: > 25a11baf535d72356966cf931baa

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 16.0.0 RC1

2023-01-09 Thread Ian Joiner
+1 (Non-binding) Ian Verified on my System76 / Ubuntu 22.04 / AMD64 On Sat, Jan 7, 2023 at 6:18 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > version 16.0.0. > > This release candidate is based on commit: > dcd52ee3d87c4dd9e2c17

Re: [ANNOUNCE] New Arrow committer: Jie Wen

2023-01-09 Thread Ian Joiner
Congrats Jie! Ian On Sun, Jan 8, 2023 at 6:25 AM Andrew Lamb wrote: > Hi, > > On behalf of the Arrow PMC, I'm happy to announce that Jie Wen > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Andrew >

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.3 RC1

2023-01-05 Thread Ian Joiner
+1 (Non-binding) Verified on my Ubuntu 22.04/AMD64/System76. Ian On Thu, Jan 5, 2023 at 4:22 AM Raphael Taylor-Davies wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Object Store > Implementation, version 0.5.3. > > This release candidate is based on commit: > 4a3b7e993

Re: Subject: [VOTE][RUST] Release Apache Arrow Rust 30.0.1 RC2

2023-01-05 Thread Ian Joiner
+1 (non-binding) Verified on Ubuntu 22.04/AMD64/System 76. Thanks for getting the release done Raphael! Ian On Thu, Jan 5, 2023 at 9:15 AM Jeremy Dyer wrote: > +1 (non-binding), verified on Ubuntu 22.04.1 Thanks for getting the release > thread together Raphael > > - Jeremy Dyer > > On Wed, Ja

Re: [ANNOUNCE] New Arrow PMC chair: Andrew Lamb

2022-12-26 Thread Ian Joiner
Congrats Andrew! Ian On Tuesday, December 27, 2022, Raúl Cumplido wrote: > Congratulations Andrew! > > > El mar, 27 dic 2022, 7:48, Benson Muite > escribió: > > > Congratulations! > > On 12/27/22 05:44, Yibo Cai wrote: > > > Congratulations! > > > > > > -Original Message- > > > From: R

Re: [ANNOUNCE] New Arrow committer: Jacob Wujciak

2022-12-15 Thread Ian Joiner
Congrats Jacob! Ian On Fri, Dec 16, 2022 at 1:15 AM Nic Crane wrote: > On behalf of the Arrow PMC, I'm happy to announce that Jacob Wujciak has > accepted an invitation to become a committer on Apache Arrow. Welcome, and > thank you for your contributions! > > Nic >

Re: [VOTE][RUST] Release Apache Arrow Rust 29.0.0 RC2

2022-12-11 Thread Ian Joiner
+1 (non-binding) Verified on my System76/Ubuntu 22.04/AMD64 On Fri, Dec 9, 2022 at 5:31 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 29.0.0. > > Note this is Release Candidate 2 (RC1 had an issue [5]) > > This release candidate

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.2 RC1

2022-12-05 Thread Ian Joiner
+1 (non-binding) Verified on Ubuntu 22.04/AMD64 On Fri, Dec 2, 2022 at 3:30 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Object > Store Implementation, version 0.5.2. > > This release candidate is based on commit: > 74b174ca7a6c11d2b410334f45aa399987b35

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 15.0.0 RC1

2022-12-05 Thread Ian Joiner
+1 (Non-binding) Verified on Ubuntu 22.04/AMD64 On Sun, Dec 4, 2022 at 3:25 PM Martin Grigorov wrote: > +1 (non-binding) > > Tested on Ubuntu 22.10 x86_64 and openEuler 22.03 aarch64. > > On Fri, Dec 2, 2022 at 7:01 PM Andy Grove wrote: > > > Hi, > > > > I would like to propose a release of Ap

Re: [VOTE][RUST] Release Apache Arrow Rust 28.0.0 RC1

2022-11-25 Thread Ian Joiner
+1 (Non-binding) Looks good! :) Ian On Fri, Nov 25, 2022 at 2:43 PM Andrew Lamb wrote: > To: dev@arrow.apache.org > Subject: [VOTE][RUST] Release Apache Arrow Rust 28.0.0 RC1 > > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 28.0.0. > > This release c

Re: [ANNOUNCE] New Arrow PMC member: Kun Liu

2022-11-14 Thread Ian Joiner
Congrats! On Sun, Nov 13, 2022 at 3:22 PM Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Kun Liu to become a PMC member and we are pleased to announce > that Kun Liu has accepted. > > Congratulations and welcome! >

Re: [VOTE][RUST] Release Apache Arrow Rust 27.0.0 RC1

2022-11-11 Thread Ian Joiner
+1 (Non-binding) Verified on my System76/Ubuntu 22.04/AMD64 On Fri, Nov 11, 2022 at 3:12 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 27.0.0. > > This release candidate is based on commit: > 94565bca99b5d9932a3e9a8e094aaf4e4384

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 14.0.0 RC1

2022-11-05 Thread Ian Joiner
+1 (Non-binding) Verified on my System76/Ubuntu 22.04/AMD64 On Fri, Nov 4, 2022 at 5:40 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > version 14.0.0. > > This release candidate is based on commit: > 6d00bd990ce5644181ad1549a6c70c

Re: [VOTE][RUST] Release Apache Arrow Rust 26.0.0 RC2

2022-11-01 Thread Ian Joiner
+1 (Non-binding) Ian Tested on my Ubuntu 22.04/AMD64/System76 On Mon, Oct 31, 2022 at 2:10 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 26.0.0. > > This release candidate is based on commit: > 36b8dfcf28382cb3344dd1a1979372e7c

Re: [VOTE][RUST] Release Apache Arrow Rust 26.0.0 RC1

2022-10-31 Thread Ian Joiner
+1 (Non-binding) Verified on Ubuntu 22.04/AMD/System76 On Fri, Oct 28, 2022 at 4:14 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 26.0.0. > > This release candidate is based on commit: > 779804317d9c9d80e72a955deb8594eb45a8308a

Re: [ANNOUNCE] New Arrow committer: Ben Baumgold

2022-10-26 Thread Ian Joiner
Congrats Ben! Ian On Wednesday, October 26, 2022, Sutou Kouhei wrote: > On behalf of the Arrow PMC, I'm happy to announce that Ben Baumgold > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > kou >

Re: [ANNOUNCE] New Arrow committer: Eric Patrick Hanson

2022-10-26 Thread Ian Joiner
Congrats Eric! Ian On Wednesday, October 26, 2022, Sutou Kouhei wrote: > On behalf of the Arrow PMC, I'm happy to announce that Eric Patrick Hanson > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > kou >

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-26 Thread Ian Joiner
Congrats Nic! Ian On Tuesday, October 25, 2022, Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Nicola Crane to become a PMC member and we are pleased to announce > that Nicola Crane has accepted. > > Congratulations and welcome! >

Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn

2022-10-26 Thread Ian Joiner
Congrats Jacob! Ian On Tuesday, October 25, 2022, Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Jacob Quinn to become a PMC member and we are pleased to announce > that Jacob Quinn has accepted. > > Congratulations and welcome! >

Re: [ANNOUNCE] New Arrow committer: Bogumił Kamiński

2022-10-26 Thread Ian Joiner
Congrats Bogumił! Ian On Tuesday, October 25, 2022, Sutou Kouhei wrote: > Hi, > > On behalf of the Arrow PMC, I'm happy to announce that Bogumił Kamiński > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Thanks, > -- > kou >

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.1 RC1

2022-10-07 Thread Ian Joiner
+1 (Non-binding) Never mind. It is slow but it still works. On Fri, Oct 7, 2022 at 11:32 AM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Object > Store Implementation, version 0.5.1. > > This release candidate is based on commit: > 8a54e95850fe27ac5865a02e

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.1 RC1

2022-10-07 Thread Ian Joiner
0 (non-binding) The tests did run successfully. However *cargo publish --dry-run* hangs regardless of whether it is executed as a part of the verification script. Verified on my Ubuntu 22.04/AMD On Fri, Oct 7, 2022 at 11:32 AM Andrew Lamb wrote: > Hi, > > I would like to propose a release of

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 13.0.0 RC1

2022-10-07 Thread Ian Joiner
+1 (non-binding) Verified on my Ubuntu 22.04 / AMD On Fri, Oct 7, 2022 at 7:26 AM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > version 13.0.0. > > This release candidate is based on commit: > 807a0c1d2963f6ca327d316badb4ed0fa77e9f2

Re: [ANNOUNCE] New Arrow committer: Dan Harris

2022-09-20 Thread Ian Joiner
Congrats Dan! On Tue, Sep 20, 2022 at 9:10 AM Andrew Lamb wrote: > On behalf of the Arrow PMC, I'm happy to announce that Dan Harris > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Andrew >

Re: [ANNOUNCE] New Arrow PMC member: Raphael Taylor-Davies

2022-09-20 Thread Ian Joiner
Congrats Raphael! On Mon, Sep 19, 2022 at 9:56 PM Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Raphael Taylor-Davies to become a PMC member and we are pleased to announce > that Raphael Taylor-Davies has accepted. > > Congratulations and welcome! >

Re: [VOTE][RUST] Release Apache Arrow Rust 23.0.0 RC2

2022-09-17 Thread Ian Joiner
+1 (Non-binding) Verified on my macOS 12.2.1 / Apple M1 Pro On Fri, Sep 16, 2022 at 2:05 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 23.0.0. > > This release candidate is based on commit: > 5a55406cf24171600a143a83a95046c7513f

Re: [VOTE][RUST][Ballista] Release Apache Arrow Ballista 0.8.0 RC2

2022-09-16 Thread Ian Joiner
+1 (Non-binding) Verified on my macOS 12.2.1 / Apple M1 Pro On Fri, Sep 16, 2022 at 4:02 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow Ballista Implementation, > version 0.8.0. > > This release candidate is based on commit: > 04f236b407cfeff9e164e4658c826aedef

Re: [VOTE][RUST] Release Apache Arrow Rust 23.0.0 RC2

2022-09-16 Thread Ian Joiner
0 (Non-binding) I found a problem related to the new arrow-buffer crate. + cargo publish --dry-run *Updating* crates.io index * Packaging* arrow v23.0.0 (/private/var/folders/cl/ycxd_6916zlf50f8mpthd9qwgn/T/arrow-23.0.0.X.yNgAGJ0B/apache-arrow-rs-23.0.0/arrow) *error**:* failed t

Re: Subject: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 12.0.0 RC1

2022-09-13 Thread Ian Joiner
+1 (Non-binding) Verified on my macOS 12.2.1 / Apple M1 Chip On Mon, Sep 12, 2022 at 2:55 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > version 12.0.0. > > This release candidate is based on commit: > 97b3a4b37f54aaa52f8705db3e57

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.0 RC1

2022-09-10 Thread Ian Joiner
+1 (Non-binding) Verified on macOS 12.2.1 / Apple M1 On Thu, Sep 8, 2022 at 2:03 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Object > Store Implementation, version 0.5.0. > > This release candidate is based on commit: > dd58805b1c46691fcbe5b46412b2581a

Re: [ANNOUNCE] New Arrow committer: Remzi Yang

2022-09-10 Thread Ian Joiner
Congrats Remzi! On Sat, Sep 10, 2022 at 8:12 AM Andrew Lamb wrote: > On behalf of the Arrow PMC, I'm happy to announce that Remzi Yang > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Andrew >

[Discussion] Arrow-rs minor and patch releases

2022-09-08 Thread Ian Joiner
Hi, Currently we have 2 major releases for arrow-rs and arrow-datafusion per month. What then happens is that API breaking changes in Arrow will necessarily require Datafusion to be modified ASAP for compatibility. Then the changes in Datafusion will necessarily require Ballista to be modified. I

Re: [ANNOUNCE] New Arrow PMC member: L. C. Hsieh

2022-09-05 Thread Ian Joiner
Congrats L.C.! On Sat, Sep 3, 2022 at 5:39 PM Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > L. C. Hsieh to become a PMC member and we are pleased to announce > that L. C. Hsieh has accepted. > > Congratulations and welcome! >

Re: [ANNOUNCE] New Arrow PMC member: Weston Pace

2022-09-05 Thread Ian Joiner
Congrats Weston! On Mon, Sep 5, 2022 at 1:56 AM Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Weston Pace to become a PMC member and we are pleased to announce > that Weston Pace has accepted. > > Congratulations and welcome! >

Re: [VOTE][RUST] Release Apache Arrow Rust 22.0.0 RC1

2022-09-02 Thread Ian Joiner
+1 (Non-binding) Tested on macOS 12.2.1 / Apple M1 On Fri, Sep 2, 2022 at 2:11 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 22.0.0. > > This release candidate is based on commit: > e5b9d05ec50807666efe401729708d53216d79fc [1] >

Re: [VOTE][RUST] Release Apache Arrow Rust 21.0.0 RC2

2022-08-19 Thread Ian Joiner
+1 (Non-binding) Verified on macOS 12.2.1 + Apple M1 Pro On Thu, Aug 18, 2022 at 5:23 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 21.0.0. > > This release candidate is based on commit: > 68934f0fa5da62ae9fcbb753d1dfd8f672a4eb1

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 11.0.0 RC1

2022-08-16 Thread Ian Joiner
Never mind the PS in the last email haha. On Tue, Aug 16, 2022 at 1:16 PM Ian Joiner wrote: > +1 (Non-binding) > > Verified on macOS 12.2.1 / Apple M1 Pro > > P.S. If verified with zsh instead of bash we got a command not found for > shasum > -a 256 -c on verify_dir_a

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 11.0.0 RC1

2022-08-16 Thread Ian Joiner
+1 (Non-binding) Verified on macOS 12.2.1 / Apple M1 Pro P.S. If verified with zsh instead of bash we got a command not found for shasum -a 256 -c on verify_dir_artifact_signatures:10 unless shasums are disabled which has been happening for a while. Not sure whether we want to fix this. If so I w

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.4.0 RC2

2022-08-11 Thread Ian Joiner
+1 (Non-binding) Verified on macOS 12.2.1 with Apple M1 Pro chip Ian On Wed, Aug 10, 2022 at 10:28 AM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Object > Store Implementation, version 0.4.0. > > This is my first attempt to do a release so please let me

Re: [VOTE][RUST] Release Apache Arrow Rust 20.0.0 RC2

2022-08-08 Thread Ian Joiner
+1 (Non-binding) Tested on macOS 12.2.1 with Apple M1 Pro chip On Fri, Aug 5, 2022 at 5:07 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 20.0.0. Note it includes the new object_store source as described > in [5]. I don't think i

Re: [VOTE][RUST] Release Apache Arrow Rust 19.0.0 RC1

2022-07-22 Thread Ian Joiner
+1 (Non-binding) Tested on a MacBook Pro with macOS 12.2.1 & Apple M1 Pro chip On Fri, Jul 22, 2022 at 12:56 PM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 19.0.0. > > This release candidate is based on commit: > c3e019f3011a902a

[Rust] IPC Format / Feather support in Datafusion

2022-07-22 Thread Ian Joiner
Hi, I'd like to ask about the level of Feather support in Datafusion. Can we read and write Feather files? I don't really find any information while searching through the repo or checking the docs. Thanks, Ian

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 10.0.0 RC1

2022-07-13 Thread Ian Joiner
0 (non-binding) I got 3 errors while running the verification script which I have attached. sql::explain_analyze::csv_explain sql::explain_analyze::test_physical_plan_display_indent sql::explain_analyze::test_physical_plan_display_indent_multi_children Tested on macOS Monterey / Apple M1 Pro

Re: [Docs] sphinx-tabs and build errors

2022-03-21 Thread Ian Joiner
Here is the PR: https://github.com/apache/arrow/pull/12684 > On Mar 21, 2022, at 2:52 PM, Joris Van den Bossche > wrote: > > On Sun, 20 Mar 2022 at 07:50, Ian Joiner wrote: > >> Hi, >> >> I’d like to ask about how the documentation is built. I have followed

Re: [Docs] sphinx-tabs and build errors

2022-03-21 Thread Ian Joiner
> On Sun, 20 Mar 2022 at 07:50, Ian Joiner wrote: > > > Hi, > > > > I’d like to ask about how the documentation is built. I have followed the > > instructions to build and install the C++ and Python libraries in my > > virtual environment and then

[Docs] sphinx-tabs and build errors

2022-03-19 Thread Ian Joiner
Hi, I’d like to ask about how the documentation is built. I have followed the instructions to build and install the C++ and Python libraries in my virtual environment and then followed the instructions for building the documentation. However unfortunately it failed. Moreover manually adding to

Re: [ANNOUNCE] New Arrow committer: Jacob Quinn

2022-02-24 Thread Ian Joiner
Congrats Jacob! On Thursday, February 24, 2022, David Li wrote: > Congrats & welcome Jacob! > > On Thu, Feb 24, 2022, at 17:39, Rok Mihevc wrote: > > Congratulations Jacob! > > > > Rok > > > > On Thu, Feb 24, 2022 at 11:13 PM Micah Kornfield > wrote: > >> > >> Congrats Jacob! > >> > >> On Thu,

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-09 Thread Ian Joiner
shows "7.0 > (stable)" and "8.0 (dev)". > > You might need a hard refresh of the browser page (the list of > versions might be cached). > > Joris > > > On Wed, 9 Feb 2022 at 07:03, Ian Joiner wrote: > > > > Sure. Let’s actually keep it sim

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-08 Thread Ian Joiner
ou > upload it to somewhere such as https://gist.github.com/ ? > > In > "Re: [VOTE] Release Apache Arrow 7.0.0 - RC10" on Tue, 8 Feb 2022 > 20:51:16 -0500, > Ian Joiner wrote: > > > The URLs are good. It is the values in the drop-down list that still >

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-08 Thread Ian Joiner
> > * https://arrow.apache.org/docs/6.0/index.html > * https://arrow.apache.org/docs/index.html > * https://arrow.apache.org/docs/dev/index.html > > > Thanks, > -- > kou > > In > "Re: [VOTE] Release Apache Arrow 7.0.0 - RC10" on Tue, 8 Feb 2022 17:35:47 >

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-08 Thread Ian Joiner
Really thanks! I do need to mention that versioning in the docs is still not displayed properly (7.0 is labelled “6.0 (stable)” while 8.0 is labelled “7.0 (dev)”). Ian On Tuesday, February 8, 2022, Sutou Kouhei wrote: > Homebrew, MSYS2 and RubyGems are done: > > 1. [done] make the released ver

Re: [Python] Parquet CMake issue

2022-02-03 Thread Ian Joiner
2022, Antoine Pitrou wrote: > > Hi Ian, > > Did you run "make install" as well after compiling Arrow C++? Perhaps > PyArrow is picking up an old installed version? > > Regards > > Antoine. > > Le 03/02/2022 à 08:35, Ian Joiner a écrit : > >> Hi, >&g

[Python] Parquet CMake issue

2022-02-02 Thread Ian Joiner
Hi, In order to prevent problematic PRs from happening again I’m cleaning up my local env. Here is my cmake: cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ -DCMAKE_INSTALL_LIBDIR=lib \ -DCMAKE_BUILD_TYPE=debug \ -DARROW_WITH_BZ2=ON \ -DARROW_WITH_ZLIB=ON \ -DARROW_WIT

Re: Release 7.0.0 Retrospective

2022-02-01 Thread Ian Joiner
Could you please share the retro board so that we can all comment on the issues? I’m very sorry for at least two of the redos were actually related to ORC with one of them caused by a simple import error I didn’t find in my Python docker tests which is caused by the fact that my old way to run P

Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Ian Joiner
Congrats Kou! On Tuesday, January 25, 2022, Wes McKinney wrote: > I am pleased to announce that we have a new PMC chair and VP as per > our newly started tradition of rotating the chair once a year. I have > resigned and Kouhei was duly elected by the PMC and approved > unanimously by the board.

Re: [ANNOUNCE] New Arrow PMC member: Yibo Cai

2022-01-04 Thread Ian Joiner
Congrats Yibo! Ian On Tuesday, January 4, 2022, Weston Pace wrote: > Congratulations Yibo! > > On Tue, Jan 4, 2022, 5:14 AM David Li wrote: > > > Congrats, Yibo! > > > > -David > > > > On Tue, Jan 4, 2022, at 10:09, Benson Muite wrote: > > > Congratulations! > > > > > > On 1/4/22 6:00 PM, Wang

Re: [ANNOUNCE] New Arrow PMC member: Daniël Heres

2021-12-21 Thread Ian Joiner
Congrats Daniël! Well deserved! Ian On Tuesday, December 21, 2021, Jorge Cardoso Leitão < jorgecarlei...@gmail.com> wrote: > Congratulations!! > > On Tue, Dec 21, 2021 at 5:24 PM Andrew Lamb wrote: > > > Congratulations Daniël ! Well deserved > > > > On Tue, Dec 21, 2021 at 12:18 PM Wes McKinne

[C++] CompressionSize vs CompressionBlockSize & StripeSize

2021-12-09 Thread Ian Joiner
ntical to CompressionBlockSize. 2. What’s the unit of the StripeSize? Is it in bytes, KBs, MBs or something else? Thanks, Ian Joiner

Re: [ANNOUNCE] New Arrow committer: Rémi Dattai

2021-12-07 Thread Ian Joiner
Congrats! On Tuesday, December 7, 2021, Wes McKinney wrote: > On behalf of the Arrow PMC, I'm happy to announce that Rémi Dattai has > accepted an invitation to become a committer on Apache Arrow. Welcome, > and thank you for your contributions! > > Wes >

[C++][Python] Metadata and ORC

2021-12-05 Thread Ian Joiner
Hi, Currently the ORC reader can read ORC metadata of a table. However it doesn’t actually write the obtained metadata into the schema of the resulting Arrow Table. The ORC writer can not write either field-specific or schema-level metadata from Arrow Tables into ORC. I wonder whether we should c

Re: [Python] How to make a new C++ header file available in Python

2021-11-28 Thread Ian Joiner
/adapter_options.h get recognized even though it clearly exists, is used in _orc.pxd and the C++ builds do recognize its existence. Here is the PR: https://github.com/apache/arrow/pull/9702 Best, Ian On Friday, November 26, 2021, Ian Joiner wrote: > Hi, > > I have added a new C++ header file, arrow

Re: [Python] io.BytesIO and pyarrow.BufferOutputStream

2021-11-27 Thread Ian Joiner
gt;> >> Le 22/11/2021 à 06:31, Ian Joiner a écrit : >>> Hi, >>> >>> According to https://arrow.apache.org/docs/python/memory.html >>> pyarrow.BufferOutputStream >>> has similar semantics to io.BytesIO. However the ORC writer apparently >>

[Python] How to make a new C++ header file available in Python

2021-11-26 Thread Ian Joiner
Hi, I have added a new C++ header file, arrow/adapters/orc/adapter_options.h which is not recognized in Cython in our Github Action builds. I wonder what kind of changes (in CMake? I haven’t found any relevant piece in the one CMakeLists.txt in the python directory though) are necessary to mak

Re: [Doc] ORC-related documentation

2021-11-25 Thread Ian Joiner
w/blob/master/docs/source/python/parquet.rst > > Best, > Joris > > On Wed, 24 Nov 2021 at 04:55, Ian Joiner wrote: > > > > Hi, > > > > Today I found that pretty much none of our ORC-related work (e.g. ORC > > writer in C++ & Python, Arrow Dataset with

[Doc] ORC-related documentation

2021-11-23 Thread Ian Joiner
Hi, Today I found that pretty much none of our ORC-related work (e.g. ORC writer in C++ & Python, Arrow Dataset with ORC) has ever been documented. This is something we have to fix or users won’t even be aware that ORC support exists, let alone how to use it. >From my understanding it seems that

[Python] io.BytesIO and pyarrow.BufferOutputStream

2021-11-21 Thread Ian Joiner
Hi, According to https://arrow.apache.org/docs/python/memory.html pyarrow.BufferOutputStream has similar semantics to io.BytesIO. However the ORC writer apparently works with paths, file objects and pyarrow.BufferOutputStream well but do not work with io.BytesIO (i.e. the writer simply writes “ORC

Re: [Python] Shall all-null object type columns in Pandas be converted into Arrow columns with NullType type?

2021-11-21 Thread Ian Joiner
21 Nov 2021 04:21:52 -0500 > Ian Joiner wrote: > > Hi, > > > > When an all NA column from Pandas of the object type is converted to > Arrow using Table.from_pandas we get a column of the NullType type as > opposed to StringType/BinaryType. Is this actually intended?

[Python] Shall all-null object type columns in Pandas be converted into Arrow columns with NullType type?

2021-11-21 Thread Ian Joiner
Hi, When an all NA column from Pandas of the object type is converted to Arrow using Table.from_pandas we get a column of the NullType type as opposed to StringType/BinaryType. Is this actually intended? Ian Joiner

Re: [ANNOUNCE] New Arrow PMC member: Joris Van den Bossche

2021-11-17 Thread Ian Joiner
Congrats Joris and really thanks for your effort in integrating ORC and dataset! Ian > On Nov 17, 2021, at 5:55 PM, Wes McKinney wrote: > > The Project Management Committee (PMC) for Apache Arrow has invited > Joris Van den Bossche to become a PMC member and we are pleased to > announce that J