[RESULT][VOTE] Release Apache Arrow JS 0.4.0 - RC1

With 4 +1 (3 binding), this VOTE passes. I will upload the release and send out the announcement later. @Paul, Brian can one of you write a short blog post about the new things in 0.4 for the Arrow blog? Uwe On Mon, Feb 4, 2019, at 10:45 PM, Paul Taylor wrote: > +1 > > verified on

Re: [ANNOUNCE] New Arrow committer: Ravindra Pindikura

Congratulations. On Mon, Feb 4, 2019 at 9:47 PM Philipp Moritz wrote: > Congratulations! > > On Mon, Feb 4, 2019 at 9:44 PM Ravindra Pindikura > wrote: > > > Thanks everyone. It’s been a pleasure to work with the arrow community, > > and I feel honored. > > > > > On Feb 5, 2019, at 9:28 AM,

Re: Arrow and R benchmark

Disclaimer: I work for Google (not on BQ). Everything I'm going to write reflects my own opinions, not those of my company. Jonathan and Wes, One way of trying to get support for this is filing a feature request at [1] and getting broader customer support for it. Another possible way of

Re: [ANNOUNCE] New Arrow committer: Ravindra Pindikura

Congratulations! On Mon, Feb 4, 2019 at 9:44 PM Ravindra Pindikura wrote: > Thanks everyone. It’s been a pleasure to work with the arrow community, > and I feel honored. > > > On Feb 5, 2019, at 9:28 AM, Bryan Cutler wrote: > > > > Congratulations Ravindra! > > > > On Mon, Feb 4, 2019, 7:40 PM

Re: [ANNOUNCE] New Arrow committer: Ravindra Pindikura

Thanks everyone. It’s been a pleasure to work with the arrow community, and I feel honored. > On Feb 5, 2019, at 9:28 AM, Bryan Cutler wrote: > > Congratulations Ravindra! > > On Mon, Feb 4, 2019, 7:40 PM Praveen Kumar >> Congrats again Ravindra :) >> >> On Tue, Feb 5, 2019 at 12:32 AM

[jira] [Created] (ARROW-4479) [Plasma] Add S3 as external store for Plasma

Anurag Khandelwal created ARROW-4479: Summary: [Plasma] Add S3 as external store for Plasma Key: ARROW-4479 URL: https://issues.apache.org/jira/browse/ARROW-4479 Project: Apache Arrow

[jira] [Created] (ARROW-4478) [R] Remove brew recommendation when installation fails

Aki Ariga created ARROW-4478: Summary: [R] Remove brew recommendation when installation fails Key: ARROW-4478 URL: https://issues.apache.org/jira/browse/ARROW-4478 Project: Apache Arrow Issue

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Congratulations Andy! On Mon, Feb 4, 2019, 3:29 PM Philipp Moritz Congratulations! > > On Mon, Feb 4, 2019 at 3:16 PM Krisztián Szűcs > wrote: > > > Congrats Andy! :) > > > > On Mon, Feb 4, 2019 at 4:39 PM Wes McKinney wrote: > > > > > The Project Management Committee (PMC) for Apache Arrow

[jira] [Created] (ARROW-4477) [JS] Bn shouldn't override constructor of the resulting typed array

Paul Taylor created ARROW-4477: -- Summary: [JS] Bn shouldn't override constructor of the resulting typed array Key: ARROW-4477 URL: https://issues.apache.org/jira/browse/ARROW-4477 Project: Apache Arrow

Re: [ANNOUNCE] New Arrow committer: Ravindra Pindikura

Congratulations Ravindra! On Mon, Feb 4, 2019, 7:40 PM Praveen Kumar Congrats again Ravindra :) > > On Tue, Feb 5, 2019 at 12:32 AM Robert Nishihara < > robertnishih...@gmail.com> > wrote: > > > Congratulations! > > > > On Mon, Feb 4, 2019 at 10:06 AM Antoine Pitrou > wrote: > > > > > > > >

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Thanks everyone! I'm honored and excited to be part of the PMC for this great project. On Mon, Feb 4, 2019 at 4:29 PM Philipp Moritz wrote: > Congratulations! > > On Mon, Feb 4, 2019 at 3:16 PM Krisztián Szűcs > wrote: > > > Congrats Andy! :) > > > > On Mon, Feb 4, 2019 at 4:39 PM Wes McKinney

Re: [ANNOUNCE] New Arrow committer: Ravindra Pindikura

Congrats again Ravindra :) On Tue, Feb 5, 2019 at 12:32 AM Robert Nishihara wrote: > Congratulations! > > On Mon, Feb 4, 2019 at 10:06 AM Antoine Pitrou wrote: > > > > > Congratulations and thanks for all the work on Gandiva :-) > > > > Regards > > > > Antoine. > > > > > > Le 04/02/2019 à

Re: Arrow and R benchmark

Arrow support would be an obvious win for BigQuery. I've spoken with people at Google Cloud about this in several occasions. With the gRPC / Flight work coming along it might be a good opportunity to rekindle the discussion. If anyone from GCP is reading or if you know anyone at GCP who might be

[jira] [Created] (ARROW-4476) [Rust] [DataFusion] Post donation clean up tasks

Andy Grove created ARROW-4476: - Summary: [Rust] [DataFusion] Post donation clean up tasks Key: ARROW-4476 URL: https://issues.apache.org/jira/browse/ARROW-4476 Project: Apache Arrow Issue Type:

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Congratulations! On Mon, Feb 4, 2019 at 3:16 PM Krisztián Szűcs wrote: > Congrats Andy! :) > > On Mon, Feb 4, 2019 at 4:39 PM Wes McKinney wrote: > > > The Project Management Committee (PMC) for Apache Arrow has invited > > Andy Grove to become a PMC member and we are pleased to announce that

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Congrats Andy! :) On Mon, Feb 4, 2019 at 4:39 PM Wes McKinney wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Andy Grove to become a PMC member and we are pleased to announce that > Andy has accepted. > > Congratulations and welcome! >

Re: Arrow and R benchmark

Hi Wes, I am currently working a lot with Google BigQuery in R and Python. Hadley Wickham listed this as a big bottleneck for his library bigrquery. *The bottleneck for loading BigQuery data is now parsing BigQuery’s JSON format, which is difficult to optimise further because I’m already using

Re: [VOTE] Release Apache Arrow JS 0.4.0 - RC1

+1 verified on 18.04.1-Ubuntu and node v11.6.0 > On 1/31/19 9:38 AM, Krisztián Szűcs wrote: > +1 (binding), > > verified on OSX Mojave and Node v11.4.0 > >> On Thu, Jan 31, 2019 at 6:06 PM Brian Hulette wrote: >> >> +1 >> >> verified on Archlinux with Node v11.9.0 >> >> Thanks a lot for

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Congratulations! On Mon, Feb 4, 2019, 14:47 Chao Sun wrote: > Congratulations Andy! > > On Mon, Feb 4, 2019 at 10:40 AM Micah Kornfield > wrote: > > > Congratulations. > > > > On Mon, Feb 4, 2019 at 10:13 AM Antoine Pitrou > wrote: > > > > > > > > Welcome on board Andy! Hopefully this will

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Congratulations Andy! On Mon, Feb 4, 2019 at 10:40 AM Micah Kornfield wrote: > Congratulations. > > On Mon, Feb 4, 2019 at 10:13 AM Antoine Pitrou wrote: > > > > > Welcome on board Andy! Hopefully this will fuel Rust contributions in > > the future. > > > > Regards > > > > Antoine. > > > > >

[jira] [Created] (ARROW-4474) [Flight] FlightInfo should use signed integer types for payload size

David Li created ARROW-4474: --- Summary: [Flight] FlightInfo should use signed integer types for payload size Key: ARROW-4474 URL: https://issues.apache.org/jira/browse/ARROW-4474 Project: Apache Arrow

Re: TensorFlow, PyTorch, and manylinux1

Replying to the thread because the last two messages got dropped. On Mon, Feb 4, 2019 at 10:00 AM soumith wrote: > > I think trying to package CUDA is the wrong way to think about it. > Instead, perhaps you should try to make the package compatible with > system CUDA installs. > > I agree in

Re: [ANNOUNCE] New Arrow committer: Ravindra Pindikura

Congratulations! On Mon, Feb 4, 2019 at 10:06 AM Antoine Pitrou wrote: > > Congratulations and thanks for all the work on Gandiva :-) > > Regards > > Antoine. > > > Le 04/02/2019 à 16:40, Wes McKinney a écrit : > > On behalf of the Arrow PMC, I'm happy to announce that Ravindra has an > >

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Congratulations. On Mon, Feb 4, 2019 at 10:13 AM Antoine Pitrou wrote: > > Welcome on board Andy! Hopefully this will fuel Rust contributions in > the future. > > Regards > > Antoine. > > > Le 04/02/2019 à 16:38, Wes McKinney a écrit : > > The Project Management Committee (PMC) for Apache

Re: Benchmarking dashboard proposal

I hope to make a PR with the DDL by tomorrow or Wednesday night—DDL along with a README in a new directory `arrow/dev/benchmarking` unless directed otherwise. A "C++ Benchmark Collector" script would be super. I expect some back-and-forth on this to identify naïve assumptions in the data model.

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Welcome on board Andy! Hopefully this will fuel Rust contributions in the future. Regards Antoine. Le 04/02/2019 à 16:38, Wes McKinney a écrit : > The Project Management Committee (PMC) for Apache Arrow has invited > Andy Grove to become a PMC member and we are pleased to announce that >

Re: [ANNOUNCE] New Arrow committer: Ravindra Pindikura

Congratulations and thanks for all the work on Gandiva :-) Regards Antoine. Le 04/02/2019 à 16:40, Wes McKinney a écrit : > On behalf of the Arrow PMC, I'm happy to announce that Ravindra has an > accepted an invitation to become a committer on Apache Arrow. > > Welcome, and thank you for

[jira] [Created] (ARROW-4473) [Website] Add instructions to do a test-deploy of Arrow website and fix bugs

Wes McKinney created ARROW-4473: --- Summary: [Website] Add instructions to do a test-deploy of Arrow website and fix bugs Key: ARROW-4473 URL: https://issues.apache.org/jira/browse/ARROW-4473 Project:

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Congratulations! On Mon, Feb 4, 2019 at 10:02 AM paddy horan wrote: > Congrats Andy > > Get Outlook for iOS > > > From: Wes McKinney > Sent: Monday, February 4, 2019 10:39 AM > To: dev@arrow.apache.org > Subject: [ANNOUNCE] New Arrow PMC

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Congrats Andy Get Outlook for iOS From: Wes McKinney Sent: Monday, February 4, 2019 10:39 AM To: dev@arrow.apache.org Subject: [ANNOUNCE] New Arrow PMC member: Andy Grove The Project Management Committee (PMC) for Apache Arrow has invited

Re: TensorFlow, PyTorch, and manylinux1

> I think trying to package CUDA is the wrong way to think about it. Instead, perhaps you should try to make the package compatible with system CUDA installs. I agree in principle. The problem fundamentally stems from user expectation. In my ~6+ years of supporting Torch and PyTorch, installing

Re: TensorFlow, PyTorch, and manylinux1

On Tue, 5 Feb 2019 01:45:34 +0800 Jason Zaman wrote: > On Tue, 5 Feb 2019 at 01:30, soumith wrote: > > > > Unfortunately I'll be on a long flight, and cannot make it to the SIGBuild > > meeting. > > I'm definitely interested in the meeting notes and any follow-up meeting. > > > > > I think we

[jira] [Created] (ARROW-4472) [Website][Python] Blog post about Python string memory use improvements in 0.12

Wes McKinney created ARROW-4472: --- Summary: [Website][Python] Blog post about Python string memory use improvements in 0.12 Key: ARROW-4472 URL: https://issues.apache.org/jira/browse/ARROW-4472 Project:

Re: TensorFlow, PyTorch, and manylinux1

On Tue, 5 Feb 2019 at 01:30, soumith wrote: > > Unfortunately I'll be on a long flight, and cannot make it to the SIGBuild > meeting. > I'm definitely interested in the meeting notes and any follow-up meeting. > > > I think we should leave CUDA out of the > discussion initially and see if we can

Re: TensorFlow, PyTorch, and manylinux1

Unfortunately I'll be on a long flight, and cannot make it to the SIGBuild meeting. I'm definitely interested in the meeting notes and any follow-up meeting. > I think we should leave CUDA out of the discussion initially and see if we can get the cpu-only wheel working correctly. Hopefully

Re: TensorFlow, PyTorch, and manylinux1

Le 04/02/2019 à 17:36, Uwe L. Korn a écrit : > I think that problem is whether this would get merged. Conda was created > after a meeting with Guido van Rossum and other folks at a PyCon quite > some years ago where the final call was that this is not a problem of > the core Python ecosystem and

Re: TensorFlow, PyTorch, and manylinux1

Hm, lets have this SIG-Build meeting as scheduled and then have another follow-up later probably around 9am PST, 6pm Europe, 1am Singapore. Does that time work for everyone? (Date TBD). My take on this whole thing is that it sounds a lot like re-implementing an entire distro complete with package

Re: Benchmarking dashboard proposal

hi folks, I'm curious where we currently stand on this project. I see the discussion in https://issues.apache.org/jira/browse/ARROW-4313 -- would the next step be to have a pull request with .sql files containing the DDL required to create the schema in PostgreSQL? I could volunteer to write the

[ANNOUNCE] New Arrow committer: Ravindra Pindikura

On behalf of the Arrow PMC, I'm happy to announce that Ravindra has an accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions!

[ANNOUNCE] New Arrow PMC member: Andy Grove

The Project Management Committee (PMC) for Apache Arrow has invited Andy Grove to become a PMC member and we are pleased to announce that Andy has accepted. Congratulations and welcome!

Re: TensorFlow, PyTorch, and manylinux1

yeah that's expected. The timing is complicated with people spread all over. We will post notes after the meeting on the SIG-Build mailing list and I'd also be up for organizing a separate call with europe folks if that would be of interest. On Mon, 4 Feb 2019 at 19:29, 'Manuel Klimek' via SIG

[jira] [Created] (ARROW-4471) [C++] Pass AR and RANLIB to all external projects

Uwe L. Korn created ARROW-4471: -- Summary: [C++] Pass AR and RANLIB to all external projects Key: ARROW-4471 URL: https://issues.apache.org/jira/browse/ARROW-4471 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4470) Pyarrow using considerable more memory when reading partitioned Parquet file

Ivan SPM created ARROW-4470: --- Summary: Pyarrow using considerable more memory when reading partitioned Parquet file Key: ARROW-4470 URL: https://issues.apache.org/jira/browse/ARROW-4470 Project: Apache