Re: Bearer Token Refresh Task

2022-02-17 Thread Holden Karau
While we’re talking about this, for engines like Spark/Flink/Dask/Ray where we might have many executors does it make sense to have centralized refresh instead of each executor doing a refresh on token expiration? On Thu, Feb 17, 2022 at 12:40 PM David Li wrote: > That sounds reasonable. > > I

Re: [VOTE][Format] Allow for 256-bit Decimal's in the Arrow specification

2020-09-29 Thread Holden Karau
+1 (non-binding) On Tue, Sep 29, 2020 at 6:08 PM Sutou Kouhei wrote: > +1 > > In > "Re: [VOTE][Format] Allow for 256-bit Decimal's in the Arrow > specification" on Tue, 29 Sep 2020 13:38:04 -0700, > Jacques Nadeau wrote: > > > +1 > > > > On Tue, Sep 29, 2020 at 11:19 AM Wes McKinney >

Re: Increasing transparency of corporate support for Apache Arrow development

2018-08-15 Thread Holden Karau
So Spark lists the committers and current company affiliations (but not historic) on its website. On Wed, Aug 15, 2018 at 10:33 PM Abdul Rahman wrote: > Are there examples of other larger Apache projects that have done this? I > am assuming this should happen rather frequently given the large

Re: Recruiting more maintainers for Apache Arrow

2018-06-30 Thread Holden Karau
One of the things I’ve started doing in the Spark project is live code reviews to encourage other folks to get involved in the review process and help it seem more achievable (see https://www.youtube.com/playlist?list=PLRLebp9QyZtYF46jlSnIu2x1NDBkKa2uw ) . Another that I think has helped us is

Re: Confronting Arrow packaging problems

2018-03-23 Thread Holden Karau
I know in Spark we’ve benefited by having some of the different language devs act as RMs and each time that language dev has ended up improving a bunch of how their components packaging has been done. Not to suggest we should just do what other projects do, but maybe an idea to consider? On Fri,

Re: [DRAFT] Apache Arrow board report

2018-01-02 Thread Holden Karau
Would it make sense to mention the other Apache projects using/planning to use Arrow? On Tue, Jan 2, 2018 at 11:31 AM Li Jin wrote: > +1. Thanks Wes! > > On Tue, Jan 2, 2018 at 11:19 AM, Uwe L. Korn wrote: > > > +1 > > > > On Tue, Jan 2, 2018, at 4:21

Re: [ANNOUNCE] New Arrow committers: Phillip Cloud and Bryan Cutler

2017-10-03 Thread Holden Karau
Congrats to the both of you :) Really excited to see the Areow project continue to grow :) On Tue, Oct 3, 2017 at 10:24 AM Julian Hyde wrote: > Congratulations and welcome, Philip and Bryan! > > > On Oct 3, 2017, at 5:27 AM, Wes McKinney wrote: > > > > On

Re: [VOTE] Release Apache Arrow 0.2.0 - rc1

2017-02-14 Thread Holden Karau
e blocker though. (let us know if you think > > otherwise) > > I opened a bug: https://issues.apache.org/jira/browse/ARROW-562 > > > > > > On Tue, Feb 14, 2017 at 2:25 PM, Holden Karau <hol...@pigscanfly.ca> > > wrote: > > > >> -0 (non

Re: [VOTE] Release Apache Arrow 0.2.0 - rc1

2017-02-14 Thread Holden Karau
-0 (non-binding): mockito in compile scope may make this difficult for downstream users to package in their projects. On Tue, Feb 14, 2017 at 2:10 PM, Uwe L. Korn wrote: > I think the problem is that there are two commits in the release branch > (which I have not pushed to the

Re: [Arrow] Development packages to PyPI?

2017-01-21 Thread Holden Karau
So publishing nightlies can be a bit problematic with the ASF release requirements. I know that the Spark project got some blow back for how it used to publish certain development artifacts. I don't know the correct answer, but just this is something we probably want to be careful with rather than

Re: Weld

2016-12-15 Thread Holden Karau
The PySpark community is aware of arrow, but certainly more reaching out to the Spark SQL devs could really be beneficial to get us all on the same page :) On Thu, Dec 15, 2016 at 10:49 AM Julian Hyde wrote: > I think someone should reach out to Matei and Shoumik, and see if

Re: [VOTE] Release Apache Arrow 0.1.0 - rc2

2016-10-06 Thread Holden Karau
So I think in some other projects they also put the jars in a staging repo (e.g. http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-2-0-0-RC5-td18367.html ) - is that not the plan for arrow in 0.1.0? On Wed, Oct 5, 2016 at 4:44 PM, Julien Le Dem

[JAVA] Figuring out whats shifted from Drill/Java

2016-06-07 Thread Holden Karau
Hi Everyone, I'm looking to help get started with Arrow & Spark and to that end I'd like to start with getting the Java implementation closer to the spec / C implementation. I'm wondering what places people know the differences are between the two? Cheers, Holden :)