Re: Timeline for 0.15.0 release

2019-09-26 Thread Krisztián Szűcs
; > > >> > >> time consuming, but you are welcome to try. >> > Krisztian -- >> > >>>> > > > are >> > >>>> > > > > you >> > >>>> > > > > > > > >> >

Re: Timeline for 0.15.0 release

2019-09-26 Thread Ji Liu
> > > > > > > >> > >> > Micah > >>>> > > > > > > > >> > >> > > >>>> > > > > > > > >> > >> > [1]

Re: Timeline for 0.15.0 release

2019-09-26 Thread Micah Kornfield
gt; > > > > > > >> > >> > >>>> > > > > > > > >> > >> > Thanks, > >>>> > > > > > > > >> > >> > Micah > >>>> >

Re: Timeline for 0.15.0 release

2019-09-25 Thread Neal Richardson
gt;> > > > > > > > >> > >> > [1] >>>> > > > > > > > >> > >> >>>> > > > > >>>> > > > https://cwiki.apache.org/confluence/display/ARROW/Rel

Re: Timeline for 0.15.0 release

2019-09-25 Thread Krisztián Szűcs
; > signing key to >> > > > > > > > >> > >> >> the KEYS file in SVN (that's not very hard to >> do). I >> > > > > think it's fine >> > > >

Re: Timeline for 0.15.0 release

2019-09-25 Thread Wes McKinney
t; > > > >> > >> emkornfi...@gmail.com> wrote: > > > > > > > >> > >> >> > > > > > > > > >> > >> >> > SGTM, as well. > > > > > > > >> > >> >> > > > > > >

Re: Timeline for 0.15.0 release

2019-09-25 Thread Micah Kornfield
> > > >> > >> >> binary artifacts for the vote > > > > > > > > >> > >> >> > > > > > > > > >> > >> >> On Tue, Sep 17, 2019 at 10:55 PM Micah Kornfield < > > > > > > > > >>

Re: Timeline for 0.15.0 release

2019-09-25 Thread Neal Richardson
; a couple of concerns: > > > > > > >> > >> >> > 1. In the past I've had trouble downloading and > > > validating > > > > > > >> > >> releases. I'm a > > > > > > >>

Re: Timeline for 0.15.0 release

2019-09-24 Thread Andy Grove
. I'm a > > > > > >> > >> >> > bit worried, that I might have similar problems doing > > the necessary > > > > > >> > >> uploads. > > > > > >> > >> >> > 2. My internet connection will likely be not great

Re: Timeline for 0.15.0 release

2019-09-24 Thread Micah Kornfield
; > 2. My internet connection will likely be not great, I > don't know if > > > > >> > >> this > > > > >> > >> >> > would make it even less likely to be successful. > > > > >> > >> >> > > > > > >&

Re: Timeline for 0.15.0 release

2019-09-24 Thread Wes McKinney
would make it even less likely to be successful. > > > >> > >> >> > > > > >> > >> >> > Does it become problematic if somehow I would have to > > > >> > >> >> > abandon the > > > >> > >> process > > > &

Re: Timeline for 0.15.0 release

2019-09-24 Thread Wes McKinney
> >> > >> process > > >> > >> >> > mid-release? Is there anyone who could serve as a backup? > > >> > >> >> > Are the > > >> > >> steps > > >> > >> >&g

Re: Timeline for 0.15.0 release

2019-09-24 Thread Wes McKinney
17, 2019 at 4:25 PM Neal Richardson < > >> > >> neal.p.richard...@gmail.com> > >> > >> >> > wrote: > >> > >> >> > > >> > >> >> > > Sounds good to me. > >> > >> >> > > &

Re: Timeline for 0.15.0 release

2019-09-24 Thread Wes McKinney
;> > > Sounds good to me. >> > >> >> > > >> > >> >> > > Do we have a release manager yet? Any volunteers? >> > >> >> > > >> > >> >> > > Neal >> > >> >> > > &

Re: Timeline for 0.15.0 release

2019-09-22 Thread Micah Kornfield
; wesmck...@gmail.com> > > >> wrote: > > >> >> > > > > >> >> > > > hi all, > > >> >> > > > > > >> >> > > > It looks like we're drawing close to be

Re: Timeline for 0.15.0 release

2019-09-22 Thread Andy Grove
> > > hi all, > > >> >> > > > > > >> >> > > > It looks like we're drawing close to be able to make the > 0.15.0 > > >> >> > > > release. I would suggest "pencils down" at the end of this > week > > >> an

Re: Timeline for 0.15.0 release

2019-09-21 Thread Wes McKinney
> release. I would suggest "pencils down" at the end of this week > >> and > >> >> > > > see if a release candidate can be produced next Monday September > >> 23. > >> >> > > > Any thoughts or objections? > >&g

Re: Timeline for 0.15.0 release

2019-09-20 Thread Micah Kornfield
and >> >> > > > see if a release candidate can be produced next Monday September >> 23. >> >> > > > Any thoughts or objections? >> >> > > > >> >> > > > Thanks, >> >> > > > Wes >> >> > > > >>

Re: Timeline for 0.15.0 release

2019-09-20 Thread Krisztián Szűcs
; > > > > >> > > > > hi Eric -- yes, that's correct. I'm planning to amend the > Format docs > >> > > > > today regarding the EOS issue and also update the C++ library > >> > > > > > >> > > > > On Wed, Sep 1

Re: Timeline for 0.15.0 release

2019-09-19 Thread Wes McKinney
s, that's correct. I'm planning to amend the Format docs >> > > > > today regarding the EOS issue and also update the C++ library >> > > > > >> > > > > On Wed, Sep 11, 2019 at 11:21 AM Eric Erhardt >> > > > > wrote: >>

Re: Timeline for 0.15.0 release

2019-09-18 Thread Micah Kornfield
gt; wrote: > > > > > > > > > > > > I assume the plan is to merge the ARROW-6313-flatbuffer-alignment > > > > branch into master before the 0.15 release, correct? > > > > > > > > > > > > BT

Re: Timeline for 0.15.0 release

2019-09-18 Thread Wes McKinney
e the C# alignment changes are ready to be merged into > > > the alignment branch - https://github.com/apache/arrow/pull/5280/ > > > > > > > > > > Eric > > > > > > > > > > -Original Message- > > >

Re: Timeline for 0.15.0 release

2019-09-17 Thread Micah Kornfield
> the alignment branch - https://github.com/apache/arrow/pull/5280/ > > > > > > > > Eric > > > > > > > > -Original Message- > > > > From: Micah Kornfield > > > > Sent: Tuesday, September 10, 2019 10:24 PM > > > > To:

Re: Timeline for 0.15.0 release

2019-09-17 Thread Neal Richardson
ct? > > > > > > BTW - I believe the C# alignment changes are ready to be merged into > the alignment branch - https://github.com/apache/arrow/pull/5280/ > > > > > > Eric > > > > > > -Original Message----- > > > From: Micah Kor

Re: Timeline for 0.15.0 release

2019-09-17 Thread Wes McKinney
--Original Message- > > From: Micah Kornfield > > Sent: Tuesday, September 10, 2019 10:24 PM > > To: Wes McKinney > > Cc: dev ; niki.lj > > Subject: Re: Timeline for 0.15.0 release > > > > I should have a little more bandwidth to help with so

Re: Timeline for 0.15.0 release

2019-09-11 Thread Wes McKinney
:24 PM > To: Wes McKinney > Cc: dev ; niki.lj > Subject: Re: Timeline for 0.15.0 release > > I should have a little more bandwidth to help with some of the packaging > starting tomorrow and going into the weekend. > > On Tuesday, September 10, 2019, Wes McKinney wrote:

RE: Timeline for 0.15.0 release

2019-09-11 Thread Eric Erhardt
: Micah Kornfield Sent: Tuesday, September 10, 2019 10:24 PM To: Wes McKinney Cc: dev ; niki.lj Subject: Re: Timeline for 0.15.0 release I should have a little more bandwidth to help with some of the packaging starting tomorrow and going into the weekend. On Tuesday, September 10, 2019, Wes

Re: Timeline for 0.15.0 release

2019-09-10 Thread Micah Kornfield
I should have a little more bandwidth to help with some of the packaging starting tomorrow and going into the weekend. On Tuesday, September 10, 2019, Wes McKinney wrote: > Hi folks, > > With the state of nightly packaging and integration builds things aren't > looking too good for being in

Re: Timeline for 0.15.0 release

2019-09-10 Thread Wes McKinney
Hi folks, With the state of nightly packaging and integration builds things aren't looking too good for being in release readiness by the end of this week but maybe I'm wrong. I'm planning to be working to close as many issues as I can and also to help with the ongoing alignment fixes. Wes On

Re: Timeline for 0.15.0 release

2019-09-05 Thread Micah Kornfield
Just for reference [1] has a dashboard of the current issues: https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.15.0+Release On Thu, Sep 5, 2019 at 3:43 PM Wes McKinney wrote: > hi all, > > It doesn't seem like we're going to be in a position to release at the > beginning of next week.

Re: Timeline for 0.15.0 release

2019-09-05 Thread Wes McKinney
hi all, It doesn't seem like we're going to be in a position to release at the beginning of next week. I hope that one more week of work (or less) will be enough to get us there. Aside from merging the alignment changes, we need to make sure that our packaging jobs required for the release

Re: Timeline for 0.15.0 release

2019-08-27 Thread Wes McKinney
hi, I think we should try to release the week of September 9, so development work should be completed by end of next week. Does that seem reasonable? I plan to get up a patch for the protocol alignment changes for C++ in the next couple of days -- I think that getting the alignment work done is

Re: Timeline for 0.15.0 release

2019-08-19 Thread Ji Liu
Hi, Wes, on the java side, I can think of several bugs that need to be fixed or reminded. i. ARROW-6040: Dictionary entries are required in IPC streams even when empty[1] This one is under review now, however through this PR we find that there seems a bug in java reading and writing

Re: Timeline for 0.15.0 release

2019-08-19 Thread Wes McKinney
I'm going to work some on organizing the 0.15.0 backlog some this week, if anyone wants to help with grooming (particularly for languages other than C++/Python where I'm focusing) that would be helpful. There have been almost 500 JIRA issues opened since the 0.14.0 release, so we should make sure

Re: Timeline for 0.15.0 release

2019-08-15 Thread Wes McKinney
The Windows wheel issue in 0.14.1 seems to be https://issues.apache.org/jira/browse/ARROW-6015 I think the root cause could be the Windows changes in https://github.com/apache/arrow/commit/223ae744cc2a12c60cecb5db593263a03c13f85a I would be appreciative if a volunteer would look into what was

Re: Timeline for 0.15.0 release

2019-08-15 Thread Antoine Pitrou
On Thu, 15 Aug 2019 11:17:07 -0700 Micah Kornfield wrote: > > > > In C++ they are > > independent, we could have 32-bit array lengths and variable-length > > types with 64-bit offsets if we wanted (we just wouldn't be able to > > have a List child with more than INT32_MAX elements). > > I

Re: Timeline for 0.15.0 release

2019-08-15 Thread Micah Kornfield
> > In C++ they are > independent, we could have 32-bit array lengths and variable-length > types with 64-bit offsets if we wanted (we just wouldn't be able to > have a List child with more than INT32_MAX elements). I think the point is we could do this in C++ but we don't. I'm not sure we would

Re: Timeline for 0.15.0 release

2019-08-15 Thread Wes McKinney
On Thu, Aug 15, 2019 at 12:00 AM Micah Kornfield wrote: > > Hi Wes, > > > > Do these need to be dependent on the 64-bit array length discussion? > > We could hack something that can read the lower 32-bit range, so I guess > not, but this leaves a bad taste in my mouth. I think there is likely >

Re: Timeline for 0.15.0 release

2019-08-14 Thread Micah Kornfield
Hi Wes, > > Do these need to be dependent on the 64-bit array length discussion? We could hack something that can read the lower 32-bit range, so I guess not, but this leaves a bad taste in my mouth. I think there is likely still enough time to have the discussion and get these implemented, one

Re: Timeline for 0.15.0 release

2019-08-14 Thread Antoine Pitrou
Agreed with Wes. Regards Antoine. Le 14/08/2019 à 20:30, Wes McKinney a écrit : > For the record, I don't think we should hold a major release hostage > if we aren't able to complete various feature milestones in time. > Since it's been about 5-6 weeks since 0.14.0 we're coming close to the

Re: Timeline for 0.15.0 release

2019-08-14 Thread Wes McKinney
For the record, I don't think we should hold a major release hostage if we aren't able to complete various feature milestones in time. Since it's been about 5-6 weeks since 0.14.0 we're coming close to the desired 8-10 week timeline for major releases, so if we need to have 0.16.0 prior to 1.0.0,

Re: Timeline for 0.15.0 release

2019-08-14 Thread Wes McKinney
On Wed, Aug 14, 2019 at 11:43 AM Micah Kornfield wrote: > > > > > is there anything else that has come up that > > definitely needs to happen before we can release again? > > We need to decide on a way forward for LargeList, LargeBinary, etc, types... > Do these need to be dependent on the

Re: Timeline for 0.15.0 release

2019-08-14 Thread Micah Kornfield
> > is there anything else that has come up that > definitely needs to happen before we can release again? We need to decide on a way forward for LargeList, LargeBinary, etc, types... On Tue, Aug 13, 2019 at 8:27 PM Wes McKinney wrote: > hi folks, > > Since there have been a number of fairly

Re: Timeline for 0.15.0 release

2019-08-14 Thread Wes McKinney
Is there a JIRA for the issue that caused us to pull the 0.14.1 Windows Python wheel installers? If we want to have working wheels for 0.15.0 we'll need a volunteer to help address whatever was wrong with 0.14.1. On Tue, Aug 13, 2019 at 10:26 PM Wes McKinney wrote: > > hi folks, > > Since there