There were so many Rust developments recently (321 issues out of the total 650, daily almost 4 issues - including the weekends and holidays) that there is a big chance cool and great PRs are delayed to 4.0.0. This is not "just okay", but something we should celebrate. I'm simply stunned with the amount of work you have done since 2.0.0. If anything, the release cadence could be improved, but that's already on the horizon.
I'm just a simple user, but thanks to everybody in the Arrow community. I'm learning a lot just by reading the developments in different fields (datafusion optimizer, python api improvements, kernels optimizations, parquet integrations). Best regards, Adam Lippai On Wed, Jan 13, 2021 at 3:30 PM Neville Dipale <nevilled...@gmail.com> wrote: > Good day, > > I was hoping to complete the parquet list writer PR in time, but even > though I've been burning the midnight oil addressing the remaining > issues in the PR, I won't make it in time :( > > I've removed the Rust blocker from the milestone, so there should be > nothing on my side blocking us. > > Thanks everyone for the hard work. > > Neville > > On Wed, 13 Jan 2021 at 03:29, Neal Richardson <neal.p.richard...@gmail.com > > > wrote: > > > Last call for 3.0. > > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release is > > closing out, and hopefully we'll be releasable by the end of tomorrow. If > > you're trying to get something merged in time for the release, now is the > > time! > > > > Thanks all for your hard work under challenging circumstances to get us > to > > this point. > > > > Neal > > > > On Mon, Jan 11, 2021 at 11:48 AM Antoine Pitrou <anto...@python.org> > > wrote: > > > > > > > > I think it would be nice to get > > > https://github.com/apache/arrow/pull/9164 in because it changes the > > > current behaviour and is also stricter with its inputs. > > > > > > Regards > > > > > > Antoine. > > > > > > > > > Le 11/01/2021 à 20:46, Neal Richardson a écrit : > > > > Hi all, > > > > We seem to be getting closer on resolving our CI and packaging > > > challenges, > > > > despite several additional, unexpected setbacks last week. I think we > > > > should be in releasable condition in the next day or two. If you have > > any > > > > other outstanding issues you're trying to get in the 3.0 release, now > > is > > > > the time. > > > > > > > > We need a volunteer from the PMC to be release manager for 3.0.0. > > > Krisztián > > > > has done the last several releases, and I was wondering if there was > > > anyone > > > > else out there who wanted to take a turn and give him a break this > > time. > > > > > > > > Neal > > > > > > > > On Wed, Jan 6, 2021 at 9:03 PM Sutou Kouhei <k...@clear-code.com> > > wrote: > > > > > > > >> Hi Neal, > > > >> > > > >> Thanks! > > > >> > > > >>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of > > > Travis-CI > > > >> > > > >> I closed this because it has been done by > > > >> https://issues.apache.org/jira/browse/ARROW-11015 . > > > >> > > > >> > > > >> Thanks, > > > >> -- > > > >> kou > > > >> > > > >> In <CAOCv4hhMyRA8qQsRcev7ar8QHykMc2Mf6= > > gcx6bskna6udz...@mail.gmail.com> > > > >> "Re: Arrow 3.0 release" on Wed, 6 Jan 2021 11:39:02 -0800, > > > >> Neal Richardson <neal.p.richard...@gmail.com> wrote: > > > >> > > > >>> I made some JIRAs for these issues: > > > >>> > > > >>> ARROW-11152: [CI][C++] Fix Homebrew numpy installation on macOS > > builds > > > >>> ARROW-11153: [C++][Packaging] Move debian/ubuntu/centos packaging > off > > > of > > > >>> Travis-CI (assigned to Kou) > > > >>> ARROW-11154: [CI][C++] Move homebrew crossbow tests off of > Travis-CI > > > >>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of > > > Travis-CI > > > >>> > > > >>> On Wed, Jan 6, 2021 at 5:50 AM Andrew Wieteska < > > > >> andrew.r.wiete...@gmail.com> > > > >>> wrote: > > > >>> > > > >>>> Hi Kou, > > > >>>> > > > >>>> For sure! I'll work on this. > > > >>>> > > > >>>> Best > > > >>>> Andrew > > > >>>> > > > >>>> On Tue, Jan 5, 2021 at 8:06 PM Sutou Kouhei <k...@clear-code.com> > > > wrote: > > > >>>> > > > >>>>> Hi Andrew, > > > >>>>> > > > >>>>> We need to fix nightly builds to release a new version. > > > >>>>> > > > >>>>> Could you check the latest nightly builds[1], open JIRA > > > >>>>> issues for not unaddressed failed builds and fix them one by > > > >>>>> one? > > > >>>>> > > > >>>>> [1] > > > >>>>> > > > >>>> > > > >> > > > > > > https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E > > > >>>>> > > > >>>>> For example, wheel-win-* are worked at > > > >>>>> https://github.com/apache/arrow/pull/9096 . We don't need to > > > >>>>> open new JIRA issues for them. > > > >>>>> > > > >>>>> > > > >>>>> We also need to move away from Travis CI in nightly builds. > > > >>>>> See also: > > > >>>>> > > > >>>> > > > >> > > > > > > https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E > > > >>>>> > > > >>>>> We need to change "ci: travis" in > > > >>>>> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml > > > >>>>> for it. > > > >>>>> > > > >>>>> wheel-osx-* are worked at > > > >>>>> https://github.com/apache/arrow/pull/8915 . > > > >>>>> > > > >>>>> I'll work on debian-*, ubuntu-* and centos-*. > > > >>>>> > > > >>>>> homebrew-* aren't unaddressed. Could you also work on them? > > > >>>>> > > > >>>>> > > > >>>>> Thanks, > > > >>>>> -- > > > >>>>> kou > > > >>>>> > > > >>>>> > > > >>>>> In <CAGeKrB_XFiu3= > > > >> fn3mbvhdd4yfqoi1havjrnkho0nwvv6qdf...@mail.gmail.com> > > > >>>>> "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500, > > > >>>>> Andrew Wieteska <andrew.r.wiete...@gmail.com> wrote: > > > >>>>> > > > >>>>>> Dear all, > > > >>>>>> > > > >>>>>> I will have time and would be happy to help with the release if > > the > > > >> PMC > > > >>>>>> release manager could use a second person. I don't have > experience > > > >> with > > > >>>>> the > > > >>>>>> release process so I might need some detailed pointers on where > > and > > > >>>> how I > > > >>>>>> can help - but if I can help to relieve the load on the release > > > >>>> manager, > > > >>>>>> I'm available! > > > >>>>>> > > > >>>>>> All the best > > > >>>>>> Andrew > > > >>>>>> > > > >>>>>> On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson < > > > >>>>> neal.p.richard...@gmail.com> > > > >>>>>> wrote: > > > >>>>>> > > > >>>>>>> Hi folks, > > > >>>>>>> It's time to get oriented for our 3.0.0 Arrow release. We had > > > >>>> previously > > > >>>>>>> said that we wanted to be release-ready by the end of this > week, > > > >> but > > > >>>>> that > > > >>>>>>> seems unlikely. There are a number of challenges in front of > us, > > > >> and > > > >>>> we > > > >>>>>>> need to step up and address them. Updating on the points I sent > > > >> out 3 > > > >>>>> weeks > > > >>>>>>> ago (see below): > > > >>>>>>> > > > >>>>>>> * Release blockers: per > > > >>>>>>> > > > >> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release > > > >>>>> we > > > >>>>>>> are up to 6 blockers, and that's not a complete list. We have > > > >> failing > > > >>>>>>> nightly builds, and we don't have any macOS crossbow builds due > > to > > > >>>>>>> Travis-CI limits, so that means no mac wheels at the moment. So > > we > > > >> are > > > >>>>> not > > > >>>>>>> releasable today. > > > >>>>>>> * Backlog: I did some pushing of issues to 4.0 today, so we're > > > >> down to > > > >>>>>>> 180ish open issues tagged for 3.0. Please review your own > > backlogs > > > >> and > > > >>>>> bump > > > >>>>>>> anything you aren't going to get done for this release out. > > > >>>>>>> * Pull requests: https://github.com/apache/arrow/pulls shows > 118 > > > >> open > > > >>>>> PRs > > > >>>>>>> right now. Some of that is probably a holiday backup, but > please > > do > > > >>>>> spend > > > >>>>>>> some time reviewing and merging (or closing, if appropriate) so > > we > > > >>>> have > > > >>>>>>> fewer things hanging on past this release. > > > >>>>>>> * Release process: despite the burst of interest a while back, > > > >> there > > > >>>>>>> doesn't seem to have been any movement on the proposed > > improvements > > > >>>> that > > > >>>>>>> would make it less expensive for us to release, and thus be > able > > to > > > >>>>> release > > > >>>>>>> more frequently. Nevertheless, we still need to release now, > and > > we > > > >>>> will > > > >>>>>>> need someone (I believe from the PMC) to volunteer to be > release > > > >>>> manager > > > >>>>>>> for 3.0. > > > >>>>>>> > > > >>>>>>> If you think you can help on any of these issues, please do! > This > > > >>>>> release > > > >>>>>>> won't happen without some collective effort. > > > >>>>>>> > > > >>>>>>> Thanks, and happy 2021 to you all. > > > >>>>>>> > > > >>>>>>> Neal > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson < > > > >>>>>>> neal.p.richard...@gmail.com> wrote: > > > >>>>>>> > > > >>>>>>>> Hi all, > > > >>>>>>>> I've created > > > >>>>>>>> > > > >>>> > > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release > > > >>>>> , > > > >>>>>>>> cloned from our previous release dashboards, for our upcoming > > > >>>>> release. A > > > >>>>>>>> few things I'd like to draw your attention to: > > > >>>>>>>> > > > >>>>>>>> * Blockers: there are 5 currently. I'm not certain that they > all > > > >> are > > > >>>>>>>> blockers, nor am I sure that there aren't other blockers. I > know > > > >>>> we've > > > >>>>>>> had > > > >>>>>>>> some issues lately with python wheel builds, and I've added a > > > >> couple > > > >>>>> of > > > >>>>>>>> known issues, but there may be others. If you know of other > > > >> release > > > >>>>>>>> blockers, please note them. > > > >>>>>>>> * There are over 300 unstarted issues tagged for 3.0.0. Given > > > >>>> holiday > > > >>>>>>>> schedules and the release target in the first week of January, > > > >>>> that's > > > >>>>> at > > > >>>>>>>> least 200 too many. Please review your backlogs and start > > bumping > > > >>>>> things > > > >>>>>>>> out of scope. I've added a 4.0.0 version that you can move > > things > > > >>>> to, > > > >>>>> if > > > >>>>>>>> you want. > > > >>>>>>>> * Release process improvements: there was some discussion a > few > > > >>>> weeks > > > >>>>> ago > > > >>>>>>>> about what could be done to make it easier to cut releases ( > > > >>>>>>>> > > > >>>>>>> > > > >>>>> > > > >>>> > > > >> > > > > > > https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E > > > >>>>>>> ). > > > >>>>>>>> A few tasks were mentioned in that thread. If anyone is going > to > > > >>>> take > > > >>>>>>>> action, now would be a good time. > > > >>>>>>>> > > > >>>>>>>> Thanks, > > > >>>>>>>> Neal > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>> > > > >>>>> > > > >>>> > > > >> > > > > > > > > > >
