Thanks Neal, like you mentioned maybe explicitly mentioning in the release page of arrow that major releases are done quarterly would be helpful.
cuDF can then standby for next release of arrow in April. Regards, Prem From: Neal Richardson <neal.p.richard...@gmail.com> Date: Monday, March 15, 2021 at 4:01 PM To: dev <dev@arrow.apache.org> Subject: Re: [Release] Request for patch release of arrow 3.x External email: Use caution opening links or attachments Probably a misunderstanding by the authors of that document. As https://arrow.apache.org/release/ shows, we've been doing quarterly major releases since roughly 2018, and they've been on the January/April/July/October ballpark, with the occasional delay. Perhaps we should formalize that somewhere on the website if it isn't stated already. Neal On Mon, Mar 15, 2021 at 1:28 PM prem sagar gali <sagarpre...@gmail.com> wrote: > Hi Arrow Devs, > > From the following road-map document I found, it appears to be that arrow > 4.0 next major release is in June 2021 as opposed to April 2021. > > > https://docs.google.com/document/d/1qspsOM_dknOxJKdGvKbC1aoVoO0M3i6x1CIo58mmN2Y/edit#<https://docs.google.com/document/d/1qspsOM_dknOxJKdGvKbC1aoVoO0M3i6x1CIo58mmN2Y/edit> > > Quoting the document here: > > "...about plans for the 4.0 release of Apache Arrow (~June 2021)...." > > Did I run into the wrong document regarding the correct arrow 4.0 release > date? I have connected with Andy and Keith offline and cuDF should be fine > with waiting until `4.0.0` if the release is April 2021. > > Regards, > Prem > > On Mon, Mar 15, 2021 at 10:54 AM Andy Grove <andygrov...@gmail.com> wrote: > > > Hi Prem, > > > > I didn't spot that this came from an NVIDIA email address when looking at > > this email on my phone. I will ping you directly and report conclusions > > back here. > > > > Thanks, > > > > Andy. > > > > On Fri, Mar 12, 2021 at 11:01 PM Andy Grove <andygrov...@gmail.com> > wrote: > > > > > Hi Prem, > > > > > > I'd like to learn more about your needs here. > > > > > > I mostly work on the Rust implementation but I work with the cuDF team > in > > > my day job at NVIDIA. > > > > > > I'll take a look at your PR on Monday. > > > > > > Thanks, > > > > > > Andy. > > > > > > > > > > > > > > > On Fri, Mar 12, 2021, 3:47 PM Neal Richardson < > > neal.p.richard...@gmail.com> > > > wrote: > > > > > >> I'll let others comment on a patch release, but let me clarify: we do > > >> major > > >> releases quarterly, and 3.0.0 was in January, so 4.0.0 will be in > April. > > >> > > >> Neal > > >> > > >> On Fri, Mar 12, 2021 at 2:45 PM Prem Sagar Gali <pg...@nvidia.com> > > wrote: > > >> > > >> > Hi Arrow Devs, > > >> > > > >> > I'm a maintainer of a project called cuDF ( > > >> > https://github.com/rapidsai/cudf.git) that is based on the Arrow > > >> columnar > > >> > format and depends on the Arrow C++ and Python libraries. Currently, > > we > > >> are > > >> > pinned to version `1.0.1`, but we've gotten feedback from the > > community > > >> > that they'd really like us to upgrade to the latest version. We > tried > > to > > >> > upgrade to version `3.0.0` but ran into a major issue: > > >> > > > >> > > > >> > - GPU buffer validation fails in array and table creation code > flows. > > >> > Related JIRA is https://issues.apache.org/jira/browse/ARROW-11872 > and > > >> > subsequent PR fixing the issue is > > >> > https://github.com/apache/arrow/pull/9640 and was merged a few days > > >> ago. > > >> > Unfortunately, this effectively blocks most usage of Arrow libraries > > for > > >> > CUDA projects. > > >> > > > >> > - After this, we tried version `2.0.0` but hit a different issue of > > >> > round-tripping of list of structs columns doesn't work properly in > the > > >> > parquet reader and writer. This is fixed in version `3.0.0`. > > >> > > > >> > It seems like version `4.0.0` is tentatively scheduled for June > 2021, > > >> > which is unfortunately quite a bit away. Would it be possible to do > a > > >> patch > > >> > release in `3.x` that included the fix for GPU buffer validation? > This > > >> > would greatly help us upgrade to the latest arrow version and > directly > > >> help > > >> > users using both Arrow and cuDF. > > >> > > > >> > > > >> > Regards, > > >> > Prem > > >> > > > >> > > > > > >
