Probably a misunderstanding by the authors of that document. As https://arrow.apache.org/release/ shows, we've been doing quarterly major releases since roughly 2018, and they've been on the January/April/July/October ballpark, with the occasional delay. Perhaps we should formalize that somewhere on the website if it isn't stated already.
Neal On Mon, Mar 15, 2021 at 1:28 PM prem sagar gali <sagarpre...@gmail.com> wrote: > Hi Arrow Devs, > > From the following road-map document I found, it appears to be that arrow > 4.0 next major release is in June 2021 as opposed to April 2021. > > > https://docs.google.com/document/d/1qspsOM_dknOxJKdGvKbC1aoVoO0M3i6x1CIo58mmN2Y/edit# > > Quoting the document here: > > "...about plans for the 4.0 release of Apache Arrow (~June 2021)...." > > Did I run into the wrong document regarding the correct arrow 4.0 release > date? I have connected with Andy and Keith offline and cuDF should be fine > with waiting until `4.0.0` if the release is April 2021. > > Regards, > Prem > > On Mon, Mar 15, 2021 at 10:54 AM Andy Grove <andygrov...@gmail.com> wrote: > > > Hi Prem, > > > > I didn't spot that this came from an NVIDIA email address when looking at > > this email on my phone. I will ping you directly and report conclusions > > back here. > > > > Thanks, > > > > Andy. > > > > On Fri, Mar 12, 2021 at 11:01 PM Andy Grove <andygrov...@gmail.com> > wrote: > > > > > Hi Prem, > > > > > > I'd like to learn more about your needs here. > > > > > > I mostly work on the Rust implementation but I work with the cuDF team > in > > > my day job at NVIDIA. > > > > > > I'll take a look at your PR on Monday. > > > > > > Thanks, > > > > > > Andy. > > > > > > > > > > > > > > > On Fri, Mar 12, 2021, 3:47 PM Neal Richardson < > > neal.p.richard...@gmail.com> > > > wrote: > > > > > >> I'll let others comment on a patch release, but let me clarify: we do > > >> major > > >> releases quarterly, and 3.0.0 was in January, so 4.0.0 will be in > April. > > >> > > >> Neal > > >> > > >> On Fri, Mar 12, 2021 at 2:45 PM Prem Sagar Gali <pg...@nvidia.com> > > wrote: > > >> > > >> > Hi Arrow Devs, > > >> > > > >> > I'm a maintainer of a project called cuDF ( > > >> > https://github.com/rapidsai/cudf.git) that is based on the Arrow > > >> columnar > > >> > format and depends on the Arrow C++ and Python libraries. Currently, > > we > > >> are > > >> > pinned to version `1.0.1`, but we've gotten feedback from the > > community > > >> > that they'd really like us to upgrade to the latest version. We > tried > > to > > >> > upgrade to version `3.0.0` but ran into a major issue: > > >> > > > >> > > > >> > - GPU buffer validation fails in array and table creation code > flows. > > >> > Related JIRA is https://issues.apache.org/jira/browse/ARROW-11872 > and > > >> > subsequent PR fixing the issue is > > >> > https://github.com/apache/arrow/pull/9640 and was merged a few days > > >> ago. > > >> > Unfortunately, this effectively blocks most usage of Arrow libraries > > for > > >> > CUDA projects. > > >> > > > >> > - After this, we tried version `2.0.0` but hit a different issue of > > >> > round-tripping of list of structs columns doesn't work properly in > the > > >> > parquet reader and writer. This is fixed in version `3.0.0`. > > >> > > > >> > It seems like version `4.0.0` is tentatively scheduled for June > 2021, > > >> > which is unfortunately quite a bit away. Would it be possible to do > a > > >> patch > > >> > release in `3.x` that included the fix for GPU buffer validation? > This > > >> > would greatly help us upgrade to the latest arrow version and > directly > > >> help > > >> > users using both Arrow and cuDF. > > >> > > > >> > > > >> > Regards, > > >> > Prem > > >> > > > >> > > > > > >
