Thanks Quanlong for volunteering as release manager and starting the 4.0 discussion. Regarding the front-end changes that have landed recently, none should be a breaking change. There are a few smaller commits pending and should likely land in a few days but those should also not be breaking changes.
-Aman On Mon, Apr 5, 2021 at 8:40 AM Laszlo Gaal <laszlo.g...@cloudera.com> wrote: > Thank you for volunteering, Quanlong; this will be an important release for > Impala. > > I have one question: Several commits have landed recently supporting > replaceable front-end(s) > for Impala. Is that new feature now considered complete, or are there still > commits pending with > potentially breaking changes? > > Thanks, > > - Laszlo > > On Mon, Apr 5, 2021 at 10:27 AM Quanlong Huang <huangquanl...@gmail.com> > wrote: > > > Yeah, the end users (e.g. SQL writers) are not aware of the catalog > mode. I > > don't think IMPALA-7127 is a breaking change unless we remove the legacy > > catalog mode (like what we did for Sentry). So we can leave it to 4.1 if > we > > can't resolve it soon. For removing the legacy catalog mode, we can leave > > it to the next major version release. > > > > On Sun, Apr 4, 2021 at 9:35 PM Jim Apple <jbap...@apache.org> wrote: > > > > > Sounds great! One thing I didn't quite understand about your views on > > 7127, > > > the fetch-on-demand metadata. Are you saying we should wait on that > until > > > 4.1? > > > > > > On Sun, Apr 4, 2021 at 2:06 AM Quanlong Huang <huangquanl...@gmail.com > > > > > wrote: > > > > > > > Hi all, > > > > > > > > Impala-3.4.0 was released in April 2020. It has been a long time > since > > > the > > > > last release. One reason is that this is a major version release so > we > > > hope > > > > it can take all the necessary breaking changes [1]. Listing all the > > > > unresolved breaking changes here (I may miss some): > > > > > > > > - IMPALA-2210: Make Parquet the default file format > > > > - IMPALA-9690: Bump minimum x86-64 CPU requirements > > > > - IMPALA-7127: Use the fetch-on-demand metadata (LocalCatalog) > mode > > by > > > > default > > > > - I think this one is not visible to end users so maybe we can > skip > > > it. > > > > > > > > However, we've got lots of amazing features/improvements, e.g. > > > > > > > > - Multi-threading > > > > - New SQL features to support all TPC-DS 99 queries (without > > manually > > > > rewriting) > > > > - Transparent query retry > > > > - Read support on full ACID ORC tables > > > > - Apache DataSketches integration > > > > - Apache Iceberg integration > > > > - arm64 support > > > > - ... > > > > > > > > I think it's time to release 4.0.0 to make them visible to our users. > > > It'd > > > > be good if the breaking changes discussed in this thread [1] can land > > > soon. > > > > Otherwise, I propose leaving them to the next major version release. > > > > > > > > Thus, I propose that we release 4.0.0 soon and I volunteer to be its > > > > release manager. Please speak up and let the community know your > ideas, > > > > especially on the breaking changes. All feedback is welcome! > > > > > > > > PS This is not a VOTE thread but only a DISCUSS thread. > > > > > > > > Thanks, > > > > Quanlong > > > > > > > > [1] > > > > > > > > > > > > > > https://lists.apache.org/thread.html/r91b070c2ddfbdc00b316791611b23816991c68fb0afefd1e18c21c26%40%3Cuser.impala.apache.org%3E > > > > > > > > > >
