Thank you for volunteering, Quanlong; this will be an important release for Impala.
I have one question: Several commits have landed recently supporting replaceable front-end(s) for Impala. Is that new feature now considered complete, or are there still commits pending with potentially breaking changes? Thanks, - Laszlo On Mon, Apr 5, 2021 at 10:27 AM Quanlong Huang <huangquanl...@gmail.com> wrote: > Yeah, the end users (e.g. SQL writers) are not aware of the catalog mode. I > don't think IMPALA-7127 is a breaking change unless we remove the legacy > catalog mode (like what we did for Sentry). So we can leave it to 4.1 if we > can't resolve it soon. For removing the legacy catalog mode, we can leave > it to the next major version release. > > On Sun, Apr 4, 2021 at 9:35 PM Jim Apple <jbap...@apache.org> wrote: > > > Sounds great! One thing I didn't quite understand about your views on > 7127, > > the fetch-on-demand metadata. Are you saying we should wait on that until > > 4.1? > > > > On Sun, Apr 4, 2021 at 2:06 AM Quanlong Huang <huangquanl...@gmail.com> > > wrote: > > > > > Hi all, > > > > > > Impala-3.4.0 was released in April 2020. It has been a long time since > > the > > > last release. One reason is that this is a major version release so we > > hope > > > it can take all the necessary breaking changes [1]. Listing all the > > > unresolved breaking changes here (I may miss some): > > > > > > - IMPALA-2210: Make Parquet the default file format > > > - IMPALA-9690: Bump minimum x86-64 CPU requirements > > > - IMPALA-7127: Use the fetch-on-demand metadata (LocalCatalog) mode > by > > > default > > > - I think this one is not visible to end users so maybe we can skip > > it. > > > > > > However, we've got lots of amazing features/improvements, e.g. > > > > > > - Multi-threading > > > - New SQL features to support all TPC-DS 99 queries (without > manually > > > rewriting) > > > - Transparent query retry > > > - Read support on full ACID ORC tables > > > - Apache DataSketches integration > > > - Apache Iceberg integration > > > - arm64 support > > > - ... > > > > > > I think it's time to release 4.0.0 to make them visible to our users. > > It'd > > > be good if the breaking changes discussed in this thread [1] can land > > soon. > > > Otherwise, I propose leaving them to the next major version release. > > > > > > Thus, I propose that we release 4.0.0 soon and I volunteer to be its > > > release manager. Please speak up and let the community know your ideas, > > > especially on the breaking changes. All feedback is welcome! > > > > > > PS This is not a VOTE thread but only a DISCUSS thread. > > > > > > Thanks, > > > Quanlong > > > > > > [1] > > > > > > > > > https://lists.apache.org/thread.html/r91b070c2ddfbdc00b316791611b23816991c68fb0afefd1e18c21c26%40%3Cuser.impala.apache.org%3E > > > > > >
