+1 (binding) - Ran some sanity tests for spark 3.4
On Fri, Sep 22, 2023 at 3:42 PM Shawn Chang <yc2...@cornell.edu> wrote: > +1 (non-binding) > > - Ran integration tests with Hudi 0.14.0-rc3 jars on the latest EMR cluster > > On Fri, Sep 22, 2023 at 12:13 PM Hussein Awala <huss...@awala.fr> wrote: > > > +1 (non-binding) ran some Spark3 jobs to create and read COW tables. > > > > On Fri 22 Sep 2023 at 21:08, Nishith <n3.nas...@gmail.com> wrote: > > > > > +1 (binding) > > > > > > - Compile [OK] > > > - Checksum [OK] > > > - Validation Script [OK] > > > > > > -Nishith > > > > > > > On Sep 22, 2023, at 11:54 AM, Udit Mehrotra <udi...@apache.org> > wrote: > > > > > > > > +1 (binding) > > > > > > > > - Build with Spark 3 [OK] > > > > - Release validation script [OK] > > > > - Ran quickstart with Spark 3.4.1 [OK] > > > > > > > > Best, > > > > Udit > > > > > > > >> On Fri, Sep 22, 2023 at 11:39 AM Balaji Varadarajan > > > >> <v.bal...@ymail.com.invalid> wrote: > > > >> > > > >> +1 (binding) > > > >> Ran validate stage testChecking Checksum of Source Release > > > >> Checksum Check of Source Release - [OK] > > > >> > > > >> > > > >> > > > >> Checking Signature > > > >> > > > >> Signature Check - [OK] > > > >> > > > >> > > > >> > > > >> > > > >> Checking for binary files in the source files > > > >> > > > >> No Binary Files in the source files? - [OK] > > > >> > > > >> > > > >> > > > >> > > > >> Checking for DISCLAIMER > > > >> > > > >> DISCLAIMER file exists ? [OK] > > > >> > > > >> > > > >> > > > >> > > > >> Checking for LICENSE and NOTICE > > > >> > > > >> License file exists ? [OK] > > > >> > > > >> Notice file exists ? [OK] > > > >> > > > >> > > > >> > > > >> > > > >> Performing custom Licensing Check > > > >> > > > >> Licensing Check Passed [OK] > > > >> > > > >> > > > >> > > > >> Running RAT Check..... RAT Check Passed [OK] > > > >> > > > >> On Friday, September 22, 2023 at 11:33:54 AM PDT, Amrish Lal < > > > amrish.k....@gmail.com> wrote: > > > >> > > > >> +1 (non binding) > > > >> > > > >> - Sanity tests using COW/MOR table to create, update, delete, and > > query > > > >> records. > > > >> - Tested use of RLI in snapshot, realtime, time-travel, and > > incremental > > > >> queries. > > > >> - Overall OK, except that use of RLI should be disabled for > > time-travel > > > ( > > > >> HUDI-6886 <https://issues.apache.org/jira/browse/HUDI-6886>) and > > > snapshot > > > >> queries (HUDI-6891 <https://issues.apache.org/jira/browse/HUDI-6891 > >) > > > >> > > > >>> On Fri, Sep 22, 2023 at 11:26 AM Y Ethan Guo <yi...@apache.org> > > wrote: > > > >>> > > > >>> +1 (binding) > > > >>> - Ran validate_staged_release.sh [OK] > > > >>> - Hudi (Delta)streamer with error injection [OK] > > > >>> - Bundle validation > > > https://github.com/apache/hudi/actions/runs/6277569953 > > > >>> [OK] > > > >>> > > > >>> - Ethan > > > >>> > > > >>> > > > >>>> On Fri, Sep 22, 2023 at 10:29 AM Jonathan Vexler <j...@onehouse.ai > > > > > wrote: > > > >>> > > > >>>> +1 (non-binding) > > > >>>> - Tested Spark Datasource and Spark Sql core flow tests > > > >>>> -Tested reading from bootstrap tables > > > >>>> > > > >>>> > > > >>>> On Fri, Sep 22, 2023 at 12:39 PM sagar sumit <cod...@apache.org> > > > wrote: > > > >>>> > > > >>>>> +1 (non-binding) > > > >>>>> > > > >>>>> - Long-running deltastreamer [OK] > > > >>>>> - Hive metastore sync [OK] > > > >>>>> - Query using Presto and Trino [OK] > > > >>>>> > > > >>>>> Regards, > > > >>>>> Sagar > > > >>>>> > > > >>>>> On Fri, Sep 22, 2023 at 9:53 PM Aditya Goenka < > adi...@onehouse.ai> > > > >>>> wrote: > > > >>>>> > > > >>>>>> +1 (non-binding) > > > >>>>>> > > > >>>>>> - Tested Spark Sql workflows , delta streamer , spark structured > > > >>>>> streaming > > > >>>>>> for both types of tables with and without record key. > > > >>>>>> - Meta Sync tests > > > >>>>>> - Tests for data-skipping with both Column stats and RLI. > > > >>>>>> > > > >>>>>> On Fri, Sep 22, 2023 at 9:38 PM Vinoth Chandar < > vin...@apache.org > > > > > > >>>>> wrote: > > > >>>>>> > > > >>>>>>> +1 (binding) > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> - Ran rc checks on RC2 only, but nothing has seemed to > change. > > > >>>>>>> - Tested Spark Datasource/SQL flows around new features like > > > >>> auto > > > >>>>> key > > > >>>>>>> generation. This is a simpler SQL experience. > > > >>>>>>> > > > >>>>>>> Thanks to all the contributors ! > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> On Tue, Sep 19, 2023 at 11:56 AM Prashant Wason > > > >>>>> <pwa...@uber.com.invalid > > > >>>>>>> > > > >>>>>>> wrote: > > > >>>>>>> > > > >>>>>>>> Hi everyone, > > > >>>>>>>> > > > >>>>>>>> Please review and vote on the *release candidate #3* for the > > > >>>> version > > > >>>>>>>> 0.14.0, as follows: > > > >>>>>>>> > > > >>>>>>>> [ ] +1, Approve the release > > > >>>>>>>> > > > >>>>>>>> [ ] -1, Do not approve the release (please provide specific > > > >>>> comments) > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> The complete staging area is available for your review, which > > > >>>>> includes: > > > >>>>>>>> > > > >>>>>>>> * JIRA release notes [1], > > > >>>>>>>> > > > >>>>>>>> * the official Apache source release and binary convenience > > > >>>> releases > > > >>>>> to > > > >>>>>>> be > > > >>>>>>>> deployed to dist.apache.org > > > >>>>>>>> <https://dist.apache.org/repos/dist/dev/hudi/hudi-0.14.0-rc3/ > > > > > >>>> [2], > > > >>>>>>> which > > > >>>>>>>> are signed with the key with > > > >>>>>>>> fingerprint 75C5744E9E5CD5C48E19C082C4D858D73B9DB1B8 [3], > > > >>>>>>>> > > > >>>>>>>> * all artifacts to be deployed to the Maven Central Repository > > > >>> [4], > > > >>>>>>>> > > > >>>>>>>> * source code tag "0.14.0-rc3" [5], > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> The vote will be open for at least 72 hours. It is adopted by > > > >>>>> majority > > > >>>>>>>> approval, with at least 3 PMC affirmative votes. > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> Thanks, > > > >>>>>>>> > > > >>>>>>>> Prashant Wason > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> [1] > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>> > > > >>>>>> > > > >>>>> > > > >>>> > > > >>> > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12352700 > > > >>>>>>>> > > > >>>>>>>> [2] > > https://dist.apache.org/repos/dist/dev/hudi/hudi-0.14.0-rc3/ > > > >>>>>>>> > > > >>>>>>>> [3] https://dist.apache.org/repos/dist/release/hudi/KEYS > > > >>>>>>>> > > > >>>>>>>> [4] > > > >>>>>>> > > > >>>> > > > https://repository.apache.org/content/repositories/orgapachehudi-1127/ > > > >>>>>>>> > > > >>>>>>>> [5] > > > >>> https://github.com/apache/hudi/releases/tag/release-0.14.0-rc3 > > > >>>>>>>> < > https://github.com/apache/hudi/releases/tag/release-0.14.0-rc3 > > > > > > >>>>>>>> > > > >>>>>>> > > > >>>>>> > > > >>>>> > > > >>>> > > > >>> > > > >> > > > > > > -- Best, Shiyan