Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

Hi All, Considering there are no notable release blockers now, I am going to cut the RC2 for Apache Spark 3.4.0. On Fri, Feb 24, 2023 at 10:44 AM Hyukjin Kwon wrote: > Yes we should fix. I will take a look > > On Thu, 23 Feb 2023 at 07:32, Jonathan Kelly > wrote: > >> Thanks! I was wondering

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

Yes we should fix. I will take a look On Thu, 23 Feb 2023 at 07:32, Jonathan Kelly wrote: > Thanks! I was wondering about that ClientE2ETestSuite failure today, so > I'm glad to know that it's also being experienced by others. > > On a similar note, I am experiencing the following error when

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

Thanks for creating the RC1, Xinrong! Besides the blockers mentioned by Tom, let's include the following bug fix in Spark 3.4.0 as well: [SPARK-42406][SQL] Fix check for missing required fields of to_protobuf

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

It looks like there are still blockers open, we need to make sure they are addressed before doing a release: https://issues.apache.org/jira/browse/SPARK-41793 https://issues.apache.org/jira/browse/SPARK-42444 TomOn Tuesday, February 21, 2023 at 10:35:45 PM CST, Xinrong Meng wrote:

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

Thanks! I was wondering about that ClientE2ETestSuite failure today, so I'm glad to know that it's also being experienced by others. On a similar note, I am experiencing the following error when running the Python tests with Python 3.7: + ./python/run-tests --python-executables=python3 Running

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

Hi All, Thanks for testing the 3.4.0 RC! I apologize for the maven testing failures for the Spark Connect Scala Client. We will try to get those sorted as soon as possible. This is an artifact of having multiple build systems, and only running CI for one (SBT). That, however, is a debate for

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

./build/mvn clean package I'm using ubuntu rolling, python 3.11 openjdk 17 CompatibilitySuite: - compatibility MiMa tests *** FAILED *** java.lang.AssertionError: assertion failed: Failed to find the jar inside folder: /home/bjorn/spark-3.4.0/connector/connect/client/jvm/target at

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

Signatures, digests, etc check out fine - thanks for updating them ! Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes The test ClientE2ETestSuite.simple udf failed [1] in "Connect Client " module ... yet to test "Spark Protobuf" module due to the failure. Regards,

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

Thanks Xinrong ! The signature verifications are fine now ... will continue with testing the release. Regards, Mridul On Wed, Feb 22, 2023 at 1:27 AM Xinrong Meng wrote: > Hi Mridul, > > Would you please try that again? It should work now. > > On Wed, Feb 22, 2023 at 2:04 PM Mridul

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

Hi Mridul, Would you please try that again? It should work now. On Wed, Feb 22, 2023 at 2:04 PM Mridul Muralidharan wrote: > > Hi Xinrong, > > Was it signed with the same key as present in KEYS [1] ? > I am seeing errors with gpg when validating. For example: > > > $ gpg --verify

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

Hi Xinrong, Was it signed with the same key as present in KEYS [1] ? I am seeing errors with gpg when validating. For example: $ gpg --verify pyspark-3.4.0.tar.gz.asc gpg: assuming signed data in 'pyspark-3.4.0.tar.gz' gpg: Signature made Tue 21 Feb 2023 05:56:05 AM CST gpg:

[VOTE] Release Apache Spark 3.4.0 (RC1)

Please vote on releasing the following candidate as Apache Spark version 3.4.0. The vote is open until 11:59pm Pacific time *February 27th* and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 3.4.0 [ ] -1 Do not release this