./build/mvn clean package -Phive SQLImplicitsTestSuite: - column resolution - test implicit encoder resolution *** FAILED *** 2023-03-11T23:13:13.873033 did not equal 2023-03-11T23:13:13.873033776 (SQLImplicitsTestSuite.scala:63) FunctionTestSuite:
Run completed in 45 seconds, 854 milliseconds. Total number of tests run: 683 Suites: completed 12, aborted 0 Tests: succeeded 682, failed 1, canceled 0, ignored 1, pending 0 *** 1 TEST FAILED *** [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary for Spark Project Parent POM 3.4.0: [INFO] [INFO] Spark Project Parent POM ........................... SUCCESS [ 4.791 s] [INFO] Spark Project Tags ................................. SUCCESS [ 9.107 s] [INFO] Spark Project Sketch ............................... SUCCESS [ 23.398 s] [INFO] Spark Project Local DB ............................. SUCCESS [ 15.841 s] [INFO] Spark Project Networking ........................... SUCCESS [ 58.199 s] [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 15.835 s] [INFO] Spark Project Unsafe ............................... SUCCESS [ 16.041 s] [INFO] Spark Project Launcher ............................. SUCCESS [ 10.052 s] [INFO] Spark Project Core ................................. SUCCESS [35:14 min] [INFO] Spark Project ML Local Library ..................... SUCCESS [ 39.237 s] [INFO] Spark Project GraphX ............................... SUCCESS [02:21 min] [INFO] Spark Project Streaming ............................ SUCCESS [05:43 min] [INFO] Spark Project Catalyst ............................. SUCCESS [11:15 min] [INFO] Spark Project SQL .................................. SUCCESS [ 02:32 h] [INFO] Spark Project ML Library ........................... SUCCESS [22:00 min] [INFO] Spark Project Tools ................................ SUCCESS [ 6.520 s] [INFO] Spark Project Hive ................................. SUCCESS [ 01:19 h] [INFO] Spark Project REPL ................................. SUCCESS [02:02 min] [INFO] Spark Project Assembly ............................. SUCCESS [ 12.161 s] [INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [ 25.144 s] [INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:37 min] [INFO] Kafka 0.10+ Source for Structured Streaming ........ SUCCESS [33:00 min] [INFO] Spark Project Examples ............................. SUCCESS [ 57.948 s] [INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [ 18.391 s] [INFO] Spark Avro ......................................... SUCCESS [02:02 min] [INFO] Spark Project Connect Common ....................... SUCCESS [ 45.043 s] [INFO] Spark Project Connect Server ....................... SUCCESS [01:02 min] [INFO] Spark Project Connect Client ....................... FAILURE [01:22 min] [INFO] Spark Protobuf ..................................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 05:55 h [INFO] Finished at: 2023-03-11T23:13:25+01:00 [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:2.2.0:test (test) on project spark-connect-client-jvm_2.12: There are test failures -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <args> -rf :spark-connect-client-jvm_2.12 lør. 11. mar. 2023 kl. 13:43 skrev yangjie01 <yangji...@baidu.com>: > Can you test `./build/mvn clean package -Phive` ? Thanks > > > > > > *发件人**: *Bjørn Jørgensen <bjornjorgen...@gmail.com> > *日期**: *2023年3月11日 星期六 20:33 > *收件人**: *Xinrong Meng <xinrong.apa...@gmail.com> > *抄送**: *beliefer <belie...@163.com>, dev <dev@spark.apache.org> > *主题**: *Re: Re: [VOTE] Release Apache Spark 3.4.0 (RC4) > > > > Ubuntu 23.04 > > java --version > openjdk 17.0.6 2023-01-17 > OpenJDK Runtime Environment (build 17.0.6+10-Ubuntu-1) > OpenJDK 64-Bit Server VM (build 17.0.6+10-Ubuntu-1, mixed mode, sharing) > > > > python3 > Python 3.11.1 (main, Dec 31 2022, 10:23:59) [GCC 12.2.0] on linux > > > > > > ./build/mvn clean package > > > > > > - broadcast join > - test temp view *** FAILED *** > io.grpc.StatusRuntimeException: INTERNAL: Error while instantiating > 'org.apache.spark.sql.hive.HiveExternalCatalog': > at io.grpc.Status.asRuntimeException(Status.java:535) > at > io.grpc.stub.ClientCalls$BlockingResponseStream.hasNext(ClientCalls.java:660) > at > scala.collection.convert.Wrappers$JIteratorWrapper.hasNext(Wrappers.scala:45) > at scala.collection.Iterator.find(Iterator.scala:993) > at scala.collection.Iterator.find$(Iterator.scala:992) > at scala.collection.AbstractIterator.find(Iterator.scala:1431) > at > org.apache.spark.sql.SparkSession.$anonfun$sql$1(SparkSession.scala:246) > at > org.apache.spark.sql.SparkSession.$anonfun$sql$1$adapted(SparkSession.scala:238) > at org.apache.spark.sql.SparkSession.newDataset(SparkSession.scala:371) > at org.apache.spark.sql.SparkSession.newDataFrame(SparkSession.scala:365) > ... > > > > - column resolution > - test implicit encoder resolution *** FAILED *** > 2023-03-11T00:01:01.810547 did not equal 2023-03-11T00:01:01.810547662 > (SQLImplicitsTestSuite.scala:63) > FunctionTestSuite: > > > > > > Run completed in 36 seconds, 921 milliseconds. > Total number of tests run: 683 > Suites: completed 12, aborted 0 > Tests: succeeded 676, failed 7, canceled 0, ignored 1, pending 0 > *** 7 TESTS FAILED *** > [*INFO*] > *------------------------------------------------------------------------* > [*INFO*] *Reactor Summary for Spark Project Parent POM 3.4.0:* > [*INFO*] > [*INFO*] Spark Project Parent POM ........................... *SUCCESS* [ > 6.417 s] > [*INFO*] Spark Project Tags ................................. *SUCCESS* [ > 8.257 s] > [*INFO*] Spark Project Sketch ............................... *SUCCESS* [ > 29.830 s] > [*INFO*] Spark Project Local DB ............................. *SUCCESS* [ > 20.144 s] > [*INFO*] Spark Project Networking ........................... *SUCCESS* > [01:14 min] > [*INFO*] Spark Project Shuffle Streaming Service ............ *SUCCESS* [ > 19.269 s] > [*INFO*] Spark Project Unsafe ............................... *SUCCESS* [ > 21.489 s] > [*INFO*] Spark Project Launcher ............................. *SUCCESS* [ > 10.221 s] > [*INFO*] Spark Project Core ................................. *SUCCESS* > [40:11 min] > [*INFO*] Spark Project ML Local Library ..................... *SUCCESS* [ > 40.290 s] > [*INFO*] Spark Project GraphX ............................... *SUCCESS* > [02:26 min] > [*INFO*] Spark Project Streaming ............................ *SUCCESS* > [06:07 min] > [*INFO*] Spark Project Catalyst ............................. *SUCCESS* > [12:05 min] > [*INFO*] Spark Project SQL .................................. *SUCCESS* [ > 02:13 h] > [*INFO*] Spark Project ML Library ........................... *SUCCESS* > [22:12 min] > [*INFO*] Spark Project Tools ................................ *SUCCESS* [ > 6.802 s] > [*INFO*] Spark Project Hive ................................. *SUCCESS* [ > 01:09 h] > [*INFO*] Spark Project REPL ................................. *SUCCESS* > [02:01 min] > [*INFO*] Spark Project Assembly ............................. *SUCCESS* [ > 10.987 s] > [*INFO*] Kafka 0.10+ Token Provider for Streaming ........... *SUCCESS* [ > 24.884 s] > [*INFO*] Spark Integration for Kafka 0.10 ................... *SUCCESS* > [01:40 min] > [*INFO*] Kafka 0.10+ Source for Structured Streaming ........ *SUCCESS* > [34:14 min] > [*INFO*] Spark Project Examples ............................. *SUCCESS* [ > 57.978 s] > [*INFO*] Spark Integration for Kafka 0.10 Assembly .......... *SUCCESS* [ > 18.300 s] > [*INFO*] Spark Avro ......................................... *SUCCESS* > [02:01 min] > [*INFO*] Spark Project Connect Common ....................... *SUCCESS* [ > 43.491 s] > [*INFO*] Spark Project Connect Server ....................... *SUCCESS* > [01:03 min] > [*INFO*] Spark Project Connect Client ....................... *FAILURE* > [01:14 min] > [*INFO*] Spark Protobuf ..................................... *SKIPPED* > [*INFO*] > *------------------------------------------------------------------------* > [*INFO*] *BUILD FAILURE* > [*INFO*] > *------------------------------------------------------------------------* > [*INFO*] Total time: 05:34 h > [*INFO*] Finished at: 2023-03-11T00:01:14+01:00 > [*INFO*] > *------------------------------------------------------------------------* > [*ERROR*] Failed to execute goal > org.scalatest:scalatest-maven-plugin:2.2.0:test *(test)* on project > spark-connect-client-jvm_2.12: *There are test failures* -> *[Help 1]* > [*ERROR*] > [*ERROR*] To see the full stack trace of the errors, re-run Maven with > the *-e* switch. > [*ERROR*] Re-run Maven using the *-X* switch to enable full debug > logging. > [*ERROR*] > [*ERROR*] For more information about the errors and possible solutions, > please read the following articles: > [*ERROR*] *[Help 1]* > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > <https://mailshield.baidu.com/check?q=uvNqv3q7iidBzcpxgEE0ifvMIOqlC%2bcJlro4NIY4KsQQXSbUE%2b%2f3N0Mffl%2bxwkotAXBqL4CkZ9nCh29ZLDtsAHvMJSICooWbPcYYtg%3d%3d> > [*ERROR*] > [*ERROR*] After correcting the problems, you can resume the build with > the command > [*ERROR*] *mvn <args> -rf :spark-connect-client-jvm_2.12* > > > > > > > > > > > > lør. 11. mar. 2023 kl. 03:18 skrev Xinrong Meng <xinrong.apa...@gmail.com > >: > > Thank you @beliefer. > > > > On Sat, Mar 11, 2023 at 9:54 AM beliefer <belie...@163.com> wrote: > > There is a bug fix. > > https://issues.apache.org/jira/browse/SPARK-42740 > <https://mailshield.baidu.com/check?q=NVNhlwVywiOTCef8T1gkvdM0FJPiRXW0XDTsxTdVihE5VNqAB%2bBUE80Fvv4Muc%2bPWRzDh%2bC%2fsZ0%3d> > > > > > > 在 2023-03-10 20:48:30，"Xinrong Meng" <xinrong.apa...@gmail.com> 写道： > > https://issues.apache.org/jira/browse/SPARK-42745 > <https://mailshield.baidu.com/check?q=xEgAkkbgayAR25TelzQxZpD4XLAs5vursloH6z282%2bkgIbF%2bv8a0k11jNv9v5%2b7RNntWzkbJY5o%3d> > can be a new release blocker, thanks @Peter Toth <peter.t...@gmail.com> for > reporting that. > > > > On Fri, Mar 10, 2023 at 8:21 PM Xinrong Meng <xinrong.apa...@gmail.com> > wrote: > > Please vote on releasing the following candidate(RC4) as Apache Spark > version 3.4.0. > > The vote is open until 11:59pm Pacific time *March 15th* and passes if a > majority +1 PMC votes are cast, with a minimum of 3 +1 votes. > > [ ] +1 Release this package as Apache Spark 3.4.0 > [ ] -1 Do not release this package because ... > > To learn more about Apache Spark, please see http://spark.apache.org/ > <https://mailshield.baidu.com/check?q=eJcUboQ1HRRomPZKEwRzpl69wA8DbI%2fNIiRNsQ%3d%3d> > > The tag to be voted on is *v3.4.0-rc4* (commit > 4000d6884ce973eb420e871c8d333431490be763): > https://github.com/apache/spark/tree/v3.4.0-rc4 > <https://mailshield.baidu.com/check?q=6IirG7fziePvCacOReK6jUdmuJP6KMbW4fUCndc6OVnk85KXW4QmYTMsmVjwV321SbCcMA%3d%3d> > > The release files, including signatures, digests, etc. can be found at: > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc4-bin/ > <https://mailshield.baidu.com/check?q=XJc0cv5rM0eszvOkhyfTtNH5GLa1nGF%2fWbwvlNPTR7sc0vDaxlyyE%2b0WuhWJjjQSWG%2b0Ln%2fr18mKRROk%2btTsLA%3d%3d> > > Signatures used for Spark RCs can be found in this file: > https://dist.apache.org/repos/dist/dev/spark/KEYS > <https://mailshield.baidu.com/check?q=E6fHbSXEWw02TTJBpc3bfA9mi7ea0YiWcNHkm%2fDJxwlaWinGnMdaoO1PahHhgj00vKwcbElpuHA%3d> > > The staging repository for this release can be found at: > https://repository.apache.org/content/repositories/orgapachespark-1438 > <https://mailshield.baidu.com/check?q=GlTXcuxQCx%2b7W2QorEq0jIiTn0Obe3TpRSeGffKHyCRHzt4zuzVuXHSsN3WVaI5u6WDuGiU5q9TUMjTURM9x5ZPnt0EXKc%2bHT%2fgTqQ%3d%3d> > > The documentation corresponding to this release can be found at: > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc4-docs/ > <https://mailshield.baidu.com/check?q=oAXUzuRiGyXS1%2frfhLFDCOB5UIxLKqhijZlhbufhSTFpYIjhSoL0ylxmvm2vrWWw7bCvL%2bvzXhkncvNMEln2ndc0J6A%3d> > > The list of bug fixes going into 3.4.0 can be found at the following URL: > https://issues.apache.org/jira/projects/SPARK/versions/12351465 > <https://mailshield.baidu.com/check?q=hdSxPMAr37WGNHJRNA4Mh1JkSlqjUL%2bM8BgEclwc23ePHCBzkAjvhgnZa0N7SPRWAcgfoLXjX43CxJXmKnDj0LIElJs%3d> > > This release is using the release script of the tag v3.4.0-rc4. > > > FAQ > > ========================= > How can I help test this release? > ========================= > If you are a Spark user, you can help us test this release by taking > an existing Spark workload and running on this release candidate, then > reporting any regressions. > > If you're working in PySpark you can set up a virtual env and install > the current RC and see if anything important breaks, in the Java/Scala > you can add the staging repository to your projects resolvers and test > with the RC (make sure to clean up the artifact cache before/after so > you don't end up building with a out of date RC going forward). > > =========================================== > What should happen to JIRA tickets still targeting 3.4.0? > =========================================== > The current list of open tickets targeted at 3.4.0 can be found at: > https://issues.apache.org/jira/projects/SPARK > <https://mailshield.baidu.com/check?q=4UUpJqq41y71Gnuj0qTUYo6hTjqzT7oytN6x%2fvgC5XUtQUC8MfJ77tj7K70O%2f1QMmNoa1A%3d%3d> > and > search for "Target Version/s" = 3.4.0 > > Committers should look at those and triage. Extremely important bug > fixes, documentation, and API tweaks that impact compatibility should > be worked on immediately. Everything else please retarget to an > appropriate release. > > ================== > But my bug isn't fixed? > ================== > In order to make timely releases, we will typically not hold the > release unless the bug in question is a regression from the previous > release. That being said, if there is something which is a regression > that has not been correctly targeted please ping me or a committer to > help target the issue. > > Thanks, > Xinrong Meng > > > > > -- > > Bjørn Jørgensen > Vestre Aspehaug 4, 6010 Ålesund > Norge > > +47 480 94 297 > -- Bjørn Jørgensen Vestre Aspehaug 4, 6010 Ålesund Norge +47 480 94 297
