Ubuntu 23.04 java --version openjdk 17.0.6 2023-01-17 OpenJDK Runtime Environment (build 17.0.6+10-Ubuntu-1) OpenJDK 64-Bit Server VM (build 17.0.6+10-Ubuntu-1, mixed mode, sharing)
python3 Python 3.11.1 (main, Dec 31 2022, 10:23:59) [GCC 12.2.0] on linux ./build/mvn clean package - broadcast join - test temp view *** FAILED *** io.grpc.StatusRuntimeException: INTERNAL: Error while instantiating 'org.apache.spark.sql.hive.HiveExternalCatalog': at io.grpc.Status.asRuntimeException(Status.java:535) at io.grpc.stub.ClientCalls$BlockingResponseStream.hasNext(ClientCalls.java:660) at scala.collection.convert.Wrappers$JIteratorWrapper.hasNext(Wrappers.scala:45) at scala.collection.Iterator.find(Iterator.scala:993) at scala.collection.Iterator.find$(Iterator.scala:992) at scala.collection.AbstractIterator.find(Iterator.scala:1431) at org.apache.spark.sql.SparkSession.$anonfun$sql$1(SparkSession.scala:246) at org.apache.spark.sql.SparkSession.$anonfun$sql$1$adapted(SparkSession.scala:238) at org.apache.spark.sql.SparkSession.newDataset(SparkSession.scala:371) at org.apache.spark.sql.SparkSession.newDataFrame(SparkSession.scala:365) ... - column resolution - test implicit encoder resolution *** FAILED *** 2023-03-11T00:01:01.810547 did not equal 2023-03-11T00:01:01.810547662 (SQLImplicitsTestSuite.scala:63) FunctionTestSuite: Run completed in 36 seconds, 921 milliseconds. Total number of tests run: 683 Suites: completed 12, aborted 0 Tests: succeeded 676, failed 7, canceled 0, ignored 1, pending 0 *** 7 TESTS FAILED *** [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary for Spark Project Parent POM 3.4.0: [INFO] [INFO] Spark Project Parent POM ........................... SUCCESS [ 6.417 s] [INFO] Spark Project Tags ................................. SUCCESS [ 8.257 s] [INFO] Spark Project Sketch ............................... SUCCESS [ 29.830 s] [INFO] Spark Project Local DB ............................. SUCCESS [ 20.144 s] [INFO] Spark Project Networking ........................... SUCCESS [01:14 min] [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 19.269 s] [INFO] Spark Project Unsafe ............................... SUCCESS [ 21.489 s] [INFO] Spark Project Launcher ............................. SUCCESS [ 10.221 s] [INFO] Spark Project Core ................................. SUCCESS [40:11 min] [INFO] Spark Project ML Local Library ..................... SUCCESS [ 40.290 s] [INFO] Spark Project GraphX ............................... SUCCESS [02:26 min] [INFO] Spark Project Streaming ............................ SUCCESS [06:07 min] [INFO] Spark Project Catalyst ............................. SUCCESS [12:05 min] [INFO] Spark Project SQL .................................. SUCCESS [ 02:13 h] [INFO] Spark Project ML Library ........................... SUCCESS [22:12 min] [INFO] Spark Project Tools ................................ SUCCESS [ 6.802 s] [INFO] Spark Project Hive ................................. SUCCESS [ 01:09 h] [INFO] Spark Project REPL ................................. SUCCESS [02:01 min] [INFO] Spark Project Assembly ............................. SUCCESS [ 10.987 s] [INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [ 24.884 s] [INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:40 min] [INFO] Kafka 0.10+ Source for Structured Streaming ........ SUCCESS [34:14 min] [INFO] Spark Project Examples ............................. SUCCESS [ 57.978 s] [INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [ 18.300 s] [INFO] Spark Avro ......................................... SUCCESS [02:01 min] [INFO] Spark Project Connect Common ....................... SUCCESS [ 43.491 s] [INFO] Spark Project Connect Server ....................... SUCCESS [01:03 min] [INFO] Spark Project Connect Client ....................... FAILURE [01:14 min] [INFO] Spark Protobuf ..................................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 05:34 h [INFO] Finished at: 2023-03-11T00:01:14+01:00 [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:2.2.0:test (test) on project spark-connect-client-jvm_2.12: There are test failures -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <args> -rf :spark-connect-client-jvm_2.12 lør. 11. mar. 2023 kl. 03:18 skrev Xinrong Meng <xinrong.apa...@gmail.com>: > Thank you @beliefer. > > On Sat, Mar 11, 2023 at 9:54 AM beliefer <belie...@163.com> wrote: > >> There is a bug fix. >> >> https://issues.apache.org/jira/browse/SPARK-42740 >> >> >> >> 在 2023-03-10 20:48:30，"Xinrong Meng" <xinrong.apa...@gmail.com> 写道： >> >> https://issues.apache.org/jira/browse/SPARK-42745 can be a new release >> blocker, thanks @Peter Toth <peter.t...@gmail.com> for reporting that. >> >> On Fri, Mar 10, 2023 at 8:21 PM Xinrong Meng <xinrong.apa...@gmail.com> >> wrote: >> >>> Please vote on releasing the following candidate(RC4) as Apache Spark >>> version 3.4.0. >>> >>> The vote is open until 11:59pm Pacific time *March 15th* and passes if >>> a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. >>> >>> [ ] +1 Release this package as Apache Spark 3.4.0 >>> [ ] -1 Do not release this package because ... >>> >>> To learn more about Apache Spark, please see http://spark.apache.org/ >>> >>> The tag to be voted on is *v3.4.0-rc4* (commit >>> 4000d6884ce973eb420e871c8d333431490be763): >>> https://github.com/apache/spark/tree/v3.4.0-rc4 >>> >>> The release files, including signatures, digests, etc. can be found at: >>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc4-bin/ >>> >>> Signatures used for Spark RCs can be found in this file: >>> https://dist.apache.org/repos/dist/dev/spark/KEYS >>> >>> The staging repository for this release can be found at: >>> https://repository.apache.org/content/repositories/orgapachespark-1438 >>> >>> The documentation corresponding to this release can be found at: >>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc4-docs/ >>> >>> The list of bug fixes going into 3.4.0 can be found at the following URL: >>> https://issues.apache.org/jira/projects/SPARK/versions/12351465 >>> >>> This release is using the release script of the tag v3.4.0-rc4. >>> >>> >>> FAQ >>> >>> ========================= >>> How can I help test this release? >>> ========================= >>> If you are a Spark user, you can help us test this release by taking >>> an existing Spark workload and running on this release candidate, then >>> reporting any regressions. >>> >>> If you're working in PySpark you can set up a virtual env and install >>> the current RC and see if anything important breaks, in the Java/Scala >>> you can add the staging repository to your projects resolvers and test >>> with the RC (make sure to clean up the artifact cache before/after so >>> you don't end up building with a out of date RC going forward). >>> >>> =========================================== >>> What should happen to JIRA tickets still targeting 3.4.0? >>> =========================================== >>> The current list of open tickets targeted at 3.4.0 can be found at: >>> https://issues.apache.org/jira/projects/SPARK and search for "Target >>> Version/s" = 3.4.0 >>> >>> Committers should look at those and triage. Extremely important bug >>> fixes, documentation, and API tweaks that impact compatibility should >>> be worked on immediately. Everything else please retarget to an >>> appropriate release. >>> >>> ================== >>> But my bug isn't fixed? >>> ================== >>> In order to make timely releases, we will typically not hold the >>> release unless the bug in question is a regression from the previous >>> release. That being said, if there is something which is a regression >>> that has not been correctly targeted please ping me or a committer to >>> help target the issue. >>> >>> Thanks, >>> Xinrong Meng >>> >> -- Bjørn Jørgensen Vestre Aspehaug 4, 6010 Ålesund Norge +47 480 94 297
