wombatu-kun commented on code in PR #12772:
URL: https://github.com/apache/hudi/pull/12772#discussion_r2070112897
##########
.github/workflows/bot.yml:
##########
@@ -971,33 +977,50 @@ jobs:
include:
- sparkProfile: 'spark3.5'
sparkArchive: 'spark-3.5.3/spark-3.5.3-bin-hadoop3.tgz'
+ scalaProfile: '-Dscala-2.12 -Dscala.binary.version=2.12'
+
+# TODO: Integration tests on Spark4 do not work on existing hadoop/hive/spark
docker images from apachehudi dockerhub repo:
+#
+# java.lang.NoSuchFieldError: NVDIMM
+# at
org.apache.hudi.integ.testsuite.TestDFSHoodieTestSuiteWriterAdapter.initClass(TestDFSHoodieTestSuiteWriterAdapter.java:67)
+# [ERROR] Errors:
+# [ERROR]
TestDFSHoodieTestSuiteWriterAdapter.initClass:67->UtilitiesTestBase.initTestServices:152
» NoSuchField
+# [ERROR]
TestFileDeltaInputWriter.initClass:62->UtilitiesTestBase.initTestServices:152 »
NoSuchField
+# [ERROR]
TestDFSAvroDeltaInputReader.initClass:47->UtilitiesTestBase.initTestServices:152
» NoSuchField
+# [ERROR]
TestDFSHoodieDatasetInputReader.initClass:56->UtilitiesTestBase.initTestServices:152
» NoSuchField
+# [ERROR] Tests run: 21, Failures: 0, Errors: 4, Skipped: 2
+
+# - sparkProfile: 'spark4'
+# sparkArchive:
'spark-4.0.0-preview1/spark-4.0.0-preview1-bin-hadoop3.tgz'
+# scalaProfile: '-Dscala-2.13 -Dscala.binary.version=2.13'
+
steps:
- uses: actions/checkout@v3
- - name: Set up JDK 8
+ - name: Set up JDK 17
uses: actions/setup-java@v3
with:
- java-version: '8'
+ java-version: '17'
Review Comment:
Spark 4 requires java 17
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
