wombatu-kun commented on code in PR #12772:
URL: https://github.com/apache/hudi/pull/12772#discussion_r2086015017
##########
.github/workflows/bot.yml:
##########
@@ -964,33 +970,50 @@ jobs:
include:
- sparkProfile: 'spark3.5'
sparkArchive: 'spark-3.5.3/spark-3.5.3-bin-hadoop3.tgz'
+ scalaProfile: '-Dscala-2.12 -Dscala.binary.version=2.12'
+
+# TODO: Integration tests on Spark4 do not work on existing hadoop/hive/spark
docker images from apachehudi dockerhub repo:
+#
+# java.lang.NoSuchFieldError: NVDIMM
+# at
org.apache.hudi.integ.testsuite.TestDFSHoodieTestSuiteWriterAdapter.initClass(TestDFSHoodieTestSuiteWriterAdapter.java:67)
+# [ERROR] Errors:
+# [ERROR]
TestDFSHoodieTestSuiteWriterAdapter.initClass:67->UtilitiesTestBase.initTestServices:152
» NoSuchField
+# [ERROR]
TestFileDeltaInputWriter.initClass:62->UtilitiesTestBase.initTestServices:152 »
NoSuchField
+# [ERROR]
TestDFSAvroDeltaInputReader.initClass:47->UtilitiesTestBase.initTestServices:152
» NoSuchField
+# [ERROR]
TestDFSHoodieDatasetInputReader.initClass:56->UtilitiesTestBase.initTestServices:152
» NoSuchField
+# [ERROR] Tests run: 21, Failures: 0, Errors: 4, Skipped: 2
+
+# - sparkProfile: 'spark4'
+# sparkArchive:
'spark-4.0.0-preview1/spark-4.0.0-preview1-bin-hadoop3.tgz'
+# scalaProfile: '-Dscala-2.13 -Dscala.binary.version=2.13'
Review Comment:
created https://issues.apache.org/jira/browse/HUDI-9409
> Does this mean that Spark 4 + Scala 2.13 is not supported yet?
No, i think there is something wrong with MiniDFSCluster (or other test
services) in tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
