Vova Kolmakov created HUDI-9409:
-----------------------------------
Summary: Adapt Integration tests CI for Spark4
Key: HUDI-9409
URL: https://issues.apache.org/jira/browse/HUDI-9409
Project: Apache Hudi
Issue Type: Improvement
Reporter: Vova Kolmakov
Integration tests on Spark 4 do not work on existing hadoop/hive/spark docker
images from apachehudi dockerhub repo:
{code:java}
java.lang.NoSuchFieldError: NVDIMM
at
org.apache.hudi.integ.testsuite.TestDFSHoodieTestSuiteWriterAdapter.initClass(TestDFSHoodieTestSuiteWriterAdapter.java:67)
[ERROR] Errors:
[ERROR]
TestDFSHoodieTestSuiteWriterAdapter.initClass:67->UtilitiesTestBase.initTestServices:152
» NoSuchField
[ERROR]
TestFileDeltaInputWriter.initClass:62->UtilitiesTestBase.initTestServices:152 »
NoSuchField
[ERROR]
TestDFSAvroDeltaInputReader.initClass:47->UtilitiesTestBase.initTestServices:152
» NoSuchField
[ERROR]
TestDFSHoodieDatasetInputReader.initClass:56->UtilitiesTestBase.initTestServices:152
» NoSuchField
[ERROR] Tests run: 21, Failures: 0, Errors: 4, Skipped: 2{code}
Need to investigate and fix (docker images or integration tests or both) and
uncomment Spark 4 params in matrix of integration-tests-java17 CI pipeline.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
