Shawn Chang created HUDI-6600:
---------------------------------
Summary: Setup HDFS in GitHub CI
Key: HUDI-6600
URL: https://issues.apache.org/jira/browse/HUDI-6600
Project: Apache Hudi
Issue Type: Improvement
Reporter: Shawn Chang
To execute unit tests with Java 17, we can't use MiniDFSCluster and have to
rely on external HDFS.
Utils to use external HDFS:
https://github.com/apache/hudi/blob/2a0223933884cb044e7aa56f205cae926358a030/hudi-common/src/test/java/org/apache/hudi/common/testutils/HoodieTestUtils.java#L241
Currently, we have docker image set up and those Java 17 tests would be
executed there
([https://github.com/apache/hudi/blob/2a0223933884cb044e7aa56f205cae926358a030/.github/workflows/bot.yml#L209)]
A more ideal solution would be setting up HDFS in GitHub CI directly, for
example: https://github.com/beyondstorage/setup-hdfs
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
