Gautham Banasandra created HDFS-17246:
-----------------------------------------
Summary: Fix shaded client for building Hadoop on Windows
Key: HDFS-17246
URL: https://issues.apache.org/jira/browse/HDFS-17246
Project: Hadoop HDFS
Issue Type: Bug
Components: hdfs-client
Affects Versions: 3.4.0
Environment: Windows 10
Reporter: Gautham Banasandra
Assignee: Gautham Banasandra
Fix For: 3.4.0
Currently, the *shaded client* Yetus personality in Hadoop fails to build on
Windows -
https://github.com/apache/hadoop/blob/4c04a6768c0cb3d5081cfa5d84ffb389d92f5805/dev-support/bin/hadoop.sh#L541-L615.
This happens due to the integration test failures in Hadoop client modules -
https://github.com/apache/hadoop/tree/4c04a6768c0cb3d5081cfa5d84ffb389d92f5805/hadoop-client-modules/hadoop-client-integration-tests.
There are several issues that need to be addressed in order to get the
integration tests working -
# Set the HADOOP_HOME, needed by the Mini DFS and YARN clusters spawned by the
integration tests.
# Add Hadoop binaries to PATH, so that winutils.exe can be located.
# Create a new user with Symlink privilege in the Docker image. This is needed
for the proper working of Mini YARN cluster, spawned by the integration tests.
# Fix a bug in DFSUtilClient.java that prevents colon (:) in the path. The
colon is used a delimiter for the PATH variable while specifying multiple
paths. However, this isn't a delimiter in the case of Windows and must be
handled appropriately.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
