Dhruve Ashar created SPARK-27937:
------------------------------------
Summary: Revert changes introduced as a part of Automatic
namespace discovery [SPARK-24149]
Key: SPARK-27937
URL: https://issues.apache.org/jira/browse/SPARK-27937
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.4.3
Reporter: Dhruve Ashar
Spark fails to launch for a valid deployment of HDFS while trying to get tokens
for a logical nameservice instead of an actual namenode (with HDFS federation
enabled).
On inspecting the source code closely, it is unclear why we were doing it and
based on the context from SPARK-24149, it solves a very specific use case of
getting the tokens for only those namenodes which are configured for HDFS
federation in the same cluster. IMHO these are better left to the user to
specify explicitly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
