Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/19885
User info isn't picked up from the URL, it's taken off your Kerberos
credentials. If you are running HDFS unkerberized, then UGI takes it from the
environment variable `HADOOP_USER_NAME`.
Looking at the `DFSClient` code, it's done in
```
this.ugi = UserGroupInformation.getCurrentUser();
```
Also looking at that code, I'm not convinced that using user@hdfs wouldn't
up causing confusion, especially in the world of HA HDFS. You'd really need to
experiment to see if you could break things.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
