Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21216
> This is a valid configuration and it is the easiest configuration for
HDFS federation.
I disagree that it is federation. It's just declaring multiple HDFS
services in the same config file. Federation means multiple services with a
single namespace, using mount points, and you don't have that here.
That doesn't mean that you can't add this code. But at that point I'd like
to see what an actual federated HDFS configuration looks like (don't remember
off the top of my head), since you shouldn't be doing duplicate work. Things
that are handled by viewfs should not be handled again by this code.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
