On Mon, Feb 11, 2019 at 2:18 PM Schile,Nathan
wrote:
> You would compare the webhdfs addresses from
> DFSUtil.getHaNnWebHdfsAddresses(conf, srcFs.getScheme()) to the hdfs
> addresses from FSHDFSUtils.getNNAddresses(desFs, conf) and see if there is
> an intersection. Something like the below. My a
You would compare the webhdfs addresses from
DFSUtil.getHaNnWebHdfsAddresses(conf, srcFs.getScheme()) to the hdfs addresses
from FSHDFSUtils.getNNAddresses(desFs, conf) and see if there is an
intersection. Something like the below. My assumption being that the same host
runs both hdfs and webhd
How do we know if a webhdfs is the same with a hdfs?
Schile,Nathan 于2019年2月11日周一 下午1:25写道：
> Currently when bulk loading from a webhdfs filesystem, files are copied
> rather than renamed if they reside on the same cluster [1]. This causes the
> bulk load to not perform optimally.
>
>
>
> It seem
