Re: How to read remote HDFS from Spark using username?

If it is so, how to update/fix the firewall issue? On Wed, Oct 3, 2018 at 1:14 PM Jörn Franke wrote: > Looks like a firewall issue > > Am 03.10.2018 um 09:34 schrieb Aakash Basu : > > The stacktrace is below - > > --- >>

Re: How to read remote HDFS from Spark using username?

Looks like a firewall issue > Am 03.10.2018 um 09:34 schrieb Aakash Basu : > > The stacktrace is below - > >> --- >> Py4JJavaError Traceback (most recent call last) >> in () >> > 1 df = >>

Re: How to read remote HDFS from Spark using username?

The stacktrace is below - --- > Py4JJavaError Traceback (most recent call last) > in () > > 1 df = spark.read.load("hdfs:// >

How to read remote HDFS from Spark using username?

Hi, I have to read data stored in HDFS of a different machine and needs to be accessed through Spark for being read. How to do that? Full HDFS address along with port doesn't seem to work. Anyone did it before? Thanks, AB.