Hi Jacin,
If I was you, first thing that I would do is, write a sample java
application to write data into hdfs and see if it's working fine. Meta data
is being created in hdfs, that means, communication to namenode is working
fine but not to datanodes since you don't see any data inside the file.
Yes printing the result with collect or take is working,
actually this is a minimal example, but also when working with real data the
actions are performed, and the resulting RDDs can be printed out without
problem. The data is there and the operations are correct, they just cannot be
written t
bq. val dist = sc.parallelize(l)
Following the above, can you call, e.g. count() on dist before saving ?
Cheers
On Fri, Oct 2, 2015 at 1:21 AM, jarias wrote:
> Dear list,
>
> I'm experimenting a problem when trying to write any RDD to HDFS. I've
> tried
> with minimal examples, scala programs
