Hi,
Naga has kindly suggested here that I should push the file into RDD and get
rid of header. But my partitions have hundreds of files in it and just
opening and processing the files using RDD is a way old method of working.
I think that SPARK community has moved on from RDD, to Dataframes to
Hi,
According to this thread https://issues.apache.org/jira/browse/SPARK-11374.
SPARK will not resolve the issue of skipping header option when the table
is defined in HIVE.
But I am unable to see a SPARK SQL option for setting up external
partitioned table.
Does that mean in case I have to
