If it's simply reading the files from source in HDFS then we have an option of sc.hadoopFile in spark API Not sure if Spark SQL provides direct method to read
On Jan 18, 2018 9:32 PM, "Michael Segel" <msegel_had...@hotmail.com> wrote: > No idea on how that last line of garbage got in the message. > > > > On Jan 18, 2018, at 9:32 AM, Michael Segel <msegel_had...@hotmail.com> > wrote: > > > > Hi, > > > > I’m trying to find out if there’s a simple way for Spark to be able to > read an RCFile. > > > > I know I can create a table in Hive, then drop the files in to that > directory and use a sql context to read the file from Hive, however I > wanted to read the file directly. > > > > Not a lot of details to go on… even the Apache site’s links are broken. > > See : > > https://cwiki.apache.org/confluence/display/Hive/RCFile > > > > Then try to follow the Javadoc link. > > > > > > Any suggestions? > > > > Thx > > > > -Mike > > > > >
