Re: How to use custom Hadoop InputFormat in DataFrame?

2015-08-10 Thread Umesh Kacha
myFormatAsPairRdd.values(); >> DataFrame myFormatAsDataframe = >> sqlContext.createDataFrame(myformatRdd,??); >> >> In above code what should I put in place of ?? I tried to put >> MyRecordWritable.class but it does not work as it is not schema it is >> Record

Re: How to use custom Hadoop InputFormat in DataFrame?

2015-08-10 Thread Michael Armbrust
gt; DataFrame myFormatAsDataframe = sqlContext.createDataFrame(myformatRdd,??); > > In above code what should I put in place of ?? I tried to put > MyRecordWritable.class but it does not work as it is not schema it is > Record > Writable. Please guide. > > > > -- > View this

How to use custom Hadoop InputFormat in DataFrame?

2015-08-10 Thread unk1102
le. Please guide. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-custom-Hadoop-InputFormat-in-DataFrame-tp24198.html Sent from the Apache Spark User List mailing list archive at