Hi Vipul Have you tried looking at the HBase and Cassandra examples under the spark example project? These use custom InputFormats and may provide guidance as to how to go about using the relevant Protobuf inputformat.
On Mon, Jan 20, 2014 at 11:48 PM, Vipul Pandey <[email protected]> wrote: > Any suggestions, anyone? > Core team / contributors / spark-developers - any thoughts? > > On Jan 17, 2014, at 4:45 PM, Vipul Pandey <[email protected]> wrote: > > Hi All, > > Can someone please share (sample) code to read lzo compressed protobufs > from hdfs (using elephant bird)? I'm trying whatever I see in the forum and > on the web but it doesn't seem comprehensive to me. > > I'm using Spark0.8.0 . My pig scripts are able to read protobuf just fine > so the hadoop layer is setup alright. It will be really helpful if someone > can list out what needs to be done with/in spark. > > ~Vipul > > >
