I can do this
val hadoopConf = new Configuration(sc.hadoopConfiguration)
* hadoopConf.set("mapreduce.input.fileinputformat.split.maxsize",
"67108864")*
sc.newAPIHadoopFile(
path + "/*.avro",
classOf[AvroKeyInputFormat[GenericRecord]],
classOf[AvroKey[GenericRecord]],
classOf[NullWritable],
hadoopConf)
But i cant do the same with
sc.sequenceFile("path", classOf[Text], classOf[Text])
How can i achieve the same with sequenceFile
--
Deepak
