Nop. 

My input file's format is:
!!
string1
string2
!!
string3
string4

sc.textFile("path) will return RDD("!!", "string1", "string2", "!!",
"string3", "string4")

what we need now is to transform this rdd to RDD("string1", "string2",
"string3", "string4")

your solution may not handle this.



-----
Senior in Tsinghua Univ.
github: http://www.github.com/uronce-cc
--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Confusing-behavior-of-newAPIHadoopFile-tp10764p10777.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Reply via email to