Nop. My input file's format is: !! string1 string2 !! string3 string4
sc.textFile("path) will return RDD("!!", "string1", "string2", "!!", "string3", "string4") what we need now is to transform this rdd to RDD("string1", "string2", "string3", "string4") your solution may not handle this. ----- Senior in Tsinghua Univ. github: http://www.github.com/uronce-cc -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Confusing-behavior-of-newAPIHadoopFile-tp10764p10777.html Sent from the Apache Spark User List mailing list archive at Nabble.com.