I guess on a technicality the docs just say "first item in this RDD", not "first line in the source text file". AFAIK there is no way apart from filtering to remove header lines <http://stackoverflow.com/a/24734612/877069>.
As long as first() always returns the same value for a given RDD, I think it's fine, no? Nick On Sun Feb 22 2015 at 9:09:01 PM Michael Malak <michaelma...@yahoo.com.invalid> wrote: > Since RDDs are generally unordered, aren't things like textFile().first() > not guaranteed to return the first row (such as looking for a header row)? > If so, doesn't that make the example in > http://spark.apache.org/docs/1.2.1/quick-start.html#basics misleading? > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional commands, e-mail: dev-h...@spark.apache.org > >
