Erik Erlandson created SPARK-2315:
-------------------------------------
Summary: drop, dropRight and dropWhile which take RDD input and
return RDD
Key: SPARK-2315
URL: https://issues.apache.org/jira/browse/SPARK-2315
Project: Spark
Issue Type: New Feature
Components: Spark Core
Reporter: Erik Erlandson
Last time I loaded in a text file, I found myself wanting to just skip the
first element as it was a header. I wrote candidate methods drop, dropRight
and dropWhile to satisfy this kind of need:
val txt = sc.textFile("text_with_header.txt")
val data = txt.drop(1)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
