Erik Erlandson created SPARK-2315: ------------------------------------- Summary: drop, dropRight and dropWhile which take RDD input and return RDD Key: SPARK-2315 URL: https://issues.apache.org/jira/browse/SPARK-2315 Project: Spark Issue Type: New Feature Components: Spark Core Reporter: Erik Erlandson
Last time I loaded in a text file, I found myself wanting to just skip the first element as it was a header. I wrote candidate methods drop, dropRight and dropWhile to satisfy this kind of need: val txt = sc.textFile("text_with_header.txt") val data = txt.drop(1) -- This message was sent by Atlassian JIRA (v6.2#6252)