i am having a text file. Each line is a record and first ten characters on each line is a date in YYYY-MM-DD format.
i would like to run a map function on this RDD with specific date range. (i.e from 2005 -01-01 to 2007-12-31). I would like to avoid reading the records out of the specified data range. (i.e kind of primary index sorted by date) is there way to implement this?
