Re: Top, takeOrdered, sortByKey

2015-03-11 Thread Saba Sehrish
oesn't take that much longer is probably b/c of the overhead of just launching the jobs. On Mon, Mar 9, 2015 at 4:21 PM, Saba Sehrish mailto:ssehr...@fnal.gov>> wrote: From: Saba Sehrish mailto:ssehr...@fnal.gov>> Date: March 9, 2015 at 4:11:07 PM CDT To: mailto:user-...@sp

Re: Top, takeOrdered, sortByKey

2015-03-11 Thread Imran Rashid
M, Saba Sehrish wrote: > > > *From:* Saba Sehrish > *Date:* March 9, 2015 at 4:11:07 PM CDT > *To:* > *Subject:* *Using top, takeOrdered, sortByKey* > > I am using spark for a template matching problem. We have 77 million > events in the template library, and we c

Top, takeOrdered, sortByKey

2015-03-09 Thread Saba Sehrish
From: Saba Sehrish mailto:ssehr...@fnal.gov>> Date: March 9, 2015 at 4:11:07 PM CDT To: mailto:user-...@spark.apache.org>> Subject: Using top, takeOrdered, sortByKey I am using spark for a template matching problem. We have 77 million events in the template library, and we compa